10000000:01000000:0.0:1788985739.995592:0:59765:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985739.995614:0:59765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf546f34 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 59765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985739.995631:0:59765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf546f18 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf546f11 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985739.995639:0:59765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf546f34 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 59765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985739.995672:0:59765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf546f18 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf546f11 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985739.995685:0:59765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf546f18 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf546f11 expref: 18 pid: 5848 timeout: 1623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985739.995697:0:59765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59765:1875885993356544:0@lo:104: 00000100:00100000:0.0:1788985739.995755:0:59765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985739.995818:0:59765:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161540 going to sleep for 11 seconds 00000100:00100000:0.0:1788985739.996532:0:59765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:59765:1875885993356544:0@lo:104: 00010000:00010000:0.0:1788985739.996551:0:59765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf546f34 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 59765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985739.997640:0:59765:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf546f34 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985739.997649:0:59765:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf546f34 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985739.997654:0:59765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf546f34 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 59765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788985743.143367:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788985743.151247:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788985743.168397:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985743.203951:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971138944 00000100:00100000:0.0:1788985743.203961:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971138944 00000100:00100000:0.0:1788985743.204027:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 201 00000100:00100000:0.0:1788985743.204038:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:35475:x1875885971138944:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788985743.204440:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:35475:x1875885971138944:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 403us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985743.204448:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 201 00000001:00100000:0.0:1788985743.442174:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000001:00080000:0.0:1788985744.798387:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967449 is committed 00000100:00100000:0.0:1788985745.410475:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788985745.410505:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993357952:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985745.410595:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985745.410688:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993357952 00000100:00100000:0.0:1788985745.410699:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993357952 00000100:00100000:0.0:1788985745.410787:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1788985745.410799:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993357952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788985745.411021:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985745.411114:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993357952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 291us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985745.411122:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1788985746.432852:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993358336:0@lo:400:kworker.0 00000100:00100000:0.0:1788985746.432929:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985746.433016:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788985746.433028:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993358464:0@lo:400:kworker.0 00000100:00100000:0.0:1788985746.433082:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985746.945316:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993358848:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985746.945406:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985747.731039:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000004:00080000:0.0:1788985750.106725:0:60156:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1534009622238ns, next at 1509293275120ns, rc = 0 00000004:00080000:0.0:1788985750.106956:0:60156:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1534009866159ns, next at 1532754994930ns, rc = 0 00000100:00100000:0.0:1788985750.177030:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993358976:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788985750.177148:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788985750.178145:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985750.188705:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971142016 00000100:00100000:0.0:1788985750.188730:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971142016 00010000:00010000:0.0:1788985750.188817:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000651ca737/0xc20d828fcf546f8f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ca7 expref: 6 pid: 6695 timeout: 1634 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985750.189020:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 287 00000100:00100000:0.0:1788985750.189033:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971142016:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788985750.189054:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985750.189061:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000651ca737/0xc20d828fcf546f8f lrc: 5/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ca7 expref: 6 pid: 6695 timeout: 1634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985750.189076:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000651ca737/0xc20d828fcf546f8f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ca7 expref: 6 pid: 6695 timeout: 1634 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985750.189154:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788985750.189177:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788985750.189184:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000270b3612/0xc20d828fcf546fb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985750.189196:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000270b3612/0xc20d828fcf546fb2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985750.189223:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788985750.189298:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971142016:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 267us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985750.189307:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 287 00010000:00010000:0.0:1788985750.466083:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985750.528952:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993359232 00000100:00100000:0.0:1788985750.528964:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993359232 00000100:00100000:0.0:1788985750.529053:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1788985750.529068:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993359232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788985750.529134:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985750.529223:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79724380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993359232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985750.529233:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:0.0:1788985751.553123:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993359616:0@lo:400:kworker.0 00000100:00100000:0.0:1788985751.553204:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985751.553285:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985751.553334:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1788985751.553346:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993359616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985751.553408:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993359616:12345-0@lo:400:kworker.0 Request processed in 64us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985751.553435:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1788985751.553483:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993359488:0@lo:400:kworker.0 00000100:00100000:0.0:1788985751.553514:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094139d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993359616:0@lo:400:kworker.0 00000100:00100000:0.0:1788985751.559306:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993359744 00000100:00100000:0.0:1788985751.559388:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993359744 00000100:00100000:0.0:1788985751.559420:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1788985751.559427:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993359744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985751.559466:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993359744:12345-0@lo:400:kworker.0 Request processed in 40us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985751.559472:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1788985751.562748:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993360000:0@lo:400:kworker.0 00000100:00100000:0.0:1788985751.562788:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985751.562831:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993360000 00000100:00100000:0.0:1788985751.562838:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993360000 00000100:00100000:0.0:1788985751.562876:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1788985751.562885:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993360000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985751.562935:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993360000:12345-0@lo:400:kworker.0 Request processed in 50us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985751.563293:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:0.0:1788985751.563420:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094139fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993360000:0@lo:400:kworker.0 00000100:00100000:0.0:1788985752.064349:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993360128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985752.064420:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788985752.512831:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788985752.676606:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00010000:00010000:0.0:1788985754.560411:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985756.608278:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985756.673419:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993360640 00000100:00100000:0.0:1788985756.673427:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993360640 00000100:00100000:0.0:1788985756.673481:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993360896 00000100:00100000:0.0:1788985756.673485:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993360896 00000100:00100000:0.0:1788985756.673512:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993360512 00000100:00100000:0.0:1788985756.673516:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993360512 00000100:00100000:0.0:1788985756.673534:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1788985756.673543:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993360640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985756.680034:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993360640:12345-0@lo:400:kworker.0 Request processed in 6485us (7009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985756.680050:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1788985757.195031:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993361152 00000100:00100000:0.0:1788985757.195044:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993361152 00010000:00010000:0.0:1788985758.656510:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985758.833925:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 687 00000100:00100000:0.0:1788985758.833943:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971142912:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985758.844191:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971142912:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 10240us (10902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985758.844208:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 687 00010000:00010000:0.0:1788985760.704480:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985760.769696:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993361280 00000100:00100000:0.0:1788985760.769704:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993361280 00000100:00100000:0.0:1788985760.769781:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1788985760.769792:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993361280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788985760.769831:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985760.769888:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993361280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985760.769903:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00100000:0.0:1788985761.794436:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993361792 00000100:00100000:0.0:1788985761.794447:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993361792 00000100:00100000:0.0:1788985761.794509:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:0.0:1788985761.794519:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993361792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985761.794829:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993361792:12345-0@lo:400:kworker.0 Request processed in 312us (2011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985761.794838:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00100000:0.0:1788985762.304952:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993362176 00000100:00100000:0.0:1788985762.304963:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993362176 00000100:00100000:0.0:1788985762.305028:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:0.0:1788985762.305039:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993362176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985762.305083:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985762.305175:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993362176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985762.305183:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00010000:00010000:0.0:1788985762.754547:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985763.957612:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971143296 00000100:00100000:0.0:1788985763.957618:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971143296 00000100:00100000:0.0:1788985763.957675:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1052 00000100:00100000:0.0:1788985763.957686:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971143296:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985763.957721:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971143296:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 39us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985763.957727:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1052 00010000:00010000:0.0:1788985764.800431:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985765.893362:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79797100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993362304:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788985766.849468:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985766.914401:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993362816 00000100:00100000:0.0:1788985766.914412:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993362816 00000100:00100000:0.0:1788985766.914472:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993363072 00000100:00100000:0.0:1788985766.914476:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993363072 00000100:00100000:0.0:1788985766.914534:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1788985766.914545:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993362816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985766.914644:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993362816:12345-0@lo:400:kworker.0 Request processed in 101us (1993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985766.914651:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1788985766.914668:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1788985766.914675:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993363072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985766.914705:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993363072:12345-0@lo:400:kworker.0 Request processed in 32us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985766.914711:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1788985766.914762:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a808cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993362816:0@lo:400:kworker.0 00000100:00100000:0.0:1788985766.915843:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a808c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993362944:0@lo:400:kworker.0 00000100:00100000:0.0:1788985766.916239:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993362688 00000100:00100000:0.0:1788985766.916245:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993362688 00000100:00100000:0.0:1788985766.916306:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1788985766.916314:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993362688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985766.916359:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993362688:12345-0@lo:400:kworker.0 Request processed in 46us (2953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985766.916366:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1788985768.253026:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971143680 00000100:00100000:0.0:1788985768.253040:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971143680 00000100:00100000:0.0:1788985768.253184:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 399 00000100:00100000:0.0:1788985768.253198:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:35933:x1875885971143680:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788985768.253333:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:35933:x1875885971143680:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 138us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985768.253342:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 399 00000100:00100000:0.0:1788985768.265591:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:0.0:1788985768.266806:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985768.269401:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:0.0:1788985768.270743:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788985771.028119:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788985771.968387:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985772.037571:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993364096 00000100:00100000:0.0:1788985772.037578:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993364096 00000100:00100000:0.0:1788985772.037632:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1788985772.037641:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993364096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985772.037904:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993364096:12345-0@lo:400:kworker.0 Request processed in 264us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985772.037912:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:0.0:1788985772.038145:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993363968 00000100:00100000:0.0:1788985772.038150:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993363968 00000100:00100000:0.0:1788985772.038182:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1788985772.038189:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993363968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985772.038225:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993363968:12345-0@lo:400:kworker.0 Request processed in 37us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985772.038231:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1788985772.038917:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993363712 00000100:00100000:0.0:1788985772.038921:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993363712 00000100:00100000:0.0:1788985772.038953:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1788985772.038970:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993363712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985772.039009:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993363712:12345-0@lo:400:kworker.0 Request processed in 40us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985772.039015:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1788985772.041750:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993363840 00000100:00100000:0.0:1788985772.041755:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993363840 00000100:00100000:0.0:1788985772.041803:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1788985772.041811:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993363840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985772.041852:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993363840:12345-0@lo:400:kworker.0 Request processed in 43us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985772.041858:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1788985774.203392:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971145728 00000100:00100000:0.0:1788985774.203397:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971145728 00000100:00100000:0.0:1788985774.203426:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1060 00000100:00100000:0.0:1788985774.203433:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971145728:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985774.203475:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971145728:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 42us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985774.203482:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1060 00000100:00100000:0.0:1788985774.333000:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788985774.333014:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993364736 00000100:00100000:0.0:1788985774.333020:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993364736 00000100:00100000:0.0:1788985774.333070:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788985774.333079:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a60678450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:60670:x1875885993364736:12345-0@lo:104: 00010000:00010000:0.0:1788985774.333107:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf546fc0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf546fc7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985774.333165:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985774.333178:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a60678450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:60670:x1875885993364736:12345-0@lo:104: Request processed in 100us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985774.333185:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00010000:0.0:1788985774.334860:0:60670:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf546fe3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985774.334869:0:60670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf546fe3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985774.334875:0:60670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf546fe3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985776.128724:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788985776.128746:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993365120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985776.128809:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985776.128869:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993365120 00000100:00100000:0.0:1788985776.128877:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993365120 00000100:00100000:0.0:1788985776.128941:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:0.0:1788985776.128951:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993365120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788985776.128983:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985776.129023:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993365120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985776.129029:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00000100:00100000:0.0:1788985776.129074:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993365120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985777.164736:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993365504:0@lo:400:kworker.0 00000100:00100000:0.0:1788985777.164797:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985777.164844:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993365504 00000100:00100000:0.0:1788985777.164850:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993365504 00000100:00100000:0.0:1788985777.164929:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1788985777.164940:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993365504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985777.165001:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993365504:12345-0@lo:400:kworker.0 Request processed in 64us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985777.165007:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00080000:0.0:1788985777.165028:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985777.165063:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79725f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993365504:0@lo:400:kworker.0 00000100:00100000:0.0:1788985777.170029:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993365376 00000100:00100000:0.0:1788985777.170036:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993365376 00000100:00100000:0.0:1788985777.170083:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1788985777.170111:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993365376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985777.170191:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993365376:12345-0@lo:400:kworker.0 Request processed in 82us (4506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985777.170198:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00080000:0.0:1788985777.170219:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985777.170243:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993365376:0@lo:400:kworker.0 00000100:00100000:0.0:1788985777.258786:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971146112 00000100:00100000:0.0:1788985777.258797:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971146112 00000100:00100000:0.0:1788985777.259265:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 405 00000100:00100000:0.0:1788985777.259277:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:36097:x1875885971146112:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788985777.259295:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985777.259317:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf546ff8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0cb5 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.259375:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf546fff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.259402:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf546fff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.259415:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf546fff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.259430:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547006 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.259436:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.259443:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.259842:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54700d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.259852:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54700d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260267:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54700d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985777.260292:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00000004:00200000:0.0:1788985777.260296:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788985777.260314:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54700d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260324:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf546fff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260342:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf546fff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260349:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf546fff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260354:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985777.260359:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf546fff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260366:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf546fff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260377:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:0.0:1788985777.260380:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985777.260384:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf546fff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260389:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf546fff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260400:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547006 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260407:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547006 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260413:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547006 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260418:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985777.260424:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547006 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260430:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547006 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260437:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9b0a4823be00) 00010000:00010000:0.0:1788985777.260439:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985777.260441:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547006 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260447:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547006 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260539:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf546ff8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0cb5 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260557:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54700d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0cb5 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.260565:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:0.0:1788985777.260577:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788985777.260580:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eec00, rc 0) 00000100:00100000:0.0:1788985777.260647:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:36097:x1875885971146112:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 1372us (4391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985777.260655:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 405 00000100:00100000:0.0:1788985777.264665:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985777.274836:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971146752 00000100:00100000:0.0:1788985777.274843:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971146752 00000100:00100000:0.0:1788985777.274887:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 408 00000100:00100000:0.0:1788985777.274905:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:36097:x1875885971146752:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788985777.274923:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985777.274939:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54703e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0cc3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.274983:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54703e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0cc3 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.274996:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54703e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x22:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0cc3 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.275011:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:0.0:1788985777.275014:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788985777.275016:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee000, rc 0) 00000100:00100000:0.0:1788985777.275068:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:36097:x1875885971146752:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 165us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985777.275074:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 408 00000100:00100000:0.0:1788985777.334923:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971147264 00000100:00100000:0.0:1788985777.334932:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971147264 00000100:00100000:0.0:1788985777.334994:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 409 00000100:00100000:0.0:1788985777.335004:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:36101:x1875885971147264:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:0.0:1788985777.335027:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985777.335058:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547045 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0cca expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335154:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54704c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335184:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54704c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335196:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54704c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335213:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547053 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335221:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335227:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335306:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54705a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x22:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335315:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54705a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335323:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54705a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985777.335355:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x22:0x0]: returning size 0 00000004:00200000:0.0:1788985777.335359:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788985777.335377:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54705a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335389:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54705a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335407:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54704c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335415:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54704c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335423:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54704c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335429:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985777.335434:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54704c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335442:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54704c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335453:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:0.0:1788985777.335456:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985777.335460:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54704c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335467:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54704c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335479:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547053 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335485:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547053 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335490:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335501:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985777.335505:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547053 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335511:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547053 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335519:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x93c5647 (ffff9b0a4823be00) 00010000:00010000:0.0:1788985777.335522:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985777.335524:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547053 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335530:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335559:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547045 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0cca expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335584:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54705a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x22:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0cca expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985777.335593:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x22:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:0.0:1788985777.335595:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788985777.335598:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efe00, rc 0) 00000100:00100000:0.0:1788985777.335644:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:36101:x1875885971147264:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 641us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985777.335651:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 409 00000100:00100000:0.0:1788985778.755003:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:0.0:1788985778.767534:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985778.767542:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf547084 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985778.767551:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788985778.767556:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf547084 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985778.767577:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf547084 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985778.767597:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf547084 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985778.767606:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf547084 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985778.767625:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985778.767627:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985778.767629:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788985778.774436:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b09413aca80/2, rc 0, transno 4294967324 00000100:00100000:0.0:1788985778.774450:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993366144:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788985778.784376:0:60916:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788985778.784410:0:60916:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:0.0:1788985778.784414:0:60916:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788985778.784424:0:60916:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54700d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0cb5 expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985778.784460:0:60916:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1788985778.784478:0:60916:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985778.784492:0:60916:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54708b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985778.784505:0:60916:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf546ff1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf546fea expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985778.784513:0:60916:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54708b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60916 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985778.784547:0:60916:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf546ff1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf546fea expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985778.784571:0:60916:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf546ff1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf546fea expref: 18 pid: 5849 timeout: 1662 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985778.784585:0:60916:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a808ca300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:60916:1875885993366400:0@lo:104: 00000100:00100000:0.0:1788985778.784642:0:60916:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985778.784716:0:60916:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c1540 going to sleep for 11 seconds 00000100:00100000:0.0:1788985778.788392:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788985778.788405:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:60916:x1875885993366400:12345-0@lo:104: 00010000:00010000:0.0:1788985778.788424:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf546fea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf546ff1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985778.788598:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985778.788606:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:60916:x1875885993366400:12345-0@lo:104: Request processed in 204us (3964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985778.788629:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00010000:00010000:0.0:1788985779.136326:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985781.532947:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971148544 00000100:00100000:0.0:1788985781.532956:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971148544 00000100:00100000:0.0:1788985781.533023:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 412 00000100:00100000:0.0:1788985781.533034:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:36189:x1875885971148544:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788985781.533080:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788985781.533143:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5470a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0cd8 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985781.533158:0:5855:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf54700d) 00010000:00010000:0.0:1788985781.533162:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:0.0:1788985781.533171:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985781.533193:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5470ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985781.533204:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5470ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985781.533213:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5470ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788985781.623686:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ff75a4e2 reply state 000000001339616e transno 4294967456 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5470ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985781.623703:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788985781.623717:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00000100:00100000:0.0:1788985781.623824:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:36189:x1875885971148544:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 90788us (90975us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1788985781.623848:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 412 00000100:00100000:0.0:1788985782.275356:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993366912:0@lo:400:kworker.0 00000100:00100000:0.0:1788985782.275388:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985782.275411:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993367424:0@lo:400:kworker.0 00000100:00100000:0.0:1788985782.275436:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985782.275605:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993367552 00000100:00100000:0.0:1788985782.275612:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993367552 00000100:00100000:0.0:1788985782.275657:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993367296 00000100:00100000:0.0:1788985782.275660:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993367296 00000100:00100000:0.0:1788985782.275679:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1788985782.275687:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993367552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985782.275734:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993367552:12345-0@lo:400:kworker.0 Request processed in 48us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985782.275741:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1788985782.275757:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1788985782.275764:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993367296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985782.275793:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993367296:12345-0@lo:400:kworker.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985782.275799:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1788985782.275816:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993366912 00000100:00100000:0.0:1788985782.275819:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993366912 00000100:00100000:0.0:1788985782.275855:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:0.0:1788985782.275862:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993366912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985782.275893:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993366912:12345-0@lo:400:kworker.0 Request processed in 31us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985782.275909:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00080000:0.0:1788985782.277536:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788985782.277555:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985782.277598:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993367168:0@lo:400:kworker.0 00000100:00100000:0.0:1788985782.277611:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993367040:0@lo:400:kworker.0 00000100:00100000:0.0:1788985782.277621:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993367552:0@lo:400:kworker.0 00000100:00100000:0.0:1788985782.279067:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993367296:0@lo:400:kworker.0 00000100:00100000:0.0:1788985782.279236:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993366912:0@lo:400:kworker.0 00000100:00100000:0.0:1788985782.279250:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993367424:0@lo:400:kworker.0 00000100:00100000:0.0:1788985782.360055:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993367680 00000100:00100000:0.0:1788985782.360063:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993367680 00000100:00100000:0.0:1788985782.360283:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788985782.360294:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:61112:x1875885993367680:12345-0@lo:104: 00010000:00010000:0.0:1788985782.360308:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547092 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547099 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985782.360380:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985782.360386:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:61112:x1875885993367680:12345-0@lo:104: Request processed in 96us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985782.360393:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788985784.433525:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971148672 00000100:00100000:0.0:1788985784.433541:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971148672 00000100:00100000:0.0:1788985784.433582:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 930 00000100:00100000:0.0:1788985784.433590:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971148672:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985784.433645:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971148672:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 57us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985784.433653:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 930 00000100:00100000:0.0:1788985786.751420:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993368320 00000100:00100000:0.0:1788985786.751428:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993368320 00000100:00100000:0.0:1788985786.751486:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788985786.751656:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:61356:x1875885993368320:12345-0@lo:104: 00010000:00010000:0.0:1788985786.751670:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5470bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5470c3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985786.751743:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985786.751748:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413adf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:61356:x1875885993368320:12345-0@lo:104: Request processed in 96us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985786.758402:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788985787.906979:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993369344 00000100:00100000:0.0:1788985787.906986:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993369344 00000100:00100000:0.0:1788985787.907039:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1788985787.907050:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993369344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985787.907083:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985787.907160:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993369344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985787.907167:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00000100:00100000:0.0:1788985788.104448:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993369472 00000100:00100000:0.0:1788985788.104459:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993369472 00000100:00100000:0.0:1788985788.104529:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:0.0:1788985788.104539:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993369472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985788.104551:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985788.104576:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5470f4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5470ed expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985788.104600:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5470f4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5470ed expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985788.104610:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5470f4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5470ed expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985788.104618:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eea00, rc 0) 00000100:00100000:0.0:1788985788.104665:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993369472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985788.104671:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:0.0:1788985789.559386:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971149312 00000100:00100000:0.0:1788985789.559393:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971149312 00000100:00100000:0.0:1788985789.559443:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 933 00000100:00100000:0.0:1788985789.559452:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971149312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985789.559485:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971149312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985789.559491:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 933 00000100:00100000:0.0:1788985789.575810:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985789.760641:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985789.773900:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000020:00000080:0.0:1788985790.590530:0:61554:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc63066330 20000000:00000080:0.0:1788985790.590722:0:61554:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7fb6f000 uarg=0000000000000000 00010000:00010000:0.0:1788985790.591618:0:61554:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788985790.591635:0:61554:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788985790.591649:0:61554:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985790.591736:0:61554:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547110 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985790.591753:0:61554:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5470f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5470ed expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985790.591761:0:61554:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547110 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985790.591794:0:61554:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5470f4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5470ed expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985790.591807:0:61554:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5470f4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5470ed expref: 18 pid: 5846 timeout: 1674 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985790.591819:0:61554:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79726680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61554:1875885993369600:0@lo:104: 00000100:00100000:0.0:1788985790.591877:0:61554:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985790.592043:0:61554:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c4600 going to sleep for 11 seconds 00000100:00100000:0.0:1788985790.595039:0:61554:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79726680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:61554:1875885993369600:0@lo:104: 00010000:00010000:0.0:1788985790.595062:0:61554:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547110 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985790.599797:0:61554:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547110 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985790.599805:0:61554:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547110 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985790.599812:0:61554:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547110 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61554 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985791.489526:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788985791.491487:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c7a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993369856:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985791.491592:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985793.024548:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993370880 00000100:00100000:0.0:1788985793.024559:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993370880 00000100:00100000:0.0:1788985793.024626:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1788985793.024636:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993370880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985793.024669:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985793.024726:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993370880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985793.024733:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000001:00100000:0.0:1788985793.620403:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:0.0:1788985793.620411:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b09431fa000/d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:0.0:1788985793.749042:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985793.753522:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985793.761873:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985793.773405:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985793.777355:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985793.780852:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985793.941814:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971151872 00000100:00100000:0.0:1788985793.941824:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971151872 00002000:00100000:0.0:1788985793.941878:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0xe:0x0] (0->1048575) req@ffff9b0a761c3b80 x1875885971151872/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:469/0 lens 488/0 e 0 to 0 dl 1788985804 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1788985793.941889:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a761c3b80 with x1875885971151872 ext(0->1048575) 00002000:00010000:0.0:1788985793.941895:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a761c3b80 00000100:00100000:0.0:1788985793.942000:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:0.0:1788985793.942013:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971151872:12345-192.168.206.21@tcp:4:dd.60003 00000100:00100000:0.0:1788985794.007184:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000001:00080000:0.0:1788985794.070815:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:0.0:1788985795.284021:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000004:00080000:0.0:1788985796.576074:0:61801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1580478981738ns, next at 1562247975152ns, rc = 0 00000004:00080000:0.0:1788985796.576203:0:61801:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1580479112895ns, next at 1532754994930ns, rc = 0 00000100:00100000:0.0:1788985797.636963:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993371136:0@lo:400:kworker.0 00000100:00100000:0.0:1788985797.637003:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985797.641948:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993371136:0@lo:400:kworker.0 00000100:00100000:0.0:1788985797.642010:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993371648:0@lo:400:kworker.0 00000100:00100000:0.0:1788985797.642137:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788985797.646485:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985797.647158:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993371648:0@lo:400:kworker.0 00000100:00100000:0.0:1788985797.647862:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993371776 00000100:00100000:0.0:1788985797.647869:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993371776 00000100:00100000:0.0:1788985797.647923:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1788985797.647942:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993371776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985797.647984:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993371776:12345-0@lo:400:kworker.0 Request processed in 54us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985797.647989:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00080000:0.0:1788985797.975390:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788985797.990625:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985797.996602:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:0.0:1788985797.996723:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985798.014214:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971153536 00000100:00100000:0.0:1788985798.014233:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971153536 00000100:00100000:0.0:1788985798.014293:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 425 00000100:00100000:0.0:1788985798.014303:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:36633:x1875885971153536:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788985798.014403:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:36633:x1875885971153536:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 101us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985798.014411:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 425 00000100:00100000:1.0:1788985798.020894:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971153664 00000100:00100000:1.0:1788985798.020903:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971153664 00000100:00100000:1.0:1788985798.020967:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 227 00000100:00100000:1.0:1788985798.020978:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:36633:x1875885971153664:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788985798.021330:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:36633:x1875885971153664:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 353us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985798.021338:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 227 00000100:00100000:1.0:1788985798.025272:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985798.031415:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985798.135253:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971154176 00000100:00100000:0.0:1788985798.135267:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971154176 00000100:00100000:0.0:1788985798.135348:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 427 00000100:00100000:0.0:1788985798.135359:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:36637:x1875885971154176:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:0.0:1788985798.135414:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985798.135444:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54715d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x23:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0cf4 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.135476:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:0.0:1788985798.135489:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985798.135512:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547172 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.135528:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547172 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.135538:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547172 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.135561:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547179 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.135568:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.135588:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.135898:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547180 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.135907:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.135914:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788985798.138083:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].14, 64 off9088 00000004:00080000:0.0:1788985798.138168:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1582041078051ns, next at 1583041074177ns, rc = 0 00010000:00010000:0.0:1788985798.138274:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547187 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x23:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138290:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547187 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138302:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547187 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138311:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547187 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138318:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547187 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138323:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547187 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x23:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138358:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788985798.138382:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547180 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138390:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547180 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138397:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547180 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138403:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985798.138407:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547180 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138416:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547180 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138428:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x23:0x0].0x0 (ffff9b0a4823b000) 00010000:00010000:0.0:1788985798.138432:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788985798.138436:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547180 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138443:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547180 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x23:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138473:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547172 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138480:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547172 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138495:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547172 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138500:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985798.138503:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547172 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138510:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547172 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138518:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:0.0:1788985798.138520:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985798.138523:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547172 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985798.138528:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547172 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788985798.138539:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000caaae137 reply state 00000000f7d5b3b3 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547179 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1e:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985798.138666:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788985798.139010:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:36637:x1875885971154176:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 3648us (3861us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788985798.139019:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 427 00000100:00100000:0.0:1788985798.146520:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788985798.146548:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993371904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985798.146613:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985798.147220:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993371904:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788985799.616498:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985799.798558:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985799.798692:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985799.798738:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971154304 00000100:00100000:0.0:1788985799.798750:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971154304 00000100:00100000:0.0:1788985799.798813:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 938 00000100:00100000:0.0:1788985799.798824:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971154304:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985799.801960:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971154304:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 91us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985799.801994:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 938 00000100:00100000:0.0:1788985799.805911:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985799.806011:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985799.806061:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971154688 00000100:00100000:0.0:1788985799.806073:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971154688 00000100:00100000:0.0:1788985799.806162:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971154560 00000100:00100000:0.0:1788985799.806166:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971154560 00000100:00100000:0.0:1788985799.806197:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 716 00000100:00100000:0.0:1788985799.806210:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971154688:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985799.806296:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971154688:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 90us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985799.806304:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 716 00000100:00100000:0.0:1788985799.806323:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 717 00000100:00100000:0.0:1788985799.806330:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971154560:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985799.806358:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942743100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971154560:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985799.806365:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 717 00000100:00080000:0.0:1788985799.806382:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788985799.806399:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985799.806854:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971154432 00000100:00100000:1.0:1788985799.806862:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971154432 00000100:00100000:1.0:1788985799.806912:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1080 00000100:00100000:1.0:1788985799.806932:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971154432:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985799.806976:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971154432:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 47us (8434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985799.806982:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1080 00000100:00080000:0.0:1788985799.807255:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788985800.352971:0:61945:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1584255879873ns, next at 1562247975152ns, rc = 0 00000004:00080000:1.0:1788985800.353064:0:61945:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1584255973777ns, next at 1583041074177ns, rc = 0 00000001:00080000:1.0:1788985800.397519:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1788985800.397529:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 35 committed 00000100:00100000:1.0:1788985800.397745:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993372032:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788985800.397815:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788985800.398429:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788985800.398984:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 36 committed 00000004:00080000:1.0:1788985800.399036:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 35 committed 00000100:00100000:0.0:1788985800.405687:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:0.0:1788985800.406659:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001bbddf59/0xc20d828fcf54718e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985800.406670:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bbddf59/0xc20d828fcf54718e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985800.406681:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bbddf59/0xc20d828fcf54718e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985800.406689:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bbddf59/0xc20d828fcf54718e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985800.406709:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788985800.407302:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993372032:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9151us (9486us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1788985800.407327:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000004:00080000:1.0:1788985800.408053:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b09413ac000/2, rc 0, transno 4294967324 00000100:00100000:1.0:1788985800.408069:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993372032:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788985800.640314:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788985801.730068:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788985802.688467:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985802.754256:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993372672:0@lo:400:kworker.0 00000100:00100000:1.0:1788985802.754327:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993372800:0@lo:400:kworker.0 00000100:00100000:0.0:1788985802.754407:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985802.754503:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993372672 00000100:00100000:0.0:1788985802.754511:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993372672 00000100:00100000:0.0:1788985802.754566:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788985802.754575:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993372672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985802.754626:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993372672:12345-0@lo:400:kworker.0 Request processed in 52us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985802.754645:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00080000:0.0:1788985802.754673:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985802.754703:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942740e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993372672:0@lo:400:kworker.0 00000100:00100000:1.0:1788985802.762257:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985802.762509:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993372800 00000100:00100000:1.0:1788985802.762518:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993372800 00000100:00100000:1.0:1788985802.762736:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1788985802.762746:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993372800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985802.762803:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993372800:12345-0@lo:400:kworker.0 Request processed in 59us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985802.762809:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:1.0:1788985802.762850:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993372800:0@lo:400:kworker.0 00000100:00100000:0.0:1788985802.763210:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993372544 00000100:00100000:0.0:1788985802.763216:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993372544 00000100:00100000:0.0:1788985802.763247:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1788985802.763253:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993372544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985802.763816:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993372416 00000100:00100000:1.0:1788985802.763820:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993372416 00000100:00100000:1.0:1788985802.763857:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1788985802.763873:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993372416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985802.763914:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993372416:12345-0@lo:400:kworker.0 Request processed in 43us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985802.763921:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:1.0:1788985802.764035:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993372928 00000100:00100000:1.0:1788985802.764040:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993372928 00000100:00100000:1.0:1788985802.764067:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1788985802.764073:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993372928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985802.764121:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993372928:12345-0@lo:400:kworker.0 Request processed in 47us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985802.764142:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1788985802.767456:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993372544:12345-0@lo:400:kworker.0 Request processed in 4193us (7154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985802.767473:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00080000:0.0:1788985802.767532:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788985802.767539:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985802.767591:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942742d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993372544:0@lo:400:kworker.0 00000100:00100000:1.0:1788985802.768233:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993373056:0@lo:400:kworker.0 00000100:00100000:1.0:1788985803.264454:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993373184 00000100:00100000:1.0:1788985803.264463:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993373184 00000100:00100000:1.0:1788985803.264516:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1788985803.264526:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993373184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985803.264561:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788985803.264611:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993373184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985803.264617:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:1.0:1788985803.264663:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993373184:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788985803.332169:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:0.0:1788985804.736446:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985804.918604:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985804.918641:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985804.918668:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985804.918706:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985804.918733:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971155200 00000100:00100000:0.0:1788985804.918742:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971155200 00000100:00100000:0.0:1788985804.918788:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971155328 00000100:00100000:0.0:1788985804.918790:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971155328 00000100:00100000:0.0:1788985804.918809:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 720 00000100:00100000:0.0:1788985804.918818:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971155200:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985804.918874:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942742d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971155200:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 57us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985804.918906:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 720 00000100:00100000:0.0:1788985804.918922:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 721 00000100:00100000:0.0:1788985804.918928:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971155328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985804.918949:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942740a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971155328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 21us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985804.918954:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 721 00000100:00080000:0.0:1788985804.918968:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788985804.918972:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985804.919405:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971154944 00000100:00100000:1.0:1788985804.919410:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971154944 00000100:00100000:1.0:1788985804.919449:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 940 00000100:00100000:1.0:1788985804.919456:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971154944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985804.919479:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971154944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985804.919485:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 940 00000100:00080000:0.0:1788985804.919822:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788985806.785233:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985806.854378:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993373312 00000100:00100000:1.0:1788985806.854398:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993373312 00000100:00100000:1.0:1788985806.854471:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1788985806.854481:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993373312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788985806.854517:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788985806.854579:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993373312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985806.854598:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00080000:0.0:1788985806.856003:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985807.872988:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993373440:0@lo:400:kworker.0 00000100:00100000:0.0:1788985807.873085:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985807.873235:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993373568:0@lo:400:kworker.0 00000100:00100000:1.0:1788985807.877140:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993373696:0@lo:400:kworker.0 00000100:00100000:1.0:1788985807.877224:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985807.877302:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788985807.877310:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993374080:0@lo:400:kworker.0 00000100:00100000:1.0:1788985807.877339:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985807.877381:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993373696 00000100:00100000:1.0:1788985807.877390:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993373696 00000100:00100000:1.0:1788985807.877472:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1788985807.877484:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993373696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985807.877544:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993373696:12345-0@lo:400:kworker.0 Request processed in 62us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985807.877551:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1788985807.878165:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993373696:0@lo:400:kworker.0 00000100:00100000:1.0:1788985807.878221:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993374080 00000100:00100000:1.0:1788985807.878226:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993374080 00000100:00100000:1.0:1788985807.878268:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1788985807.878276:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993374080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985807.878326:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993374080:12345-0@lo:400:kworker.0 Request processed in 51us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985807.878333:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00100000:1.0:1788985807.878354:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993373440 00000100:00100000:1.0:1788985807.878358:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993373440 00000100:00100000:1.0:1788985807.878382:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:1.0:1788985807.878419:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993373440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985807.878454:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993373440:12345-0@lo:400:kworker.0 Request processed in 51us (5370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985807.878461:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:1.0:1788985807.878493:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788985807.878499:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b09413ac000, transno 4294967324 00000100:00100000:1.0:1788985807.878512:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993374080:0@lo:400:kworker.0 00000100:00080000:1.0:1788985807.881914:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985807.881926:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985807.881954:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993373568 00000100:00100000:1.0:1788985807.881964:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993373568 00000100:00100000:1.0:1788985807.882027:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1788985807.882037:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993373568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985807.882155:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993373568:12345-0@lo:400:kworker.0 Request processed in 120us (3019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985807.882163:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1788985807.888655:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993373440:0@lo:400:kworker.0 00000100:00100000:0.0:1788985807.888703:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993373952:0@lo:400:kworker.0 00000100:00100000:0.0:1788985807.888779:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985807.888822:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993373952 00000100:00100000:0.0:1788985807.888830:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993373952 00000100:00100000:0.0:1788985807.888897:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:0.0:1788985807.888906:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993373952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985807.888959:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993373952:12345-0@lo:400:kworker.0 Request processed in 54us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985807.888966:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00080000:0.0:1788985807.888990:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985807.889014:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993373952:0@lo:400:kworker.0 00000100:00100000:0.0:1788985807.895736:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993373824 00000100:00100000:0.0:1788985807.895753:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993373824 00000100:00100000:0.0:1788985807.895845:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1788985807.895856:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993373824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985807.895962:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993373824:12345-0@lo:400:kworker.0 Request processed in 109us (6755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985807.895969:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:0.0:1788985807.896029:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993373824:0@lo:400:kworker.0 00000100:00100000:1.0:1788985808.388471:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993374208:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985808.388562:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985808.390452:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993374208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788985808.838497:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985810.041805:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985810.041864:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985810.042077:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971155584 00000100:00100000:1.0:1788985810.042117:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971155584 00000100:00100000:1.0:1788985810.042223:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1088 00000100:00100000:1.0:1788985810.042236:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971155584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985810.042336:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971155584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 104us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985810.042363:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1088 00000100:00080000:0.0:1788985810.043035:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985810.046125:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985810.046175:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985810.046280:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971155840 00000100:00100000:1.0:1788985810.046291:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971155840 00000100:00100000:1.0:1788985810.046386:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971155712 00000100:00100000:1.0:1788985810.046398:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971155712 00000100:00100000:1.0:1788985810.046431:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 724 00000100:00100000:1.0:1788985810.046442:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971155840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985810.046531:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971155840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 91us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985810.046539:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 724 00000100:00100000:1.0:1788985810.046558:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 725 00000100:00100000:1.0:1788985810.046565:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971155712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985810.046594:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971155712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985810.046600:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 725 00000100:00080000:0.0:1788985810.046920:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788985810.046926:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788985810.880865:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985811.973221:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993374336 00000100:00100000:1.0:1788985811.973240:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993374336 00000100:00100000:1.0:1788985811.973426:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:1.0:1788985811.973454:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993374336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788985811.973506:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788985811.974234:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993374336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 796us (5218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985811.974243:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00080000:0.0:1788985811.977623:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788985812.933699:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985812.993254:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993374464:0@lo:400:kworker.0 00000100:00100000:1.0:1788985812.993357:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985812.996167:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993374848:0@lo:400:kworker.0 00000100:00100000:0.0:1788985812.996251:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985812.996330:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993374848 00000100:00100000:0.0:1788985812.996337:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993374848 00000100:00100000:0.0:1788985812.996404:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:0.0:1788985812.996415:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993374848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985812.996473:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993374848:12345-0@lo:400:kworker.0 Request processed in 61us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985812.996500:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:0.0:1788985812.996552:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993374848:0@lo:400:kworker.0 00000100:00100000:0.0:1788985812.996591:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993374720:0@lo:400:kworker.0 00000100:00100000:0.0:1788985812.996623:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985812.996645:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788985812.996652:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993374592:0@lo:400:kworker.0 00000100:00100000:0.0:1788985812.996674:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985812.996701:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993374720 00000100:00100000:0.0:1788985812.996705:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993374720 00000100:00100000:0.0:1788985812.996741:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993374592 00000100:00100000:0.0:1788985812.996744:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993374592 00000100:00100000:0.0:1788985812.996764:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1788985812.996771:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993374720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985812.996807:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993374720:12345-0@lo:400:kworker.0 Request processed in 37us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985812.996813:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1788985812.996827:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1788985812.996833:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993374592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985812.996874:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993374592:12345-0@lo:400:kworker.0 Request processed in 41us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985812.996880:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00080000:0.0:1788985812.996901:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985812.996920:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993374592:0@lo:400:kworker.0 00000100:00100000:0.0:1788985812.996930:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993374720:0@lo:400:kworker.0 00000100:00100000:1.0:1788985813.008405:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993374464:0@lo:400:kworker.0 00000100:00100000:0.0:1788985813.009701:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788985813.009727:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993374976:0@lo:400:kworker.0 00000100:00100000:0.0:1788985813.009763:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788985813.010267:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788985813.010702:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788985814.976377:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985815.152819:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971155968 00000100:00100000:1.0:1788985815.152833:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971155968 00000100:00100000:1.0:1788985815.152906:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 944 00000100:00100000:1.0:1788985815.152918:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971155968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985815.153030:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971155968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 114us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985815.153038:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 944 00000100:00100000:1.0:1788985815.159525:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985815.159574:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985815.159645:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985815.159794:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971156096 00000100:00100000:0.0:1788985815.159799:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971156096 00000100:00100000:0.0:1788985815.159837:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1092 00000100:00100000:0.0:1788985815.159848:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971156096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985815.159936:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971156096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 89us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985815.159944:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1092 00000100:00080000:1.0:1788985815.160235:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788985815.160241:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788985815.160243:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788985817.024412:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788985817.095664:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985818.112894:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993375616:0@lo:400:kworker.0 00000100:00100000:0.0:1788985818.113082:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993375872:0@lo:400:kworker.0 00000100:00100000:1.0:1788985818.119607:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985818.119820:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993376128:0@lo:400:kworker.0 00000100:00100000:1.0:1788985818.119858:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985818.119913:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993376128 00000100:00100000:1.0:1788985818.119921:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993376128 00000100:00100000:1.0:1788985818.119980:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:1.0:1788985818.119989:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993376128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985818.120039:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993376128:12345-0@lo:400:kworker.0 Request processed in 51us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985818.120047:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00080000:1.0:1788985818.120067:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985818.120131:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993376128:0@lo:400:kworker.0 00000100:00100000:1.0:1788985818.120169:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993375616 00000100:00100000:1.0:1788985818.120172:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993375616 00000100:00100000:1.0:1788985818.120200:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1788985818.120206:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993375616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985818.120239:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993375616:12345-0@lo:400:kworker.0 Request processed in 33us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985818.120245:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1788985818.120271:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993375616:0@lo:400:kworker.0 00000100:00100000:1.0:1788985818.129260:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993375488 00000100:00100000:1.0:1788985818.129272:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993375488 00000100:00100000:1.0:1788985818.129332:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:1.0:1788985818.129343:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993375488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985818.129431:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993375488:12345-0@lo:400:kworker.0 Request processed in 90us (999us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985818.129444:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:1.0:1788985818.129635:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993376000 00000100:00100000:1.0:1788985818.129641:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993376000 00000100:00100000:1.0:1788985818.129686:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1788985818.129694:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993376000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985818.129744:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993376000:12345-0@lo:400:kworker.0 Request processed in 52us (1165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985818.129751:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00080000:1.0:1788985818.129768:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985818.134739:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993375744 00000100:00100000:1.0:1788985818.134752:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993375744 00000100:00100000:1.0:1788985818.134842:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1788985818.134883:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993375744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985818.134961:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993375744:12345-0@lo:400:kworker.0 Request processed in 92us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985818.134982:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1788985818.139542:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985818.147037:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993375872:0@lo:400:kworker.0 00000100:00100000:1.0:1788985818.360888:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985818.364548:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985818.364839:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971156608 00000100:00100000:1.0:1788985818.364851:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971156608 00000100:00100000:1.0:1788985818.364991:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 230 00000100:00100000:1.0:1788985818.365004:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:36895:x1875885971156608:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788985818.365533:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:36895:x1875885971156608:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 529us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985818.365541:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 230 00000100:00100000:0.0:1788985818.367187:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:1.0:1788985818.368129:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985818.375918:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971156864 00000100:00100000:1.0:1788985818.375931:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971156864 00000100:00100000:1.0:1788985818.376008:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 429 00000100:00100000:1.0:1788985818.376019:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:36895:x1875885971156864:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788985818.376593:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:36895:x1875885971156864:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 573us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985818.376602:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 429 00000100:00100000:0.0:1788985818.380692:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985818.381311:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971156992 00000100:00100000:1.0:1788985818.381324:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971156992 00000100:00100000:1.0:1788985818.381418:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 430 00000100:00100000:1.0:1788985818.381430:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:36895:x1875885971156992:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788985818.381565:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:36895:x1875885971156992:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 136us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985818.381593:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 430 00000100:00100000:0.0:1788985818.384638:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985818.396915:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985818.397015:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971157376 00000100:00100000:1.0:1788985818.397130:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971157376 00000100:00100000:0.0:1788985818.397523:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 431 00000100:00100000:0.0:1788985818.397537:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:36895:x1875885971157376:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788985818.398476:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:36895:x1875885971157376:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 935us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985818.398502:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 431 00000100:00100000:0.0:1788985818.420474:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985818.420825:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971157504 00000100:00100000:1.0:1788985818.420846:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971157504 00000100:00100000:1.0:1788985818.421275:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 432 00000100:00100000:1.0:1788985818.421287:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:36896:x1875885971157504:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788985818.421315:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985818.421355:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547195 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d02 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.421451:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54719c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.421475:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54719c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.421491:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54719c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788985818.421537:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00000004:00200000:1.0:1788985818.421541:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788985818.421563:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54719c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.421593:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547195 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d02 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.421623:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54719c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d02 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.421649:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:1.0:1788985818.421652:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788985818.421657:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788985818.421735:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:36896:x1875885971157504:12345-192.168.206.21@tcp:101:rm.0 Request processed in 451us (1282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985818.421742:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 432 00000100:00100000:0.0:1788985818.435406:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985818.437437:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971157888 00000100:00100000:1.0:1788985818.437455:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971157888 00000100:00100000:1.0:1788985818.439405:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:1.0:1788985818.439436:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:36896:x1875885971157888:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:1.0:1788985818.443833:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:36896:x1875885971157888:12345-192.168.206.21@tcp:37:rm.0 Request processed in 4393us (8424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985818.443852:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 44 00000100:00100000:0.0:1788985818.450649:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985818.450763:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971158400 00000100:00100000:1.0:1788985818.450776:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971158400 00000100:00100000:1.0:1788985818.450853:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 434 00000100:00100000:1.0:1788985818.450865:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:36896:x1875885971158400:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788985818.450936:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788985818.450968:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54719c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d02 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.450998:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf547141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ced expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451009:0:15241:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf546d97) 00010000:00010000:1.0:1788985818.451030:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:1.0:1788985818.451044:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788985818.451074:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5471b1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451150:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5471b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451162:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5471b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451176:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5471b8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451184:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5471b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451191:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5471b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451570:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5471bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451580:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5471bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451588:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5471bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451630:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5471bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451638:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5471bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451652:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5471bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451658:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985818.451663:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5471bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451672:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5471bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451681:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:1.0:1788985818.451684:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788985818.451688:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5471bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451695:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5471bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451716:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5471b1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451723:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5471b1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451729:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5471b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451734:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985818.451738:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5471b1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451754:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5471b1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451763:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:1.0:1788985818.451766:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985818.451769:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5471b1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451775:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5471b1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451787:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5471b8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451794:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5471b8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451800:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5471b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451805:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985818.451808:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5471b8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451814:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5471b8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451821:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9b0a45316f00) 00010000:00010000:1.0:1788985818.451823:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985818.451826:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5471b8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985818.451843:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5471b8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985818.451944:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:36896:x1875885971158400:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1079us (1305us total) trans 0 rc -13/-13 00000100:00100000:1.0:1788985818.451953:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 434 00010000:00010000:0.0:1788985819.076771:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985820.273566:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985820.273611:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:0.0:1788985820.274548:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788985820.274952:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985820.280438:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985820.280552:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:0.0:1788985820.281222:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788985821.126544:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788985821.221828:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000020:00000080:0.0:1788985821.406227:0:62308:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9bdc05f0 20000000:00000080:0.0:1788985821.406245:0:62308:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80b1c000 uarg=0000000000000000 00010000:00010000:0.0:1788985821.406924:0:62308:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788985821.406940:0:62308:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788985821.406954:0:62308:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985821.406972:0:62308:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5471c6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 62308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985821.406988:0:62308:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54711e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547117 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985821.406996:0:62308:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5471c6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 62308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985821.407034:0:62308:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54711e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547117 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985821.407060:0:62308:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54711e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547117 expref: 18 pid: 5848 timeout: 1705 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985821.407075:0:62308:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62308:1875885993376384:0@lo:104: 00000100:00100000:0.0:1788985821.407264:0:62308:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985821.407377:0:62308:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51df26c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788985821.407508:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993376384 00000100:00100000:1.0:1788985821.407516:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993376384 00000100:00100000:1.0:1788985821.407608:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788985821.407617:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:62308:x1875885993376384:12345-0@lo:104: 00010000:00010000:1.0:1788985821.407630:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547117 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54711e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985821.407692:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788985821.407698:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:62308:x1875885993376384:12345-0@lo:104: Request processed in 84us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985821.407706:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788985821.407948:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993376512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985821.407977:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985821.408033:0:62308:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094139d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62308:1875885993376384:0@lo:104: 00010000:00010000:0.0:1788985821.408052:0:62308:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5471c6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985821.408533:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993376512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985821.408553:0:62308:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5471c6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985821.408561:0:62308:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5471c6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985821.408567:0:62308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5471c6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 62308 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985822.146207:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985822.208322:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788985822.208363:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993376640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788985822.208462:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985822.208542:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993376640 00000100:00100000:1.0:1788985822.208550:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993376640 00000100:00100000:1.0:1788985822.208641:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00000100:00100000:1.0:1788985822.208652:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993376640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788985822.208715:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788985822.208779:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993376640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985822.208787:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:0.0:1788985822.722533:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993376768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985822.722551:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5471d4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5471db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985822.722560:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5471d4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5471db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985822.722588:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788985822.722593:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5471d4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5471db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985822.722601:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5471d4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5471db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985823.170205:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985823.236455:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993376896:0@lo:400:kworker.0 00000100:00100000:0.0:1788985823.240986:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985823.241030:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993377408:0@lo:400:kworker.0 00000100:00100000:0.0:1788985823.241072:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985823.241120:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993377152 00000100:00100000:0.0:1788985823.241125:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993377152 00000100:00100000:0.0:1788985823.241161:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993377408 00000100:00100000:0.0:1788985823.241164:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993377408 00000100:00100000:0.0:1788985823.241182:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1788985823.241189:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993377152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985823.241230:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993377152:12345-0@lo:400:kworker.0 Request processed in 41us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985823.241237:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1788985823.241251:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1788985823.241257:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993377408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985823.241289:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993377408:12345-0@lo:400:kworker.0 Request processed in 32us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985823.241294:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00080000:0.0:1788985823.241329:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985823.241368:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993377408:0@lo:400:kworker.0 00000100:00100000:0.0:1788985823.241390:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993377152:0@lo:400:kworker.0 00000100:00080000:0.0:1788985823.241769:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985823.242438:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993376896:0@lo:400:kworker.0 00010000:00010000:0.0:1788985824.199445:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985825.330785:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971159040 00000100:00100000:0.0:1788985825.330797:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971159040 00000100:00100000:0.0:1788985825.330879:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 435 00000100:00100000:0.0:1788985825.330890:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37010:x1875885971159040:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788985825.330916:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985825.330946:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5471e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d10 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.331023:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5471e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.331040:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5471e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.331055:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5471e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985825.331141:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788985825.331146:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788985825.331172:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5471e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.331201:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5471e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d10 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.331228:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5471e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d10 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.331238:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:0.0:1788985825.331242:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788985825.331246:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788985825.331327:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37010:x1875885971159040:12345-192.168.206.21@tcp:101:rm.0 Request processed in 438us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985825.331334:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 435 00000100:00100000:0.0:1788985825.341577:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985825.341619:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971159168 00000100:00100000:0.0:1788985825.341630:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971159168 00000100:00100000:0.0:1788985825.341691:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 436 00000100:00100000:0.0:1788985825.341704:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37010:x1875885971159168:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788985825.341730:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985825.341754:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5471f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d17 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.341826:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5471f7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.341843:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5471f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.341857:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5471f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.341887:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5471fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.341902:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5471fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.341910:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5471fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343502:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547205 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343521:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343554:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985825.343600:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00000004:00200000:0.0:1788985825.343605:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788985825.343629:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547205 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343644:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5471f7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343651:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5471f7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343658:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5471f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343677:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985825.343682:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5471f7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343690:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5471f7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343705:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:0.0:1788985825.343708:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985825.343713:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5471f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343720:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5471f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343734:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5471fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343741:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5471fe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343748:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5471fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343754:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985825.343757:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5471fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343763:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5471fe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343781:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9b0a4823b100) 00010000:00010000:0.0:1788985825.343784:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985825.343787:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5471fe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343794:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5471fe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343836:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5471f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d17 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343850:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547205 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d17 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.343857:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788985825.343860:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788985825.343862:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788985825.343950:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37010:x1875885971159168:12345-192.168.206.21@tcp:101:rm.0 Request processed in 2249us (2387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985825.343960:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 436 00000100:00100000:0.0:1788985825.347631:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985825.356337:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971159552 00000100:00100000:0.0:1788985825.356348:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971159552 00000100:00100000:0.0:1788985825.356440:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:0.0:1788985825.356450:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:37010:x1875885971159552:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:1.0:1788985825.368136:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:37010:x1875885971159552:12345-192.168.206.21@tcp:37:rm.0 Request processed in 11618us (12066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985825.368153:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 46 00000100:00100000:0.0:1788985825.377484:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985825.383674:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971160064 00000100:00100000:0.0:1788985825.383702:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971160064 00000100:00100000:0.0:1788985825.383885:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 438 00000100:00100000:0.0:1788985825.383897:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:37010:x1875885971160064:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1788985825.383967:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788985825.384001:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547205 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d17 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.384025:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788985825.384045:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5471e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d10 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.384054:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:0.0:1788985825.384060:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985825.384120:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54721a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.384135:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54721a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.384148:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54721a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.384162:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547221 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.384181:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547221 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.384188:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547221 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.384558:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547228 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.384569:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.384588:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985825.385487:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x1e:0x0]: returning size 16384 00010000:00010000:0.0:1788985825.385513:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385522:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547228 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385530:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547228 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385536:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985825.385542:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547228 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385550:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547228 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385563:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1e:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:0.0:1788985825.385566:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788985825.385571:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547228 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385589:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547228 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385613:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54721a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385620:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54721a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385625:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54721a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385631:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985825.385634:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54721a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385640:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54721a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385649:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:0.0:1788985825.385652:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985825.385655:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54721a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.385661:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54721a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788985825.385675:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000091c510b6 reply state 000000001eb38db7 transno 4294967465 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547221 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985825.385684:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788985825.388894:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:37010:x1875885971160064:12345-192.168.206.21@tcp:36:rm.0 Request processed in 4983us (5571us total) trans 4294967465 rc 0/0 00000100:00100000:0.0:1788985825.388911:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 438 00010000:00010000:1.0:1788985825.390443:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547221 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.390461:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547221 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.390469:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547221 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.390476:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985825.390481:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547221 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.390490:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547221 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.390507:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9b0a4823b800) 00010000:00010000:1.0:1788985825.390511:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985825.390517:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547221 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.390524:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547221 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985825.395901:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971160448 00000100:00100000:0.0:1788985825.395907:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971160448 00000100:00100000:0.0:1788985825.396011:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971160320 00000100:00100000:0.0:1788985825.396014:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971160320 00000100:00100000:0.0:1788985825.400065:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 736 00000100:00100000:0.0:1788985825.400115:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971160448:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985825.400223:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971160448:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 142us (4844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985825.400232:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 736 00000100:00100000:0.0:1788985825.400256:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 737 00000100:00100000:0.0:1788985825.400265:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971160320:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985825.400295:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971160320:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (4809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985825.400301:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 737 00000100:00100000:0.0:1788985825.445957:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971160576 00000100:00100000:0.0:1788985825.445976:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971160576 00000100:00100000:0.0:1788985825.446073:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 439 00000100:00100000:0.0:1788985825.446104:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:37014:x1875885971160576:12345-192.168.206.21@tcp:101:mkdir.0 00010000:00010000:0.0:1788985825.446138:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985825.446169:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54722f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d25 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.446253:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547236 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.446288:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.446303:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985825.446361:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788985825.446365:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788985825.446394:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547236 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.446421:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54722f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d25 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.446441:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547236 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d25 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.446451:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:0.0:1788985825.446454:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788985825.446459:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eee00, rc 0) 00000100:00100000:0.0:1788985825.446602:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:37014:x1875885971160576:12345-192.168.206.21@tcp:101:mkdir.0 Request processed in 517us (6621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985825.446611:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 439 00000100:00100000:0.0:1788985825.454554:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985825.457358:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971160960 00000100:00100000:0.0:1788985825.457369:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971160960 00000100:00100000:0.0:1788985825.457438:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 441 00000100:00100000:0.0:1788985825.457450:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:37014:x1875885971160960:12345-192.168.206.21@tcp:36:mkdir.0 00010000:00010000:0.0:1788985825.457539:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985825.457580:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547236 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d25 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.457614:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:0.0:1788985825.457628:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985825.457719:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54723d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.457734:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54723d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.457746:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54723d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.457758:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547244 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.457765:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547244 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.457772:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547244 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985825.459965:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00010000:00010000:0.0:1788985825.459987:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54723d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.459999:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54723d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.460007:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54723d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.460029:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985825.460034:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54723d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.460043:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54723d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.460060:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:0.0:1788985825.460063:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985825.460069:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54723d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985825.460075:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54723d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788985825.460127:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000120ef44 reply state 0000000021058d8a transno 4294967466 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547244 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985825.460137:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788985825.460687:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:37014:x1875885971160960:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 3233us (3421us total) trans 4294967466 rc 0/0 00000100:00100000:0.0:1788985825.460698:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 441 00000100:00100000:0.0:1788985825.528554:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971161088 00000100:00100000:0.0:1788985825.528565:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971161088 00000100:00100000:0.0:1788985825.529340:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 442 00000100:00100000:0.0:1788985825.529355:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:37018:x1875885971161088:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:1.0:1788985825.529450:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985825.529482:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54724b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d2c expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.529555:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547252 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.529573:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547252 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.529585:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547252 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788985825.529627:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788985825.529630:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788985825.529653:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547252 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.529680:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54724b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d2c expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.529705:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547252 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d2c expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.529720:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:1.0:1788985825.529723:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788985825.529727:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788985825.529800:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:37018:x1875885971161088:12345-192.168.206.21@tcp:101:chown.0 Request processed in 449us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985825.529826:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 442 00000100:00100000:0.0:1788985825.535006:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985825.539008:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000001:00080000:1.0:1788985825.648575:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967466 is committed 00000001:00080000:1.0:1788985825.648596:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967467 is committed 00000004:00010000:0.0:1788985825.649070:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000af68e06b reply state 000000001bb17a97 transno 4294967467 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985825.649119:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788985825.649139:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00010000:00080000:0.0:1788985825.649234:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788985825.649293:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37018:x1875885971161472:12345-192.168.206.21@tcp:36:chown.0 Request processed in 109410us (110294us total) trans 4294967467 rc 0/0 00000100:00100000:0.0:1788985825.649302:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 444 00010000:00010000:1.0:1788985825.649964:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547275 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.649976:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547275 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.649984:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.649990:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985825.649995:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547275 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.650003:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547275 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.650018:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45aca200) 00010000:00010000:1.0:1788985825.650021:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788985825.650026:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547275 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985825.650033:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547275 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985826.241295:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985826.441563:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985826.441571:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5471d4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5471db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985826.441580:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788985826.441584:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5471d4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5471db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985826.441593:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5471d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5471db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788985826.441600:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5471d4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5471db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985826.441605:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788985826.441642:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5471d4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5471db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985826.441651:0:62553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:62553:1875885993377792:0@lo:104: 00010000:00010000:0.0:1788985826.441651:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788985826.441675:0:62553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54727c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 62553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985826.441678:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5471d4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5471db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985826.441692:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5471d4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5471db expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985826.441716:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985826.441718:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985826.441720:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985826.441730:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788985826.441742:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993377920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985826.441793:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985826.442148:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993377920:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985827.264244:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985827.329224:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993378048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985827.329285:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985827.330034:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993378048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985828.352707:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993378176 00000100:00100000:0.0:1788985828.352719:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993378176 00000100:00100000:0.0:1788985828.352778:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1788985828.352789:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993378176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985828.352858:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993378176:12345-0@lo:400:kworker.0 Request processed in 70us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985828.352866:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:1.0:1788985828.352870:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993378304:0@lo:400:kworker.0 00000100:00100000:1.0:1788985828.352928:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985828.352934:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993378432:0@lo:400:kworker.0 00000100:00100000:1.0:1788985828.352966:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993378816:0@lo:400:kworker.0 00000100:00100000:0.0:1788985828.352993:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985828.352999:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985828.353709:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993378560 00000100:00100000:1.0:1788985828.353716:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993378560 00000100:00100000:1.0:1788985828.353862:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993378816 00000100:00100000:1.0:1788985828.353868:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993378816 00000100:00100000:1.0:1788985828.353906:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1788985828.353914:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993378560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985828.353955:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993378560:12345-0@lo:400:kworker.0 Request processed in 43us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985828.353962:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1788985828.353977:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:1.0:1788985828.353983:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993378816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985828.354012:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993378816:12345-0@lo:400:kworker.0 Request processed in 30us (1014us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985828.354018:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:1.0:1788985828.354053:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1788985828.354060:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993378432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985828.354113:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993378432:12345-0@lo:400:kworker.0 Request processed in 53us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985828.354119:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1788985828.354263:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993378304:0@lo:400:kworker.0 00000100:00100000:1.0:1788985828.354312:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993378816:0@lo:400:kworker.0 00000100:00100000:1.0:1788985828.354387:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993378176:0@lo:400:kworker.0 00000100:00100000:0.0:1788985828.355944:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993378432:0@lo:400:kworker.0 00000100:00100000:1.0:1788985828.359069:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993378944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985828.359119:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54728a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547291 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985828.359131:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54728a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547291 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985828.359165:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788985828.359171:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54728a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547291 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985828.359180:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54728a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547291 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985828.359509:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993378688 00000100:00100000:0.0:1788985828.359516:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993378688 00000100:00100000:0.0:1788985828.359574:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1788985828.359582:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993378688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985828.359642:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993378688:12345-0@lo:400:kworker.0 Request processed in 62us (1142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985828.359650:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:0.0:1788985828.359689:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993378688:0@lo:400:kworker.0 00000100:00080000:1.0:1788985828.359718:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788985829.319273:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985829.875399:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:1.0:1788985829.876315:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985830.522587:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971161856 00000100:00100000:1.0:1788985830.522594:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971161856 00000100:00100000:1.0:1788985830.522642:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971161984 00000100:00100000:1.0:1788985830.522645:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971161984 00000100:00100000:1.0:1788985830.522667:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 740 00000100:00100000:1.0:1788985830.522675:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971161856:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985830.523327:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971161856:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 650us (1912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985830.523343:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 740 00000100:00100000:1.0:1788985830.523365:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 741 00000100:00100000:1.0:1788985830.523373:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971161984:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985830.523404:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971161984:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (1897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985830.523410:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 741 00000100:00080000:1.0:1788985830.523432:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985830.524072:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985831.340922:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788985831.340936:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993379200 00000100:00100000:1.0:1788985831.340943:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993379200 00000100:00100000:1.0:1788985831.340991:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1788985831.341001:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:62846:x1875885993379200:12345-0@lo:104: 00010000:00010000:1.0:1788985831.341015:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54728a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547291 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985831.341405:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:1.0:1788985831.341412:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:62846:x1875885993379200:12345-0@lo:104: Request processed in 413us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985831.341424:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1788985831.341652:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993379328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985831.341688:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985831.343829:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993379328:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985831.361019:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985832.449343:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788985832.449366:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993379456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985832.449432:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985832.449636:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993379456 00000100:00100000:1.0:1788985832.449645:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993379456 00000100:00100000:1.0:1788985832.449713:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1788985832.449723:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993379456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788985832.449773:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788985832.449824:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993379456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985832.449840:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00000100:00080000:0.0:1788985832.449855:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985832.449899:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993379456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788985833.408244:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985833.473700:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788985833.474604:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993379840:0@lo:400:kworker.0 00000100:00100000:1.0:1788985833.474669:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985833.474739:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993379712:0@lo:400:kworker.0 00000100:00100000:1.0:1788985833.474769:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985833.474883:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993379712 00000100:00100000:0.0:1788985833.474890:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993379712 00000100:00100000:0.0:1788985833.474929:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1788985833.474937:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993379712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985833.474986:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993379712:12345-0@lo:400:kworker.0 Request processed in 49us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985833.474993:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:1.0:1788985833.475167:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993379712:0@lo:400:kworker.0 00000100:00100000:1.0:1788985833.475440:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993380352:0@lo:400:kworker.0 00000100:00100000:1.0:1788985833.475466:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985833.475485:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788985833.475491:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993380224:0@lo:400:kworker.0 00000100:00100000:1.0:1788985833.475517:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993380352 00000100:00100000:1.0:1788985833.475520:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993380352 00000100:00100000:1.0:1788985833.475555:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1788985833.475561:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993380352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985833.475594:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993380352:12345-0@lo:400:kworker.0 Request processed in 33us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985833.475600:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00080000:1.0:1788985833.475616:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985833.475641:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993380096:0@lo:400:kworker.0 00000100:00100000:1.0:1788985833.475664:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985833.475690:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993380096 00000100:00100000:1.0:1788985833.475694:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993380096 00000100:00100000:1.0:1788985833.475731:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1788985833.475736:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993380096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985833.475769:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993380096:12345-0@lo:400:kworker.0 Request processed in 33us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985833.475774:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:1.0:1788985833.475818:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993380096:0@lo:400:kworker.0 00000100:00100000:0.0:1788985833.476371:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993379968 00000100:00100000:0.0:1788985833.476377:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993379968 00000100:00100000:0.0:1788985833.476423:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993380224 00000100:00100000:0.0:1788985833.476426:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993380224 00000100:00100000:0.0:1788985833.476453:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:0.0:1788985833.476468:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993379968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985833.476510:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993379968:12345-0@lo:400:kworker.0 Request processed in 42us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985833.476519:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:0.0:1788985833.476664:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993380224:0@lo:400:kworker.0 00000100:00100000:1.0:1788985833.909750:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985833.909783:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971162112 00000100:00100000:1.0:1788985833.909792:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971162112 00000100:00100000:1.0:1788985833.909850:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 445 00000100:00100000:1.0:1788985833.909861:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37195:x1875885971162112:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788985833.909885:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985833.909907:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5472ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d3a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.909962:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5472b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.909976:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5472b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.910192:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5472b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788985833.910231:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788985833.910235:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788985833.910255:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5472b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.910301:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5472ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d3a expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.910319:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5472b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d3a expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.910328:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:1.0:1788985833.910331:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788985833.910336:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788985833.910388:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37195:x1875885971162112:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 528us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985833.910396:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 445 00000100:00080000:1.0:1788985833.910419:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985833.913641:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985833.913833:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971162240 00000100:00100000:1.0:1788985833.913845:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971162240 00000100:00100000:1.0:1788985833.913900:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 446 00000100:00100000:1.0:1788985833.913911:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37195:x1875885971162240:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788985833.913931:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985833.913953:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5472bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d41 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.914108:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5472c2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.914124:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5472c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.914149:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5472c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.914167:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5472c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.914174:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5472c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.914182:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5472c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.914941:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5472d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.914953:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5472d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.914962:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5472d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788985833.914999:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00000004:00200000:1.0:1788985833.915004:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788985833.915025:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5472d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915036:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5472c2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915043:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5472c2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915061:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5472c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915068:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985833.915084:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5472c2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915116:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5472c2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915128:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:1.0:1788985833.915132:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985833.915137:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5472c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915144:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5472c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915169:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5472c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915184:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5472c9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915190:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5472c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915195:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985833.915198:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5472c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915215:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5472c9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915225:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9b0a45316f00) 00010000:00010000:1.0:1788985833.915228:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985833.915232:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5472c9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915239:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5472c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915301:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5472bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d41 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915321:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5472d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d41 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985833.915329:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788985833.915331:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788985833.915334:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788985833.915409:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37195:x1875885971162240:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 1499us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985833.915427:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 446 00000100:00100000:1.0:1788985833.919059:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985833.919615:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971162496 00000100:00100000:0.0:1788985833.919626:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971162496 00000100:00100000:0.0:1788985833.919840:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 447 00000100:00100000:0.0:1788985833.919852:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37195:x1875885971162496:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788985833.919901:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985833.919927:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5472d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d41 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985833.919944:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:0.0:1788985833.919954:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985833.919986:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5472d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985833.920014:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5472d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985833.920025:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5472d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788985833.950533:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967468 is committed 00010000:00010000:0.0:1788985833.951558:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5472d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985833.951580:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5472d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985833.951603:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5472d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985833.951610:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985833.951615:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5472d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985833.951624:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5472d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985833.951640:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:0.0:1788985833.951644:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788985833.952162:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5472d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985833.952172:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5472d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985833.984274:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993380480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985833.984342:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985833.985702:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993380480:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788985834.432882:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788985834.608531:0:63042:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdc40ab0e0 20000000:00000080:0.0:1788985834.608546:0:63042:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094377b400 uarg=0000000000000000 00010000:00010000:0.0:1788985834.611780:0:63042:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788985834.611819:0:63042:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:0.0:1788985834.611823:0:63042:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788985834.611833:0:63042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5472b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d3a expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985834.611857:0:63042:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1788985834.611873:0:63042:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985834.611886:0:63042:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985834.611911:0:63042:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5472a6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54729f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985834.611918:0:63042:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985834.611955:0:63042:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5472a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54729f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985834.611969:0:63042:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5472a6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54729f expref: 18 pid: 5846 timeout: 1718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985834.611983:0:63042:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a808cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63042:1875885993380608:0@lo:104: 00000100:00100000:0.0:1788985834.612043:0:63042:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985834.612797:0:63042:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788985834.613312:0:63042:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a808cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63042:1875885993380608:0@lo:104: 00010000:00010000:0.0:1788985834.613332:0:63042:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.615415:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788985834.615566:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54729f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5472a6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.615577:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788985834.615581:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54729f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5472a6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.615591:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54729f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5472a6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788985834.615599:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54729f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5472a6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985834.615604:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788985834.615709:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54729f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5472a6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.615718:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788985834.615744:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54729f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5472a6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.615751:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54729f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5472a6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.615767:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985834.615769:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985834.615770:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985834.616352:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993380736 00000100:00100000:1.0:1788985834.616368:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993380736 00010000:00010000:1.0:1788985834.616397:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5472a6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54729f expref: 19 pid: 5846 timeout: 1718 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985834.617193:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788985834.617207:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993380736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985834.617221:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788985834.617226:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5472a6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54729f expref: 19 pid: 5846 timeout: 1718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.617239:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5472a6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54729f expref: 19 pid: 5846 timeout: 1718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.617252:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5472a6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54729f expref: 19 pid: 5846 timeout: 1718 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.617279:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.617287:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.617301:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.617307:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.617314:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.617320:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.617333:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efe00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788985834.617337:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.617344:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.617361:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985834.617369:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985834.617527:0:63042:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985834.617536:0:63042:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985834.617542:0:63042:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf5472de lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63042 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985834.617987:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993380736:12345-0@lo:103:ldlm_bl.0 Request processed in 216us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985834.617998:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00010000:00010000:1.0:1788985835.459276:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985835.642423:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985835.642467:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985835.642498:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985835.642527:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985835.642560:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971162880 00000100:00100000:1.0:1788985835.642570:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971162880 00000100:00100000:1.0:1788985835.642625:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971163008 00000100:00100000:1.0:1788985835.642629:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971163008 00000100:00100000:1.0:1788985835.642652:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 744 00000100:00100000:1.0:1788985835.642662:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971162880:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985835.642745:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971162880:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985835.642753:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 744 00000100:00100000:1.0:1788985835.642784:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 745 00000100:00100000:1.0:1788985835.642790:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971163008:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985835.642817:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971163008:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985835.642822:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 745 00000100:00080000:1.0:1788985835.642838:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985835.642842:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985835.643180:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971162752 00000100:00100000:0.0:1788985835.643192:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971162752 00000100:00100000:0.0:1788985835.643238:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1106 00000100:00100000:0.0:1788985835.643246:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971162752:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985835.643305:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971162752:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 60us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985835.643311:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1106 00000100:00080000:1.0:1788985835.643475:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788985836.482490:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985836.544980:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993380864 00000100:00100000:1.0:1788985836.544989:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993380864 00000100:00100000:1.0:1788985836.545039:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1788985836.545048:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993380864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985836.545061:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985836.545075:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5472ec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5472e5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985836.545124:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5472ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5472e5 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985836.545135:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5472ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5472e5 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985836.545144:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788985836.545196:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993380864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985836.545203:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00010000:00010000:1.0:1788985837.504291:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985837.523874:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:1.0:1788985837.524129:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985837.530618:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971163392 00000100:00100000:0.0:1788985837.530628:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971163392 00000100:00100000:0.0:1788985837.530876:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 449 00000100:00100000:0.0:1788985837.530888:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37272:x1875885971163392:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788985837.530908:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985837.530927:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54730f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d4f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.531217:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547316 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.531234:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547316 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.531255:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547316 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.531270:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54731d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.531277:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54731d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.531284:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54731d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788985837.532046:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0xf:0x0], index 0: 0 00010000:00010000:0.0:1788985837.532932:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.532947:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.532958:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.532992:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547316 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.532999:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547316 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.533006:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547316 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.533013:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985837.533017:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547316 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.533025:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547316 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.533036:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:0.0:1788985837.533039:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985837.533044:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547316 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.533062:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547316 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788985837.533075:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000999136a3 reply state 00000000aab8acb7 transno 4294967469 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54731d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985837.533084:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788985837.534073:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54730f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d4f expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.534229:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d4f expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.534238:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:0.0:1788985837.534251:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788985837.534255:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eea00, rc 0) 00000100:00100000:0.0:1788985837.534452:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:37272:x1875885971163392:12345-192.168.206.21@tcp:101:touch.0 Request processed in 3565us (4003us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1788985837.534461:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 449 00010000:00010000:1.0:1788985837.538548:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54731d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.538564:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54731d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.538571:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54731d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.538577:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985837.538581:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54731d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.538588:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54731d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.538603:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x93c5647 (ffff9b0a4823b900) 00010000:00010000:1.0:1788985837.538606:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985837.538611:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54731d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.538617:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54731d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985837.540051:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971163648 00000100:00100000:0.0:1788985837.540062:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971163648 00000100:00100000:0.0:1788985837.540141:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 450 00000100:00100000:0.0:1788985837.540152:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:37272:x1875885971163648:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:0.0:1788985837.540209:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985837.540233:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d4f expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.540279:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:0.0:1788985837.540430:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985837.540477:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547332 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.540489:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.540497:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788985837.540624:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002b3eb6e2 reply state 000000009139e9ad transno 4294967470 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985837.540633:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788985837.541222:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:37272:x1875885971163648:12345-192.168.206.21@tcp:36:touch.0 Request processed in 1070us (1605us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788985837.541230:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 450 00000100:00100000:0.0:1788985837.552173:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985837.552259:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971163904 00000100:00100000:1.0:1788985837.552269:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971163904 00000100:00100000:1.0:1788985837.552392:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 234 00000100:00100000:1.0:1788985837.552404:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971163904:12345-192.168.206.21@tcp:2:touch.0 00000100:00100000:1.0:1788985837.552743:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971163904:12345-192.168.206.21@tcp:2:touch.0 Request processed in 340us (578us total) trans 4294967325 rc 0/0 00000100:00100000:1.0:1788985837.552765:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 234 00000100:00100000:0.0:1788985837.569899:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993380992:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788985837.572573:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985837.631859:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985837.662566:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971164416 00000100:00100000:1.0:1788985837.662576:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971164416 00000100:00100000:1.0:1788985837.662636:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 235 00000100:00100000:1.0:1788985837.662647:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971164416:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788985837.662664:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985837.662685:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54735c lrc: 2/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d64 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788985837.663040:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x6aa1c1ed, atime: 0x6aa1c1ed, ctime: 0x6aa1c1ed, blocks: 0x1 00010000:00010000:1.0:1788985837.663063:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=1621s v=(0 0) 00010000:00010000:1.0:1788985837.663067:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788985837.663078:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54735c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d64 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.663120:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54735c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d64 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.663133:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00100000:1.0:1788985837.663195:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971164416:12345-192.168.206.21@tcp:101:rm.0 Request processed in 551us (1494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985837.663202:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 235 00000100:00100000:0.0:1788985837.671197:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971164672 00000100:00100000:0.0:1788985837.671207:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971164672 00000100:00100000:0.0:1788985837.671275:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 453 00000100:00100000:0.0:1788985837.671287:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:37276:x1875885971164672:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1788985837.671348:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788985837.671387:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547355 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x25:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d5d expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.671426:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf547339 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x25:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d56 expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.671437:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:0.0:1788985837.671448:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985837.671469:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547363 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.671482:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547363 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.671491:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547363 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.671505:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54736a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.671512:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54736a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.671519:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54736a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.671611:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547371 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x25:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.671619:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547371 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.671626:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547371 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x25:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.675926:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985837.675937:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547378 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.675946:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788985837.675950:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547378 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.675959:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547378 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.675973:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x25:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:0.0:1788985837.675976:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788985837.675980:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547378 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.675986:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547378 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x25:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985837.676006:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985837.676007:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985837.676009:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985837.681720:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54736a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.681755:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54736a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.681764:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54736a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.681770:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985837.681784:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54736a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.681793:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54736a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.681809:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x93c5647 (ffff9b0a4823ba00) 00010000:00010000:1.0:1788985837.681812:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985837.681816:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54736a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985837.681823:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54736a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985838.533352:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985838.596269:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993381120:0@lo:400:kworker.0 00000100:00100000:0.0:1788985838.596301:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985838.596334:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993381632:0@lo:400:kworker.0 00000100:00100000:0.0:1788985838.596357:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985838.596377:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788985838.596383:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993381504:0@lo:400:kworker.0 00000100:00100000:0.0:1788985838.596418:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985838.596449:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993381632 00000100:00100000:0.0:1788985838.596453:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993381632 00000100:00100000:0.0:1788985838.596482:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1788985838.596489:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993381632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985838.596524:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993381632:12345-0@lo:400:kworker.0 Request processed in 35us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985838.596530:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1788985838.596548:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993381504 00000100:00100000:0.0:1788985838.596552:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993381504 00000100:00100000:0.0:1788985838.596573:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1788985838.596579:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993381504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985838.596608:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993381504:12345-0@lo:400:kworker.0 Request processed in 29us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985838.596614:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00080000:0.0:1788985838.596630:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985838.596646:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993381504:0@lo:400:kworker.0 00000100:00100000:0.0:1788985838.596655:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993381632:0@lo:400:kworker.0 00000100:00100000:0.0:1788985838.597013:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993381120:0@lo:400:kworker.0 00000100:00100000:1.0:1788985839.105336:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993381888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985839.105405:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985839.105478:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993381888 00000100:00100000:1.0:1788985839.105486:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993381888 00000100:00100000:1.0:1788985839.105534:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00000100:00100000:1.0:1788985839.105543:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993381888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985839.105578:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788985839.105638:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942742300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993381888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985839.105646:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:1.0:1788985839.106037:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993381888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985839.235892:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971164800 00000100:00100000:1.0:1788985839.235898:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971164800 00010000:00010000:1.0:1788985839.235941:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54735c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d64 expref: 7 pid: 6695 timeout: 1723 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985839.235975:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 300 00000100:00100000:1.0:1788985839.235984:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971164800:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788985839.235999:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788985839.236005:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54735c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d64 expref: 7 pid: 6695 timeout: 1723 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985839.236019:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54735c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d64 expref: 7 pid: 6695 timeout: 1723 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985839.236041:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54735c lrc: 0/0,0 mode: --/PR res: [0x240000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d64 expref: 7 pid: 6695 timeout: 1723 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985839.236057:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788985839.236062:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788985839.236068:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e36856b6/0xc20d828fcf54737f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985839.236122:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e36856b6/0xc20d828fcf54737f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985839.236147:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788985839.236198:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971164800:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 214us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985839.236205:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 300 00000100:00080000:1.0:1788985839.236318:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788985839.553270:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985839.563392:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993382272 00000100:00100000:1.0:1788985839.563400:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993382272 00000100:00100000:1.0:1788985839.563449:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788985839.563459:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:63288:x1875885993382272:12345-0@lo:104: 00010000:00010000:1.0:1788985839.563472:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3000/0xc20d828fcf5472e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5472ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985839.563709:0:63288:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63288:1875885993382272:0@lo:104: 00010000:00010000:0.0:1788985839.563729:0:63288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547386 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985839.563819:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788985839.563826:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:63288:x1875885993382272:12345-0@lo:104: Request processed in 369us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985839.563833:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788985839.564613:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788985839.564628:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993382400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788985839.564676:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788985839.565429:0:63288:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547386 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985839.565449:0:63288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547386 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985839.565455:0:63288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547386 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985839.567782:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993382400:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985840.581218:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985840.756478:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971165312 00000100:00100000:0.0:1788985840.756490:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971165312 00000100:00100000:0.0:1788985840.756625:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 237 00000100:00100000:0.0:1788985840.756637:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971165312:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:0.0:1788985840.756668:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf547125 00000100:00080000:0.0:1788985840.756679:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f9ee000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788985840.756728:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1788985840.756971:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971165312:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 336us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985840.756979:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 237 00000100:00080000:1.0:1788985840.764406:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788985840.764414:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985841.481011:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993382528 00000100:00100000:1.0:1788985841.481020:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993382528 00000100:00100000:1.0:1788985841.481070:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1788985841.481079:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993382528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985841.481116:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985841.481130:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547394 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54738d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985841.481153:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547394 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54738d expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985841.481163:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547394 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54738d expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985841.481172:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788985841.481210:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993382528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985841.481217:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1788985841.481268:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993382528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985841.481281:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54738d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547394 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985841.481289:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54738d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547394 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985841.481305:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788985841.481310:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54738d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547394 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985841.481324:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54738d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547394 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985841.601267:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985842.554489:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:1.0:1788985842.554763:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985842.560644:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971165696 00000100:00100000:0.0:1788985842.560660:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971165696 00000100:00100000:0.0:1788985842.560730:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 455 00000100:00100000:0.0:1788985842.560741:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37363:x1875885971165696:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788985842.560803:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788985842.560834:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5473a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d6b expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985842.560854:0:15241:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf547308) 00010000:00010000:0.0:1788985842.560871:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:0.0:1788985842.560883:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985842.560909:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5473a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985842.560922:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5473a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985842.560932:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5473a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985842.634385:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985842.639458:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5473a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985842.639476:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5473a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985842.639485:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5473a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985842.639502:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985842.639508:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5473a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985842.639516:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5473a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985842.639541:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:1.0:1788985842.639544:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788985842.639549:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5473a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985842.639556:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5473a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985842.693894:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993382656 00000100:00100000:1.0:1788985842.693913:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993382656 00000100:00100000:1.0:1788985842.693972:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1788985842.693982:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993382656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788985842.694014:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788985842.694062:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993382656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985842.694069:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1788985843.506662:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993382784 00000100:00100000:1.0:1788985843.506673:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993382784 00000100:00100000:1.0:1788985843.506920:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788985843.506931:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:63483:x1875885993382784:12345-0@lo:104: 00010000:00010000:1.0:1788985843.506946:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54738d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547394 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985843.507237:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788985843.507245:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:63483:x1875885993382784:12345-0@lo:104: Request processed in 316us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985843.507253:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00010000:00010000:1.0:1788985843.649194:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985843.717709:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993383296:0@lo:400:kworker.0 00000100:00100000:0.0:1788985844.224266:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788985844.224289:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993383680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985844.224357:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985844.224418:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993383680 00000100:00100000:0.0:1788985844.224427:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993383680 00000100:00100000:0.0:1788985844.224474:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1788985844.224484:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993383680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985844.224516:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985844.224560:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993383680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985844.224567:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:0.0:1788985844.224610:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094139ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993383680:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788985845.056193:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788985845.056209:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788985845.056213:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788985845.056258:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf5473b7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985845.056270:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf5473b7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985845.056280:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf5473b7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985845.056333:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993383808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788985845.056398:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985845.056451:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eacb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788985845.056700:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993383808 00000100:00100000:0.0:1788985845.056708:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993383808 00000100:00100000:0.0:1788985845.056763:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:0.0:1788985845.056772:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993383808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985845.056792:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985845.056805:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5473be lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5473b7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985845.056827:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5473be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5473b7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985845.056837:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5473be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5473b7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985845.056845:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eee00, rc 0) 00000100:00100000:0.0:1788985845.056887:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993383808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985845.056893:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00010000:00010000:1.0:1788985845.698781:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985845.877369:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971165824 00000100:00100000:1.0:1788985845.877374:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971165824 00000100:00100000:1.0:1788985845.877403:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 961 00000100:00100000:1.0:1788985845.877410:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971165824:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985845.877446:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971165824:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985845.877451:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 961 00010000:00010000:2.0:1788985846.434755:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5473cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.434774:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5473cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.434780:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985846.434784:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5473cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.434791:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5473cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.434805:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:2.0:1788985846.434809:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985846.434814:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5473cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.434821:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5473cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.436000:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.436010:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.436017:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.436023:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985846.436027:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.436045:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.436057:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9b0a45aca300) 00010000:00010000:2.0:1788985846.436060:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985846.436064:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.436071:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.436132:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5473c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d72 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.436154:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf5473da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d72 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.436163:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788985846.436165:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788985846.436168:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0a00, rc 0) 00000100:00100000:2.0:1788985846.436251:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37440:x1875885971166208:12345-192.168.206.21@tcp:101:touch.0 Request processed in 4875us (9301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985846.436260:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 456 00000100:00100000:2.0:1788985846.461930:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985846.461966:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971166592 00000100:00100000:2.0:1788985846.461975:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971166592 00000100:00100000:2.0:1788985846.462030:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 458 00000100:00100000:2.0:1788985846.462043:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37440:x1875885971166592:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788985846.462069:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985846.462103:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5473f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d80 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462166:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462180:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462202:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462220:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547404 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462227:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462235:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462257:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462264:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462270:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462276:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985846.462286:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462294:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462305:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788985846.462308:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985846.462313:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462319:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5473fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462331:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462336:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547404 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462342:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462347:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985846.462349:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462355:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547404 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462362:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x93c5647 (ffff9b0a45acac00) 00010000:00010000:2.0:1788985846.462365:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985846.462374:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547404 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462380:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547404 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462411:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5473f6 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d80 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462421:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788985846.462423:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985846.462427:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5473f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d80 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.462436:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1e00, rc 0) 00000100:00100000:2.0:1788985846.462493:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37440:x1875885971166592:12345-192.168.206.21@tcp:101:touch.0 Request processed in 454us (569us total) trans 0 rc 301/301 00000100:00100000:2.0:1788985846.462500:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 458 00000100:00100000:2.0:1788985846.468072:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971166720 00000100:00100000:2.0:1788985846.468099:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971166720 00000100:00100000:2.0:1788985846.468165:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 459 00000100:00100000:2.0:1788985846.468176:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37440:x1875885971166720:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788985846.468206:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985846.468230:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54740b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d87 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468300:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547412 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468329:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547412 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468341:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547412 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468358:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468365:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468371:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468392:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547412 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468398:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547412 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468405:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547412 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468410:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985846.468415:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547412 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468422:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547412 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468433:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788985846.468442:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985846.468448:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547412 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468455:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547412 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468469:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468475:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547419 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468482:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468487:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985846.468489:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468496:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547419 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468503:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x93c5647 (ffff9b0a45aca300) 00010000:00010000:2.0:1788985846.468506:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985846.468509:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547419 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468514:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547419 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468547:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54740b lrc: 1/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d87 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468563:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788985846.468565:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985846.468570:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54740b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d87 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985846.468580:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0400, rc 0) 00000100:00100000:2.0:1788985846.468641:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37440:x1875885971166720:12345-192.168.206.21@tcp:101:touch.0 Request processed in 467us (3416us total) trans 0 rc 301/301 00000100:00100000:2.0:1788985846.468649:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 459 00010000:00010000:0.0:1788985847.744249:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985847.809285:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993383936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788985847.809354:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985847.809448:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993383936 00000100:00100000:2.0:1788985847.809456:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993383936 00000100:00100000:2.0:1788985847.809507:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:2.0:1788985847.809516:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993383936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985847.809549:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985847.809595:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993383936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985847.809602:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00080000:2.0:1788985847.809622:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788985847.809650:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:2.0:1788985847.810051:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0942b0ce00, transno 4294967326 00000100:00100000:2.0:1788985847.810074:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993383936:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788985848.333530:0:63730:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc39960860 20000000:00000080:1.0:1788985848.333548:0:63730:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80efb800 uarg=0000000000000000 00010000:00010000:1.0:1788985848.335612:0:63730:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788985848.335729:0:63730:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:1.0:1788985848.335733:0:63730:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788985848.335745:0:63730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf5473da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d72 expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985848.335767:0:63730:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1788985848.335786:0:63730:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985848.335801:0:63730:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547420 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 63730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985848.335813:0:63730:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5473be lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5473b7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985848.335832:0:63730:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547420 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 63730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985848.335868:0:63730:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5473be lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5473b7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985848.335884:0:63730:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5473be lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5473b7 expref: 18 pid: 5846 timeout: 1732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985848.335899:0:63730:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63730:1875885993384064:0@lo:104: 00000100:00100000:1.0:1788985848.335960:0:63730:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985848.336070:0:63730:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094395f240 going to sleep for 11 seconds 00000100:00100000:0.0:1788985848.342505:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993384064 00000100:00100000:0.0:1788985848.342521:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993384064 00010000:00010000:1.0:1788985848.343529:0:63730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5473be lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5473b7 expref: 19 pid: 5846 timeout: 1732 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985848.343542:0:63730:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094139c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63730:1875885993384064:0@lo:104: 00010000:00010000:1.0:1788985848.343560:0:63730:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547420 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985848.343568:0:63730:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547420 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985848.343575:0:63730:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547420 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985848.343581:0:63730:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547420 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63730 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985848.768562:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985848.838397:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a808cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993384448:0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.838455:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985848.838509:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788985848.838515:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a808cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993384320:0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.838535:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985848.838550:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993384832:0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.838568:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985848.838589:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993384704:0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.838606:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985848.838629:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788985848.838634:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993384576:0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.838652:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985848.838682:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993384448 00000100:00100000:0.0:1788985848.838688:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993384448 00000100:00100000:0.0:1788985848.838732:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993384320 00000100:00100000:0.0:1788985848.838735:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993384320 00000100:00100000:0.0:1788985848.838752:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993384704 00000100:00100000:0.0:1788985848.838754:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993384704 00000100:00100000:0.0:1788985848.838768:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1788985848.838785:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993384448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.838829:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79724380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993384448:12345-0@lo:400:kworker.0 Request processed in 54us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985848.838836:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1788985848.838851:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1788985848.838856:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993384320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.838875:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79725180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993384320:12345-0@lo:400:kworker.0 Request processed in 19us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985848.838880:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1788985848.838888:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1788985848.838893:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993384704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.838914:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79726680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993384704:12345-0@lo:400:kworker.0 Request processed in 21us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985848.838919:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1788985848.838938:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993384832 00000100:00100000:0.0:1788985848.838941:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993384832 00000100:00100000:0.0:1788985848.838962:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993384576 00000100:00100000:0.0:1788985848.838964:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993384576 00000100:00100000:0.0:1788985848.838986:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1788985848.838991:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993384832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.839016:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993384832:12345-0@lo:400:kworker.0 Request processed in 25us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985848.839022:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1788985848.839031:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:0.0:1788985848.839036:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993384576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.839055:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941f78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993384576:12345-0@lo:400:kworker.0 Request processed in 20us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985848.839061:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00080000:0.0:1788985848.839075:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788985848.839080:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985848.839419:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993384576:0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.839436:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993384704:0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.839471:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a808cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993384320:0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.839481:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79725c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993384832:0@lo:400:kworker.0 00000100:00100000:0.0:1788985848.839490:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a808cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993384448:0@lo:400:kworker.0 00000100:00100000:1.0:1788985849.344584:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993384960:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985849.344661:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985849.344689:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993384960 00000100:00100000:0.0:1788985849.344699:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993384960 00000100:00100000:0.0:1788985849.344761:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1788985849.344771:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993384960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985849.344805:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985849.344855:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993384960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985849.344884:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1788985849.344931:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993384960:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1788985849.543966:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788985849.543973:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788985849.543992:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788985849.544038:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985849.544050:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985849.544061:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985849.545466:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942c22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993385088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788985849.545543:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985849.545661:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a432fc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788985849.545861:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993385088 00000100:00100000:1.0:1788985849.545870:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993385088 00000100:00100000:1.0:1788985849.545956:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1788985849.545966:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993385088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985849.545981:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985849.545998:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54742e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547427 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985849.546023:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54742e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547427 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985849.546034:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54742e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547427 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985849.546043:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788985849.546104:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993385088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (545us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985849.546111:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:1.0:1788985849.549160:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942c22d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993385088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985849.549198:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54742e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985849.549212:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54742e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985849.549237:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788985849.549242:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54742e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985849.549262:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54742e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985850.817021:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985850.997216:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971166848 00000100:00100000:2.0:1788985850.997222:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971166848 00000100:00100000:2.0:1788985850.997262:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 963 00000100:00100000:2.0:1788985850.997272:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971166848:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:1.0:1788985850.997336:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788985850.999241:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971166848:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1963us (2233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985850.999252:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 963 00000100:00100000:1.0:1788985851.527065:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971167232 00000100:00100000:1.0:1788985851.527075:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971167232 00000100:00100000:1.0:1788985851.527152:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 460 00000100:00100000:1.0:1788985851.527163:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37527:x1875885971167232:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788985851.527193:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985851.527215:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547435 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d8e expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985851.527275:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54743c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985851.527288:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54743c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985851.527300:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54743c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788985851.527332:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00000004:00200000:1.0:1788985851.527335:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788985851.527352:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54743c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985851.527374:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547435 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d8e expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985851.527409:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54743c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d8e expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985851.527416:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:1.0:1788985851.527419:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788985851.527423:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031a00, rc 0) 00000100:00100000:1.0:1788985851.527473:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37527:x1875885971167232:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 311us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985851.527480:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 460 00000100:00100000:2.0:1788985851.538213:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985851.538250:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971167488 00000100:00100000:2.0:1788985851.538259:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971167488 00000100:00100000:2.0:1788985851.538309:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 461 00000100:00100000:2.0:1788985851.538320:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37527:x1875885971167488:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788985851.538368:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788985851.538394:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54743c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d8e expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985851.538423:0:5856:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf5473da) 00010000:00010000:2.0:1788985851.538427:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:2.0:1788985851.538438:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788985851.538464:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547443 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985851.538476:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547443 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985851.538486:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547443 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788985851.539494:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000063622761 reply state 000000006c1e3a2a transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547443 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985851.539506:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788985851.539515:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00000100:00100000:2.0:1788985851.539609:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37527:x1875885971167488:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 1289us (1402us total) trans 4294967474 rc 0/0 00000100:00100000:2.0:1788985851.539618:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 461 00010000:00010000:1.0:1788985851.548797:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547443 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985851.548813:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547443 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985851.548820:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547443 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985851.548826:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985851.548830:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547443 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985851.548838:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547443 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985851.548853:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:1.0:1788985851.548856:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788985851.548871:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547443 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985851.548892:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547443 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788985852.276030:0:63926:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe10111340 20000000:00000080:1.0:1788985852.276046:0:63926:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80ef8800 uarg=0000000000000000 00010000:00010000:1.0:1788985852.276506:0:63926:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985852.276521:0:63926:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788985852.276535:0:63926:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985852.276554:0:63926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985852.276571:0:63926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54742e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547427 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985852.276580:0:63926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985852.276625:0:63926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54742e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547427 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985852.276756:0:63926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54742e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547427 expref: 18 pid: 5848 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985852.276772:0:63926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63926:1875885993385216:0@lo:104: 00000100:00100000:1.0:1788985852.276833:0:63926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985852.276894:0:63926:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094395f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788985852.277118:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993385216 00000100:00100000:2.0:1788985852.277127:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993385216 00010000:00010000:0.0:1788985852.277440:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985852.277448:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54742e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277455:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788985852.277459:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54742e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277468:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54742e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788985852.277475:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54742e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985852.277481:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788985852.277517:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54742e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277524:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788985852.277542:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54742e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277549:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf547427 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54742e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277562:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985852.277569:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985852.277571:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985852.277582:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993385344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985852.277610:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985852.277663:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993385344 00000100:00100000:0.0:1788985852.277667:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993385344 00010000:00010000:0.0:1788985852.277687:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54742e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547427 expref: 19 pid: 5848 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985852.277708:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788985852.277713:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993385344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985852.277722:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985852.277726:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54742e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547427 expref: 19 pid: 5848 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277735:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54742e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547427 expref: 19 pid: 5848 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277749:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277757:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277770:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277776:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277783:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277795:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277800:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788985852.277804:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277811:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277819:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985852.277828:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788985852.277856:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993385344:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985852.277863:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:0.0:1788985852.277896:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941f79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993385344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985852.278488:0:63926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54742e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547427 expref: 18 pid: 5848 timeout: 1736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985852.278515:0:63926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094139e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:63926:1875885993385216:0@lo:104: 00010000:00010000:1.0:1788985852.278532:0:63926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985852.278541:0:63926:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985852.278548:0:63926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985852.278555:0:63926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54744a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 63926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985852.928375:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993385472:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985852.928466:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985852.928586:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993385472 00000100:00100000:2.0:1788985852.928596:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993385472 00000100:00100000:2.0:1788985852.928675:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1788985852.928685:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993385472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985852.928728:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985852.928790:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941f79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993385472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985852.928815:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00080000:0.0:1788985852.928879:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985852.928920:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993385472:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788985852.980691:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967474 is committed 00010000:00010000:0.0:1788985853.894336:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985853.952634:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993385856:0@lo:400:kworker.0 00000100:00100000:2.0:1788985853.952727:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985853.952810:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788985853.952817:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993385984:0@lo:400:kworker.0 00000100:00100000:2.0:1788985853.952848:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985853.952889:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993385856 00000100:00100000:2.0:1788985853.952898:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993385856 00000100:00100000:2.0:1788985853.952974:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1788985853.952985:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993385856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985853.953049:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993385856:12345-0@lo:400:kworker.0 Request processed in 67us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985853.953189:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993385728:0@lo:400:kworker.0 00000100:00100000:1.0:1788985853.953224:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985853.953252:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993386240:0@lo:400:kworker.0 00000100:00100000:1.0:1788985853.953272:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985853.953293:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788985853.953299:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993385600:0@lo:400:kworker.0 00000100:00100000:1.0:1788985853.953330:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985853.953352:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993386112:0@lo:400:kworker.0 00000100:00100000:1.0:1788985853.953374:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985853.953403:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993385728 00000100:00100000:1.0:1788985853.953407:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993385728 00000100:00100000:1.0:1788985853.953434:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993386112 00000100:00100000:1.0:1788985853.953442:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993386112 00000100:00100000:1.0:1788985853.953480:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1788985853.953486:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993385728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985853.953526:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993385728:12345-0@lo:400:kworker.0 Request processed in 40us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985853.953532:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:1.0:1788985853.953551:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1788985853.953558:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993386112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985853.953584:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993386112:12345-0@lo:400:kworker.0 Request processed in 28us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985853.953590:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:1.0:1788985853.953612:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993385984 00000100:00100000:1.0:1788985853.953616:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993385984 00000100:00100000:1.0:1788985853.953656:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993386240 00000100:00100000:1.0:1788985853.953659:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993386240 00000100:00100000:1.0:1788985853.953682:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1788985853.953689:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993385984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985853.953724:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993385984:12345-0@lo:400:kworker.0 Request processed in 36us (875us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985853.953730:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1788985853.953742:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1788985853.953748:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993386240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985853.953775:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993386240:12345-0@lo:400:kworker.0 Request processed in 28us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985853.953780:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:1.0:1788985853.953797:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993385600 00000100:00100000:1.0:1788985853.953800:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993385600 00000100:00100000:1.0:1788985853.953824:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1788985853.953836:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993385600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985853.953867:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993385600:12345-0@lo:400:kworker.0 Request processed in 31us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985853.953873:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:1.0:1788985853.953936:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993385600:0@lo:400:kworker.0 00000100:00100000:1.0:1788985853.953951:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993386112:0@lo:400:kworker.0 00000100:00100000:1.0:1788985853.953963:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993385728:0@lo:400:kworker.0 00000100:00100000:1.0:1788985853.953972:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993386240:0@lo:400:kworker.0 00000100:00100000:2.0:1788985853.954322:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00080000:2.0:1788985853.954351:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788985853.954357:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985853.954393:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993385984:0@lo:400:kworker.0 00000100:00100000:2.0:1788985853.954406:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942c23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993385856:0@lo:400:kworker.0 00000100:00100000:1.0:1788985854.016838:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993386368 00000100:00100000:1.0:1788985854.016920:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993386368 00000100:00100000:1.0:1788985854.016991:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:1.0:1788985854.017002:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993386368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985854.017085:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985854.017686:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547458 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547451 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985854.017721:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547458 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547451 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985854.017743:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547458 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547451 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985854.017754:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788985854.017859:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993386368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 858us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985854.017867:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:0.0:1788985854.465842:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788985854.465869:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993386496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985854.465956:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985854.466040:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993386496 00000100:00100000:0.0:1788985854.466049:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993386496 00000100:00100000:0.0:1788985854.466128:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:0.0:1788985854.466138:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993386496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985854.466191:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985854.466245:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993386496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985854.466252:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:0.0:1788985854.466305:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941f7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993386496:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788985854.913967:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985855.936291:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985855.996379:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985855.996477:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971167616 00000100:00100000:1.0:1788985855.996489:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971167616 00000100:00100000:1.0:1788985855.996611:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 462 00000100:00100000:1.0:1788985855.996623:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37611:x1875885971167616:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788985855.996753:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37611:x1875885971167616:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 131us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985855.996761:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 462 00000100:00080000:2.0:1788985855.996993:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985856.002314:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985856.002437:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971167744 00000100:00100000:1.0:1788985856.002449:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971167744 00000100:00080000:2.0:1788985856.002553:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985856.002603:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 238 00000100:00100000:1.0:1788985856.002618:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37611:x1875885971167744:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788985856.003186:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941f7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37611:x1875885971167744:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 568us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985856.003195:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 238 00000100:00100000:1.0:1788985856.007456:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985856.012821:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:2.0:1788985856.013747:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985856.015609:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985856.015713:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971168128 00000100:00100000:2.0:1788985856.015725:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971168128 00000100:00100000:2.0:1788985856.015800:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 463 00000100:00100000:2.0:1788985856.015811:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37611:x1875885971168128:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788985856.016570:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37611:x1875885971168128:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 757us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985856.016579:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 463 00000100:00100000:1.0:1788985856.019259:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985856.019382:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971168256 00000100:00100000:2.0:1788985856.019394:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971168256 00000100:00100000:2.0:1788985856.019466:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 464 00000100:00100000:2.0:1788985856.019478:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37611:x1875885971168256:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788985856.019605:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37611:x1875885971168256:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 130us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985856.019620:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 464 00000100:00100000:2.0:1788985856.021471:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971168384 00000100:00100000:2.0:1788985856.021481:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971168384 00000100:00100000:2.0:1788985856.021565:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 241 00000100:00100000:2.0:1788985856.021577:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37611:x1875885971168384:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788985856.023246:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37611:x1875885971168384:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 1657us (1884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985856.023280:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 241 00000100:00100000:0.0:1788985856.028474:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985856.028615:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971168512 00000100:00100000:1.0:1788985856.028627:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971168512 00000100:00100000:1.0:1788985856.028862:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 242 00000100:00100000:1.0:1788985856.028877:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37611:x1875885971168512:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788985856.029364:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37611:x1875885971168512:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 490us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985856.029373:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 242 00000100:00100000:1.0:1788985856.032968:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985856.033049:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971168640 00000100:00100000:0.0:1788985856.033061:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971168640 00000100:00100000:0.0:1788985856.033164:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 465 00000100:00100000:0.0:1788985856.033176:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37611:x1875885971168640:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788985856.033850:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37611:x1875885971168640:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 673us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985856.033858:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 465 00000100:00100000:2.0:1788985856.094330:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985856.096675:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 466 00000100:00100000:2.0:1788985856.096691:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37615:x1875885971168768:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788985856.096719:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985856.096750:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547466 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d95 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.096830:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54746d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.096846:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54746d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.096873:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54746d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.096889:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547474 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.096896:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.096902:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.097817:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54747b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.097831:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54747b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.097848:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54747b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788985856.097891:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00000004:00200000:2.0:1788985856.097896:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788985856.097919:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54747b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.097932:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54746d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.097939:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54746d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.097946:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54746d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.097952:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985856.097956:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54746d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.097963:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54746d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.097975:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788985856.097979:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985856.097983:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54746d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.097989:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54746d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.098012:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547474 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.098018:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547474 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.098023:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.098027:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985856.098030:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547474 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.098034:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547474 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.098040:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9b0a45acab00) 00010000:00010000:2.0:1788985856.098042:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985856.098044:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547474 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.098049:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547474 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.098084:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547466 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d95 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.098213:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54747b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d95 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985856.098232:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45aca200) 00010000:00010000:2.0:1788985856.098234:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788985856.098237:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0a00, rc 0) 00000100:00100000:2.0:1788985856.098321:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37615:x1875885971168768:12345-192.168.206.21@tcp:101:dd.0 Request processed in 1634us (4007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985856.098329:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 466 00000100:00100000:1.0:1788985856.105244:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971169024 00000100:00100000:1.0:1788985856.105256:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971169024 00000100:00100000:1.0:1788985856.105365:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 467 00000100:00100000:1.0:1788985856.105378:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:37615:x1875885971169024:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:1.0:1788985856.105413:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985856.105441:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547482 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0d9c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.105813:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547489 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.105829:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547489 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.105857:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547489 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.105876:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547490 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.105883:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.105890:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788985856.106752:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0xf:0x0], index 1: 0 00000100:00100000:2.0:1788985856.113189:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:1.0:1788985856.114969:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547497 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x27:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.114992:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.115004:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547497 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.115069:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547489 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.115077:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547489 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.115084:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547489 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.115170:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985856.115188:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547489 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.115197:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547489 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.115212:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45aca200) 00010000:00010000:1.0:1788985856.115215:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985856.115220:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547489 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.115228:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547489 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788985856.115249:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000095b5e73f reply state 0000000034f86a00 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985856.115259:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788985856.115305:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547482 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d9c expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.115327:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547497 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x27:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d9c expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.115335:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b0a45316500) 00010000:00010000:1.0:1788985856.115337:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788985856.115340:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031a00, rc 0) 00000100:00100000:1.0:1788985856.115405:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:37615:x1875885971169024:12345-192.168.206.21@tcp:101:dd.0 Request processed in 10030us (10267us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788985856.115414:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 467 00010000:00010000:1.0:1788985856.119241:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547490 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.119256:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547490 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.119265:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547490 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.119272:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985856.119277:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547490 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.119285:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547490 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.119300:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x93c5647 (ffff9b0a45316d00) 00010000:00010000:1.0:1788985856.119303:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985856.119308:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547490 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985856.119315:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547490 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985856.126504:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985856.148992:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985856.149222:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971169408 00000100:00100000:0.0:1788985856.149234:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971169408 00002000:00100000:0.0:1788985856.149301:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xf:0x0] (0->1048575) req@ffff9b0a80ca3100 x1875885971169408/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:532/0 lens 488/0 e 0 to 0 dl 1788985867 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788985856.149313:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a80ca3100 with x1875885971169408 ext(0->1048575) 00002000:00010000:0.0:1788985856.149319:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a80ca3100 00000100:00100000:0.0:1788985856.149378:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:0.0:1788985856.149389:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971169408:12345-192.168.206.21@tcp:4:dd.0 00000001:00100000:1.0:1788985856.209345:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:0.0:1788985856.213855:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971169408:12345-192.168.206.21@tcp:4:dd.0 Request processed in 64452us (64863us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788985856.213890:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00002000:00100000:0.0:1788985856.213909:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0xf:0x0] (0->1048575) req@ffff9b0a80ca3100 x1875885971169408/t4294967325(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:532/0 lens 488/448 e 0 to 0 dl 1788985867 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788985856.213921:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a80ca3100 with x1875885971169408 ext(0->1048575) 00002000:00010000:0.0:1788985856.213929:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a80ca3100 00000100:00100000:0.0:1788985856.221297:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985856.221627:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971169536 00000100:00100000:1.0:1788985856.221640:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971169536 00000100:00100000:1.0:1788985856.221713:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 468 00000100:00100000:1.0:1788985856.221725:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:37615:x1875885971169536:12345-192.168.206.21@tcp:44:dd.0 00000100:00100000:2.0:1788985856.298862:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37615:x1875885971169536:12345-192.168.206.21@tcp:44:dd.0 Request processed in 77131us (77572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985856.298876:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 468 00000100:00100000:2.0:1788985856.301460:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985856.361498:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971169664:12345-192.168.206.21@tcp:16:dd.0 Request processed in 59842us (60044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985856.361535:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 244 00000100:00100000:2.0:1788985856.364506:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971169920 00000100:00100000:2.0:1788985856.364518:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971169920 00000100:00100000:2.0:1788985856.364579:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 49 00000100:00100000:2.0:1788985856.364591:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37615:x1875885971169920:12345-192.168.206.21@tcp:35:dd.0 00000001:00080000:2.0:1788985856.365171:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:2.0:1788985856.369003:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:37615:x1875885971169920:12345-192.168.206.21@tcp:35:dd.0 Request processed in 4391us (4562us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1788985856.369033:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 49 00000020:00080000:2.0:1788985856.369045:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788985856.960298:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788985857.685893:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967477 is committed 00010000:00010000:1.0:1788985857.984356:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985858.048671:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993386624 00000100:00100000:2.0:1788985858.048682:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993386624 00000100:00100000:2.0:1788985858.048755:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1788985858.048764:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993386624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985858.048843:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985858.048898:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993386624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985858.048905:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1788985858.048952:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993386624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788985859.015941:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985859.072549:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993386880:0@lo:400:kworker.0 00000100:00100000:1.0:1788985859.072612:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985859.072657:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993387392:0@lo:400:kworker.0 00000100:00100000:1.0:1788985859.072680:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985859.072701:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788985859.072707:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993386752:0@lo:400:kworker.0 00000100:00100000:1.0:1788985859.072731:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985859.072750:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993387264:0@lo:400:kworker.0 00000100:00100000:1.0:1788985859.072769:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985859.072790:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993387136:0@lo:400:kworker.0 00000100:00100000:1.0:1788985859.072809:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985859.072832:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788985859.072837:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993387008:0@lo:400:kworker.0 00000100:00100000:1.0:1788985859.072856:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985859.072882:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993386880 00000100:00100000:1.0:1788985859.072890:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993386880 00000100:00100000:2.0:1788985859.073012:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993387008 00000100:00100000:2.0:1788985859.073017:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993387008 00000100:00100000:2.0:1788985859.073062:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1788985859.073072:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993386880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985859.073156:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993386880:12345-0@lo:400:kworker.0 Request processed in 85us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985859.073163:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1788985859.073179:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1788985859.073186:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993387008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985859.073217:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993387008:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985859.073223:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1788985859.073253:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993387392 00000100:00100000:2.0:1788985859.073257:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993387392 00000100:00100000:2.0:1788985859.073281:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993387136 00000100:00100000:2.0:1788985859.073284:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993387136 00000100:00100000:2.0:1788985859.073301:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:2.0:1788985859.073307:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993387392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985859.073513:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993387392:12345-0@lo:400:kworker.0 Request processed in 205us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985859.073520:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:2.0:1788985859.073542:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1788985859.073548:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993387136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985859.073576:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993387136:12345-0@lo:400:kworker.0 Request processed in 28us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985859.073581:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1788985859.073598:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993386752 00000100:00100000:2.0:1788985859.073601:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993386752 00000100:00100000:2.0:1788985859.073623:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1788985859.073629:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993386752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985859.073657:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993386752:12345-0@lo:400:kworker.0 Request processed in 28us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985859.073663:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00080000:2.0:1788985859.073688:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788985859.073692:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985859.073728:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094139e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993387008:0@lo:400:kworker.0 00000100:00100000:2.0:1788985859.073738:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993387136:0@lo:400:kworker.0 00000100:00100000:2.0:1788985859.073766:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993386752:0@lo:400:kworker.0 00000100:00100000:2.0:1788985859.073776:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942c21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993386880:0@lo:400:kworker.0 00000100:00100000:2.0:1788985859.073784:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993387392:0@lo:400:kworker.0 00000100:00100000:1.0:1788985859.073843:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993387264 00000100:00100000:1.0:1788985859.073848:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993387264 00000100:00100000:1.0:1788985859.073886:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:1.0:1788985859.073892:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993387264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985859.073926:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993387264:12345-0@lo:400:kworker.0 Request processed in 35us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985859.074003:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00080000:2.0:1788985859.075011:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985859.075152:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993387264:0@lo:400:kworker.0 00000004:00080000:2.0:1788985859.104878:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 37 committed 00000004:00080000:2.0:1788985859.104901:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 37 committed 00000100:00100000:0.0:1788985859.589136:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788985859.589158:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993387520:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985859.589221:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985859.589358:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993387520 00000100:00100000:1.0:1788985859.589366:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993387520 00000100:00100000:1.0:1788985859.589409:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1788985859.589418:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993387520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985859.589450:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788985859.589499:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993387520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985859.589507:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1788985859.589552:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993387520:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788985860.033879:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985860.303182:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971170048 00000100:00100000:0.0:1788985860.303191:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971170048 00000100:00100000:0.0:1788985860.303263:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 469 00000100:00100000:0.0:1788985860.303274:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37808:x1875885971170048:12345-192.168.206.21@tcp:48:lfs.0 00000100:00080000:1.0:1788985860.303379:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985860.303791:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37808:x1875885971170048:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 517us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985860.303799:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 469 00000100:00100000:1.0:1788985860.311005:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:1.0:1788985860.311309:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985860.323687:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985860.329441:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971170432 00000100:00100000:2.0:1788985860.329461:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971170432 00000100:00100000:2.0:1788985860.329520:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 470 00000100:00100000:2.0:1788985860.329530:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37808:x1875885971170432:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788985860.329948:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37808:x1875885971170432:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 419us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985860.329956:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 470 00000100:00080000:1.0:1788985860.331267:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985860.350454:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985860.362946:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 247 00000100:00100000:2.0:1788985860.362960:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37808:x1875885971170688:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788985860.363428:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:37808:x1875885971170688:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 469us (12982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985860.363436:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 247 00000100:00100000:2.0:1788985860.376176:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985860.399186:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985860.399217:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971170944 00000100:00100000:0.0:1788985860.399226:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971170944 00000100:00100000:0.0:1788985860.399277:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 472 00000100:00100000:0.0:1788985860.399287:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37808:x1875885971170944:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788985860.402369:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:37808:x1875885971170944:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 3072us (3178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985860.402383:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 472 00000100:00100000:2.0:1788985860.529256:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:1.0:1788985860.537479:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788985860.537493:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5474c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985860.537505:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788985860.537509:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5474c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985860.537519:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5474c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985860.537554:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x27:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:1.0:1788985860.537556:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788985860.537562:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5474c1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985860.537567:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5474c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x27:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985860.537590:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985860.537592:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985860.537593:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985860.538002:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5474b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985860.538011:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5474b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985860.538017:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5474b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985860.538022:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985860.538025:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5474b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985860.538032:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5474b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985860.538042:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x93c5647 (ffff9b0a55745300) 00010000:00010000:1.0:1788985860.538044:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985860.538048:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5474b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985860.538061:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5474b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985861.057311:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985861.238535:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985861.238573:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985861.238602:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985861.238626:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985861.238653:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971171456 00000100:00100000:1.0:1788985861.238662:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971171456 00000100:00100000:1.0:1788985861.238714:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1125 00000100:00100000:1.0:1788985861.238724:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971171456:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985861.238792:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971171456:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985861.238800:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1125 00000100:00100000:1.0:1788985861.238823:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971171712 00000100:00100000:1.0:1788985861.238827:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971171712 00000100:00100000:1.0:1788985861.238855:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971171584 00000100:00100000:1.0:1788985861.238858:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971171584 00000100:00100000:1.0:1788985861.238877:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 759 00000100:00100000:1.0:1788985861.238884:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971171712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985861.238910:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971171712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985861.238915:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 759 00000100:00100000:1.0:1788985861.238927:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 760 00000100:00100000:1.0:1788985861.238932:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971171584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985861.238979:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971171584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 45us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985861.238987:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 760 00000100:00100000:1.0:1788985861.239011:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971171328 00000100:00100000:1.0:1788985861.239015:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971171328 00000100:00100000:1.0:1788985861.239040:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 968 00000100:00100000:1.0:1788985861.239046:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971171328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985861.239070:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971171328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985861.239076:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 968 00010000:00010000:1.0:1788985862.080959:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788985863.061672:0:64318:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1646964579722ns, next at 1622576930559ns, rc = 0 00000004:00080000:2.0:1788985863.061825:0:64318:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1646964734875ns, next at 1645434852324ns, rc = 0 00010000:00010000:1.0:1788985863.104717:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788985863.104818:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 39 committed 00000004:00080000:0.0:1788985863.104842:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 38 committed 00000001:00080000:0.0:1788985863.104863:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967478 is committed 00000004:00080000:0.0:1788985863.104867:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 38 committed 00000100:00100000:1.0:1788985863.105033:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788985863.105052:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993387648:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788985863.105147:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985863.105213:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993387648 00000100:00100000:1.0:1788985863.105221:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993387648 00000100:00100000:1.0:1788985863.105272:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788985863.105282:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993387648:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788985863.105305:0:8478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:15 count 1 00010000:00010000:1.0:1788985863.105328:0:8478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985863.105348:0:8478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf5474a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0da3 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985863.105373:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0xf:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1788985863.105377:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788985863.105382:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985863.105419:0:8478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf5474a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0da3 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985863.105432:0:8478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf5474a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0da3 expref: 5 pid: 6695 timeout: 1747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985863.105443:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8478:1875885993387776:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788985863.105492:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a50309d80 going to sleep for 11 seconds 00000100:00080000:1.0:1788985863.105503:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985863.109847:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985863.110009:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8478:1875885993387776:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788985863.110038:0:8478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985863.111541:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf5474a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0da3 expref: 6 pid: 6695 timeout: 1747 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985863.111591:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 305 00000100:00100000:2.0:1788985863.111601:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a96450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971171840:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788985863.111616:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985863.111624:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf5474a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0da3 expref: 6 pid: 6695 timeout: 1747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985863.111637:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf5474a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0da3 expref: 6 pid: 6695 timeout: 1747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985863.111674:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf5474a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0da3 expref: 6 pid: 6695 timeout: 1747 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985863.111691:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788985863.111695:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788985863.111920:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985863.111933:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985863.111965:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985863.112084:0:8478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985863.112121:0:8478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985863.112131:0:8478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985863.112138:0:8478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985863.112156:0:8478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788985863.113176:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a96450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971171840:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 1571us (3332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985863.113188:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 305 00000100:00100000:0.0:1788985863.113364:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993387648:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8083us (8215us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1788985863.113385:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00010000:0.0:1788985863.113421:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985863.113430:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985863.113440:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788985863.113444:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985863.113455:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985863.113474:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985863.113482:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf5474c8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985863.113504:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985863.113506:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985863.113508:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788985863.113682:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a760c1880/2, rc 0, transno 4294967326 00000100:00100000:2.0:1788985863.113710:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993387648:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1788985863.116033:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985863.170922:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788985863.170943:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993387904:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788985863.171330:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985863.172162:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993387904 00000100:00100000:2.0:1788985863.172172:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993387904 00000100:00100000:2.0:1788985863.172246:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:2.0:1788985863.172256:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993387904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985863.172289:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985863.172346:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993387904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985863.172353:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00000100:00080000:1.0:1788985863.172501:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985863.172543:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993387904:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788985864.134495:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985864.192422:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993388288:0@lo:400:kworker.0 00000100:00100000:0.0:1788985864.192485:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985864.192537:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788985864.192544:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993388160:0@lo:400:kworker.0 00000100:00100000:0.0:1788985864.192581:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985864.192610:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993388672:0@lo:400:kworker.0 00000100:00100000:0.0:1788985864.192635:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985864.192665:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993388288 00000100:00100000:0.0:1788985864.192673:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993388288 00000100:00100000:0.0:1788985864.192719:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993388160 00000100:00100000:0.0:1788985864.192723:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993388160 00000100:00100000:0.0:1788985864.192743:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1788985864.192751:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993388288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985864.192798:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993388288:12345-0@lo:400:kworker.0 Request processed in 48us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985864.192804:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:0.0:1788985864.192820:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1788985864.192825:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993388160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985864.192850:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993388160:12345-0@lo:400:kworker.0 Request processed in 25us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985864.192855:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1788985864.192888:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993388160:0@lo:400:kworker.0 00000100:00100000:0.0:1788985864.192897:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993388288:0@lo:400:kworker.0 00000100:00100000:2.0:1788985864.193073:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993388416:0@lo:400:kworker.0 00000100:00100000:2.0:1788985864.193147:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985864.193177:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788985864.193183:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993388032:0@lo:400:kworker.0 00000100:00100000:2.0:1788985864.193210:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985864.193231:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993388544:0@lo:400:kworker.0 00000100:00100000:2.0:1788985864.193252:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985864.193275:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993388544 00000100:00100000:2.0:1788985864.193279:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993388544 00000100:00100000:2.0:1788985864.193308:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1788985864.193314:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993388544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985864.193352:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993388544:12345-0@lo:400:kworker.0 Request processed in 38us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985864.193358:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1788985864.193376:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993388032 00000100:00100000:2.0:1788985864.193380:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993388032 00000100:00100000:2.0:1788985864.193414:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1788985864.193421:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993388032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985864.193451:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993388032:12345-0@lo:400:kworker.0 Request processed in 31us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985864.193456:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:2.0:1788985864.193490:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993388032:0@lo:400:kworker.0 00000100:00100000:2.0:1788985864.193501:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993388544:0@lo:400:kworker.0 00000100:00100000:0.0:1788985864.193673:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993388672 00000100:00100000:0.0:1788985864.193678:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993388672 00000100:00100000:0.0:1788985864.193710:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993388416 00000100:00100000:0.0:1788985864.193712:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993388416 00000100:00100000:0.0:1788985864.193732:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1788985864.193738:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993388672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985864.193774:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993388672:12345-0@lo:400:kworker.0 Request processed in 37us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985864.193792:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:0.0:1788985864.193807:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1788985864.193813:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993388416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985864.193845:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993388416:12345-0@lo:400:kworker.0 Request processed in 33us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985864.193851:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1788985864.193878:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993388672:0@lo:400:kworker.0 00000100:00080000:1.0:1788985864.194111:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985864.194652:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993388416:0@lo:400:kworker.0 00000100:00100000:2.0:1788985864.706016:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993388800 00000100:00100000:2.0:1788985864.706024:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993388800 00000100:00100000:2.0:1788985864.706078:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:2.0:1788985864.706123:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993388800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788985864.706156:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788985864.706220:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993388800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 133us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985864.706227:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00010000:00010000:0.0:1788985865.152550:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985866.177747:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985866.352815:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985866.352864:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985866.352906:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985866.352937:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985866.352976:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971171968 00000100:00100000:0.0:1788985866.352986:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971171968 00000100:00100000:0.0:1788985866.353038:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 970 00000100:00100000:0.0:1788985866.353049:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971171968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985866.353153:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971171968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 105us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985866.353162:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 970 00000100:00100000:0.0:1788985866.353194:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971172352 00000100:00100000:0.0:1788985866.353199:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971172352 00000100:00100000:0.0:1788985866.353230:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971172224 00000100:00100000:0.0:1788985866.353233:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971172224 00000100:00100000:0.0:1788985866.353253:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 763 00000100:00100000:0.0:1788985866.353260:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971172352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985866.353304:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971172352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985866.353311:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 763 00000100:00100000:0.0:1788985866.353324:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 764 00000100:00100000:0.0:1788985866.353331:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971172224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985866.353349:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971172224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 20us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985866.353355:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 764 00000100:00100000:2.0:1788985866.353527:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971172096 00000100:00100000:2.0:1788985866.353532:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971172096 00000100:00100000:2.0:1788985866.353583:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1129 00000100:00100000:2.0:1788985866.353591:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971172096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:0.0:1788985866.360635:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788985866.360644:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788985866.360646:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788985867.204966:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985868.230351:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985868.293420:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993388928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788985868.293567:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788985869.252914:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985869.312637:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788985869.312661:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993389056:0@lo:400:kworker.0 00000100:00100000:2.0:1788985869.312732:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985869.313058:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993389312:0@lo:400:kworker.0 00000100:00100000:2.0:1788985869.313118:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985869.313145:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788985869.313151:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993389184:0@lo:400:kworker.0 00000100:00100000:2.0:1788985869.313173:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985869.313191:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993389696:0@lo:400:kworker.0 00000100:00100000:2.0:1788985869.313211:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985869.313552:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993389440 00000100:00100000:0.0:1788985869.313557:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993389440 00000100:00100000:0.0:1788985869.313596:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993389696 00000100:00100000:0.0:1788985869.313599:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993389696 00000100:00100000:1.0:1788985869.313656:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993389056 00000100:00100000:1.0:1788985869.313661:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993389056 00000100:00100000:1.0:1788985869.313694:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1788985869.313703:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993389056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985869.313757:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993389056:12345-0@lo:400:kworker.0 Request processed in 55us (1024us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985869.313764:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1788985869.313794:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993389312 00000100:00100000:1.0:1788985869.313798:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993389312 00000100:00080000:2.0:1788985869.316900:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788985869.316911:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985869.320375:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1788985869.320391:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993389312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985869.320493:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993389312:12345-0@lo:400:kworker.0 Request processed in 107us (7373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985869.320501:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:0.0:1788985869.323867:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1788985869.323883:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993389696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985869.323983:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993389696:12345-0@lo:400:kworker.0 Request processed in 105us (10770us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985869.323990:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1788985869.824342:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788985869.824367:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993389824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985869.824432:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985869.824738:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993389824 00000100:00100000:1.0:1788985869.824748:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993389824 00000100:00100000:1.0:1788985869.824801:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1788985869.824811:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993389824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985869.824844:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788985869.824903:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993389824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985869.824910:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:0.0:1788985869.825036:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993389824:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788985870.272310:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985871.297694:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985871.482695:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985871.482739:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985871.482770:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985871.482808:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985871.482809:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971172480 00000100:00100000:0.0:1788985871.482819:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971172480 00000100:00100000:0.0:1788985871.482878:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 972 00000100:00100000:0.0:1788985871.482889:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971172480:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985871.482900:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971172736 00000100:00100000:2.0:1788985871.482909:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971172736 00000100:00100000:2.0:1788985871.482946:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971172864 00000100:00100000:2.0:1788985871.482948:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971172864 00000100:00100000:0.0:1788985871.482952:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971172480:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985871.482959:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 972 00000100:00100000:2.0:1788985871.482988:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 767 00000100:00100000:2.0:1788985871.482996:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971172736:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985871.483025:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971172736:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985871.483031:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 767 00000100:00100000:2.0:1788985871.483044:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 768 00000100:00100000:2.0:1788985871.483050:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971172864:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985871.483086:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971172864:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985871.483127:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 768 00000100:00080000:2.0:1788985871.483144:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788985871.483148:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788985871.484406:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788985872.321672:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985873.344317:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985873.408488:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788985873.408513:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993389952:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788985873.408593:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788985873.409258:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788985873.409300:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993389952:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788985874.369217:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985874.432468:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993390208:0@lo:400:kworker.0 00000100:00100000:0.0:1788985874.432537:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985874.432605:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993390720:0@lo:400:kworker.0 00000100:00100000:0.0:1788985874.432631:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985874.432654:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788985874.432660:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993390336:0@lo:400:kworker.0 00000100:00100000:0.0:1788985874.432680:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985874.432768:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993390464:0@lo:400:kworker.0 00000100:00100000:1.0:1788985874.432800:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985874.432835:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788985874.432841:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993390080:0@lo:400:kworker.0 00000100:00100000:1.0:1788985874.432867:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985874.432888:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993390592:0@lo:400:kworker.0 00000100:00100000:1.0:1788985874.432909:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985874.432937:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993390208 00000100:00100000:1.0:1788985874.432944:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993390208 00000100:00100000:1.0:1788985874.432990:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993390336 00000100:00100000:1.0:1788985874.432993:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993390336 00000100:00100000:1.0:1788985874.433016:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993390592 00000100:00100000:1.0:1788985874.433018:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993390592 00000100:00100000:1.0:1788985874.433034:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:1.0:1788985874.433293:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993390208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985874.433394:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993390208:12345-0@lo:400:kworker.0 Request processed in 352us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985874.433412:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:1.0:1788985874.433441:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1788985874.433448:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993390336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985874.433476:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993390336:12345-0@lo:400:kworker.0 Request processed in 30us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985874.433482:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1788985874.433492:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0:1788985874.433497:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993390592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985874.433526:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993390592:12345-0@lo:400:kworker.0 Request processed in 29us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985874.433545:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0:1788985874.433603:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993390592:0@lo:400:kworker.0 00000100:00100000:1.0:1788985874.433653:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942743b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993390336:0@lo:400:kworker.0 00000100:00100000:1.0:1788985874.433663:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993390208:0@lo:400:kworker.0 00000100:00100000:0.0:1788985874.433940:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993390720 00000100:00100000:0.0:1788985874.433945:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993390720 00000100:00100000:0.0:1788985874.433997:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993390464 00000100:00100000:0.0:1788985874.434001:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993390464 00000100:00100000:0.0:1788985874.434023:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1788985874.434029:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993390720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985874.434081:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993390720:12345-0@lo:400:kworker.0 Request processed in 53us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985874.434111:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:0.0:1788985874.434125:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:0.0:1788985874.434152:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993390464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985874.434187:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993390464:12345-0@lo:400:kworker.0 Request processed in 36us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985874.434193:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:0.0:1788985874.434225:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942741c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993390464:0@lo:400:kworker.0 00000100:00100000:0.0:1788985874.434260:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993390720:0@lo:400:kworker.0 00000100:00080000:2.0:1788985874.435388:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788985874.435394:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985874.437846:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993390080:0@lo:400:kworker.0 00010000:00010000:0.0:1788985875.392771:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985876.416314:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985876.594998:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985876.595055:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985876.595132:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985876.595170:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985876.595201:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971173376 00000100:00100000:1.0:1788985876.595211:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971173376 00000100:00100000:1.0:1788985876.595264:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971173248 00000100:00100000:1.0:1788985876.595267:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971173248 00000100:00100000:1.0:1788985876.595292:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 771 00000100:00100000:1.0:1788985876.595302:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971173376:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985876.595381:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971173376:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 80us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985876.595389:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 771 00000100:00100000:1.0:1788985876.595406:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 772 00000100:00100000:1.0:1788985876.595413:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971173248:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985876.595439:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971173248:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985876.595445:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 772 00000100:00100000:2.0:1788985876.595672:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971173120 00000100:00100000:2.0:1788985876.595690:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971173120 00000100:00100000:2.0:1788985876.595727:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1137 00000100:00100000:2.0:1788985876.595734:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971173120:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985876.595764:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971173120:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985876.595770:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1137 00000100:00080000:2.0:1788985876.595788:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788985876.595792:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788985876.595794:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788985877.442788:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985878.466319:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985878.530634:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788985878.530704:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993390976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788985878.530771:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788985878.531836:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788985879.489106:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985879.553225:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993391104 00000100:00100000:0.0:1788985879.553235:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993391104 00000100:00100000:0.0:1788985879.553293:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1788985879.553303:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993391104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985879.553478:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993391232:0@lo:400:kworker.0 00000100:00100000:2.0:1788985879.553542:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985879.553571:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788985879.553577:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993391360:0@lo:400:kworker.0 00000100:00100000:2.0:1788985879.553598:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985879.553623:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993391488:0@lo:400:kworker.0 00000100:00100000:2.0:1788985879.553649:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985879.553678:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993391232 00000100:00100000:2.0:1788985879.553682:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993391232 00000100:00100000:2.0:1788985879.553707:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993391360 00000100:00100000:2.0:1788985879.553710:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993391360 00000100:00100000:2.0:1788985879.553734:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1788985879.553741:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993391232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985879.553814:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993391232:12345-0@lo:400:kworker.0 Request processed in 73us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985879.553822:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1788985879.553839:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1139 00000100:00100000:2.0:1788985879.553845:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993391360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985879.553874:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993391360:12345-0@lo:400:kworker.0 Request processed in 29us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985879.553880:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1139 00000100:00100000:2.0:1788985879.553899:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993391488 00000100:00100000:2.0:1788985879.553902:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993391488 00000100:00100000:2.0:1788985879.553927:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:2.0:1788985879.553933:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993391488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985879.553964:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993391488:12345-0@lo:400:kworker.0 Request processed in 31us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985879.553971:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00080000:2.0:1788985879.553993:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985879.554033:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993391488:0@lo:400:kworker.0 00000100:00100000:2.0:1788985879.554063:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993391360:0@lo:400:kworker.0 00000100:00100000:2.0:1788985879.554072:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993391232:0@lo:400:kworker.0 00000100:00100000:0.0:1788985879.554482:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993391104:12345-0@lo:400:kworker.0 Request processed in 1179us (1367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985879.554490:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:2.0:1788985879.554761:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788985879.554771:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993391744:0@lo:400:kworker.0 00000100:00100000:2.0:1788985879.554805:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985879.554838:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788985879.554845:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993391616:0@lo:400:kworker.0 00000100:00100000:2.0:1788985879.554867:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985879.554906:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993391616 00000100:00100000:2.0:1788985879.554911:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993391616 00000100:00100000:2.0:1788985879.554945:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1788985879.554952:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993391616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985879.554990:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993391616:12345-0@lo:400:kworker.0 Request processed in 38us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985879.554995:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00080000:2.0:1788985879.555029:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985879.555049:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993391616:0@lo:400:kworker.0 00000100:00100000:1.0:1788985879.557032:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993391744 00000100:00100000:1.0:1788985879.557045:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993391744 00000100:00100000:1.0:1788985879.557217:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:1.0:1788985879.557227:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993391744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985879.557312:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993391744:12345-0@lo:400:kworker.0 Request processed in 88us (2506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985879.557318:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:1.0:1788985879.557457:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993391744:0@lo:400:kworker.0 00000100:00080000:2.0:1788985879.560827:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985880.064452:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788985880.064476:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993391872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985880.064548:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985880.065600:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993391872:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788985880.520159:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985881.318128:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971173504 00000100:00100000:2.0:1788985881.318141:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971173504 00000100:00100000:2.0:1788985881.318257:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 474 00000100:00100000:2.0:1788985881.318268:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38070:x1875885971173504:12345-192.168.206.21@tcp:48:lfs.0 00000100:00080000:0.0:1788985881.318545:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985881.318616:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38070:x1875885971173504:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 348us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985881.318625:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 474 00000100:00100000:1.0:1788985881.338319:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985881.338422:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971173632 00000100:00100000:2.0:1788985881.338434:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971173632 00000100:00100000:2.0:1788985881.338523:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 250 00000100:00100000:2.0:1788985881.338534:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38070:x1875885971173632:12345-192.168.206.21@tcp:19:lfs.0 00000100:00080000:0.0:1788985881.339164:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788985881.339997:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38070:x1875885971173632:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 1455us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985881.340022:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 250 00000100:00100000:1.0:1788985881.360708:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985881.365064:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971173760 00000100:00100000:2.0:1788985881.365134:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971173760 00000100:00100000:2.0:1788985881.365243:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 251 00000100:00100000:2.0:1788985881.365255:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38070:x1875885971173760:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788985881.365699:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38070:x1875885971173760:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 445us (5005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985881.365709:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 251 00000100:00080000:0.0:1788985881.366167:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788985881.375647:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971173888 00000100:00100000:2.0:1788985881.375665:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971173888 00000100:00100000:2.0:1788985881.375760:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 475 00000100:00100000:2.0:1788985881.375773:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38070:x1875885971173888:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788985881.381590:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38070:x1875885971173888:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 5809us (7848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985881.381605:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 475 00000100:00100000:2.0:1788985881.396390:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971174016 00000100:00100000:2.0:1788985881.396405:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971174016 00000100:00100000:1.0:1788985881.400764:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985881.400917:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971174144 00000100:00100000:2.0:1788985881.400927:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971174144 00000100:00100000:2.0:1788985881.400982:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 252 00000100:00100000:2.0:1788985881.401283:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38070:x1875885971174144:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788985881.401723:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38070:x1875885971174144:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 729us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985881.401731:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 252 00000100:00100000:1.0:1788985881.408639:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985881.408756:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971174272 00000100:00100000:2.0:1788985881.408766:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971174272 00000100:00100000:2.0:1788985881.408856:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 253 00000100:00100000:2.0:1788985881.408868:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38070:x1875885971174272:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788985881.409672:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38070:x1875885971174272:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 804us (1038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985881.409681:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 253 00000100:00100000:0.0:1788985881.418932:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985881.419603:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971174400 00000100:00100000:2.0:1788985881.419614:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971174400 00000100:00100000:2.0:1788985881.419678:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 477 00000100:00100000:2.0:1788985881.419689:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38070:x1875885971174400:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788985881.421393:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38070:x1875885971174400:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 1700us (2465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985881.421404:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 477 00010000:00010000:0.0:1788985881.539309:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985881.717538:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985881.717608:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971174528 00000100:00100000:0.0:1788985881.717618:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971174528 00000100:00100000:0.0:1788985881.717670:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 976 00000100:00100000:0.0:1788985881.717682:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971174528:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985881.717750:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971174528:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 71us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985881.717759:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 976 00000100:00100000:1.0:1788985881.730176:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985881.730241:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971174656 00000100:00100000:1.0:1788985881.730250:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971174656 00000100:00100000:1.0:1788985881.730299:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1141 00000100:00100000:1.0:1788985881.730309:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971174656:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985881.730376:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971174656:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985881.730383:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1141 00000100:00100000:0.0:1788985881.734621:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985881.734663:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985881.737663:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 776 00000100:00100000:2.0:1788985881.737675:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971174912:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985881.737756:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971174912:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 82us (3091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985881.737766:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 776 00010000:00010000:1.0:1788985882.561398:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985883.591931:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985883.650755:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993392000 00000100:00100000:2.0:1788985883.650768:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993392000 00000100:00100000:2.0:1788985883.650827:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:2.0:1788985883.650836:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993392000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985883.650873:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985883.650953:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993392000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985883.650961:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00000100:00080000:2.0:1788985883.650983:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788985883.651035:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993392000:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788985884.070783:0:64636:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff5c3eca10 20000000:00000080:0.0:1788985884.070798:0:64636:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a4395a800 uarg=0000000000000000 00010000:00010000:0.0:1788985884.073184:0:64636:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788985884.073257:0:64636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45aca200) 00010000:00010000:0.0:1788985884.073261:0:64636:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788985884.073271:0:64636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54747b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0d95 expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985884.073292:0:64636:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1788985884.073307:0:64636:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985884.073320:0:64636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5474cf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 64636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985884.073333:0:64636:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547458 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547451 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985884.073341:0:64636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5474cf lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 64636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985884.073381:0:64636:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547458 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547451 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985884.073396:0:64636:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547458 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547451 expref: 18 pid: 5846 timeout: 1767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985884.073410:0:64636:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64636:1875885993392128:0@lo:104: 00000100:00100000:0.0:1788985884.073462:0:64636:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985884.073558:0:64636:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a457dc480 going to sleep for 11 seconds 00000100:00100000:0.0:1788985884.074344:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:64636:x1875885993392128:12345-0@lo:104: 00010000:00010000:0.0:1788985884.074359:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf547451 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547458 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985884.074471:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985884.074478:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:64636:x1875885993392128:12345-0@lo:104: Request processed in 185us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985884.074485:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00010000:00010000:1.0:1788985884.075298:0:64636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547458 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547451 expref: 18 pid: 5846 timeout: 1767 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985884.075310:0:64636:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:64636:1875885993392128:0@lo:104: 00010000:00010000:1.0:1788985884.075324:0:64636:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5474cf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985884.075332:0:64636:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5474cf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985884.075346:0:64636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5474cf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985884.075352:0:64636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5474cf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64636 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985884.608316:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985884.673077:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993392384:0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.673171:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985884.673210:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993392896:0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.673234:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985884.673256:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788985884.673262:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993392512:0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.673290:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985884.673304:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993393024:0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.673323:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985884.673347:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993392384 00000100:00100000:1.0:1788985884.673354:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993392384 00000100:00100000:1.0:1788985884.673389:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:1.0:1788985884.673396:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993392384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.673439:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993392384:12345-0@lo:400:kworker.0 Request processed in 42us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985884.673445:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:1.0:1788985884.673642:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993392896 00000100:00100000:1.0:1788985884.673647:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993392896 00000100:00100000:1.0:1788985884.673676:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993392512 00000100:00100000:1.0:1788985884.673678:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993392512 00000100:00100000:1.0:1788985884.673702:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:1.0:1788985884.673708:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993392896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.673736:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993392896:12345-0@lo:400:kworker.0 Request processed in 29us (502us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985884.673741:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00100000:1.0:1788985884.673751:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:1.0:1788985884.673756:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993392512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.673774:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993392512:12345-0@lo:400:kworker.0 Request processed in 19us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985884.673779:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:1.0:1788985884.673798:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993393024 00000100:00100000:1.0:1788985884.673801:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993393024 00000100:00100000:1.0:1788985884.673824:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1788985884.673829:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993393024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.673852:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993393024:12345-0@lo:400:kworker.0 Request processed in 24us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985884.673858:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00080000:1.0:1788985884.673872:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985884.673876:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985884.673906:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993392512:0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.673915:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993393024:0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.673921:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993392384:0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.673928:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993392896:0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.674713:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993392640 00000100:00100000:1.0:1788985884.674718:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993392640 00000100:00100000:1.0:1788985884.674811:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1788985884.674818:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993392640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985884.674855:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993392640:12345-0@lo:400:kworker.0 Request processed in 38us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985884.674861:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1788985884.674890:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993392640:0@lo:400:kworker.0 00000100:00080000:0.0:1788985884.675165:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985885.194202:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993393152 00000100:00100000:2.0:1788985885.194211:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993393152 00000100:00100000:2.0:1788985885.194263:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00000100:00100000:2.0:1788985885.194273:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993393152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788985885.194307:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985885.194362:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993393152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985885.194369:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 10000000:01000000:0.0:1788985885.509028:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788985885.509035:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788985885.509041:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788985885.509086:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985885.509120:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985885.509132:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985885.509182:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993393280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788985885.509248:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985885.509290:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a457dbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788985885.509313:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993393280 00000100:00100000:0.0:1788985885.509321:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993393280 00000100:00100000:0.0:1788985885.509369:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1788985885.509379:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993393280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985885.509391:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985885.509403:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5474dd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5474d6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985885.509426:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5474dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5474d6 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985885.509435:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5474dd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5474d6 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985885.509444:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efc00, rc 0) 00000100:00100000:0.0:1788985885.509697:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993393280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 320us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985885.509704:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1788985885.509758:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993393280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985885.509773:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5474dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985885.509782:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5474dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985885.509808:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788985885.509813:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5474dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985885.509820:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5474dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985886.837427:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985886.837459:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985886.837490:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985886.837519:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985886.837565:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971175040 00000100:00100000:0.0:1788985886.837575:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971175040 00000100:00100000:0.0:1788985886.837621:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 979 00000100:00100000:0.0:1788985886.837631:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971175040:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985886.837694:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971175040:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 64us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985886.837702:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 979 00000100:00100000:0.0:1788985886.837732:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971175424 00000100:00100000:0.0:1788985886.837736:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971175424 00000100:00100000:0.0:1788985886.837768:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971175296 00000100:00100000:0.0:1788985886.837771:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971175296 00000100:00100000:0.0:1788985886.837792:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 779 00000100:00100000:0.0:1788985886.837798:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971175424:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985886.837824:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971175424:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985886.839986:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 779 00000100:00100000:0.0:1788985886.840030:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 780 00000100:00100000:0.0:1788985886.840048:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971175296:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985886.840128:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971175296:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 89us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985886.840135:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 780 00000100:00080000:0.0:1788985886.840284:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788985886.840288:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788985886.840449:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971175168 00000100:00100000:2.0:1788985886.840457:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971175168 00000100:00100000:2.0:1788985886.840519:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1145 00000100:00100000:2.0:1788985886.840527:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971175168:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985886.840564:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971175168:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (3147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985886.840571:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1145 00000100:00100000:0.0:1788985887.205517:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985887.221516:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000001:00080000:0.0:1788985887.264289:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967479 is committed 00010000:00010000:2.0:1788985887.264494:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5474f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985887.264508:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5474f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985887.264517:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5474f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985887.264523:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985887.264528:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5474f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985887.264554:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5474f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985887.264570:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:2.0:1788985887.264573:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788985887.264578:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5474f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985887.264585:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5474f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985888.114499:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788985888.114515:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993393408 00000100:00100000:2.0:1788985888.114520:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993393408 00000100:00100000:2.0:1788985888.114595:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1788985888.114605:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f354c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:64832:x1875885993393408:12345-0@lo:104: 00010000:00010000:2.0:1788985888.114618:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5474dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985888.114808:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788985888.114815:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f354c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:64832:x1875885993393408:12345-0@lo:104: Request processed in 212us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985888.114822:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00010000:00010000:0.0:1788985888.114893:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985888.114899:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5474dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985888.114907:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788985888.114911:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5474dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985888.114919:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5474dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788985888.114926:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5474dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985888.114932:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788985888.114975:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5474dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985888.114993:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788985888.115021:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5474dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985888.115028:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf5474d6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5474dd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985888.115043:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985888.115044:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985888.115045:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985888.115052:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788985888.115063:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993393536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985888.115115:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985888.115216:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993393536 00000100:00100000:2.0:1788985888.115220:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993393536 00010000:00010000:2.0:1788985888.115239:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5474dd lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5474d6 expref: 19 pid: 5849 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985888.115263:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788985888.115276:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993393536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985888.115286:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985888.115291:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5474dd lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5474d6 expref: 19 pid: 5849 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985888.115301:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5474dd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5474d6 expref: 19 pid: 5849 timeout: 1772 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985888.115316:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf5474f9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985888.115323:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf5474f9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 64832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985888.115335:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf5474f9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 64832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985888.115341:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf5474f9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985888.115347:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf5474f9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 64832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985888.115352:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf5474f9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985888.115357:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985888.115360:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf5474f9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 64832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985888.115367:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf5474f9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 64832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985888.115381:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf5474f9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 64832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985888.115389:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985888.115421:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993393536:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985888.115428:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1788985888.115458:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993393536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985888.706209:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788985889.729275:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788985889.729281:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788985889.729284:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788985889.729323:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985889.729334:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985889.729499:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985889.729525:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942743b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993393792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788985889.729584:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985889.730229:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a52eca3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788985889.730362:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993393792 00000100:00100000:2.0:1788985889.730370:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993393792 00000100:00100000:2.0:1788985889.730419:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:2.0:1788985889.730429:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993393792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985889.730442:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985889.730457:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf547507 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547500 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985889.730481:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf547507 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547500 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985889.730492:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf547507 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547500 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985889.730500:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0600, rc 0) 00000100:00100000:2.0:1788985889.730755:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993393792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 327us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985889.730762:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:1.0:1788985889.730840:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942743b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993393792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985889.730855:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547507 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985889.730865:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547507 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985889.730897:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788985889.730903:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547507 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985889.730910:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547507 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985889.794846:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993394304:0@lo:400:kworker.0 00000100:00100000:0.0:1788985889.795112:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993393920:0@lo:400:kworker.0 00000100:00100000:0.0:1788985889.795148:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985889.795175:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993394432:0@lo:400:kworker.0 00000100:00100000:0.0:1788985889.795198:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985889.795231:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993393920 00000100:00100000:0.0:1788985889.795237:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993393920 00000100:00100000:0.0:1788985889.795280:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:0.0:1788985889.795288:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993393920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985889.795335:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993393920:12345-0@lo:400:kworker.0 Request processed in 48us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985889.795342:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:0.0:1788985889.795365:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993394432 00000100:00100000:0.0:1788985889.795368:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993394432 00000100:00100000:0.0:1788985889.795399:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:0.0:1788985889.795413:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993394432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985889.795459:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993394432:12345-0@lo:400:kworker.0 Request processed in 47us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985889.795465:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00080000:0.0:1788985889.795483:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985889.795512:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993393920:0@lo:400:kworker.0 00000100:00100000:0.0:1788985889.795522:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993394432:0@lo:400:kworker.0 00000100:00100000:2.0:1788985889.795643:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985889.795689:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993394048:0@lo:400:kworker.0 00000100:00100000:2.0:1788985889.795714:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985889.795734:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788985889.795740:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993394176:0@lo:400:kworker.0 00000100:00100000:2.0:1788985889.795761:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985889.795788:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993394304 00000100:00100000:2.0:1788985889.795791:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993394304 00000100:00100000:2.0:1788985889.795817:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993394048 00000100:00100000:2.0:1788985889.795820:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993394048 00000100:00100000:2.0:1788985889.795853:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1788985889.795859:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993394304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985889.795895:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993394304:12345-0@lo:400:kworker.0 Request processed in 36us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985889.795902:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1147 00000100:00100000:2.0:1788985889.795916:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1788985889.795922:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993394048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985889.795951:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993394048:12345-0@lo:400:kworker.0 Request processed in 29us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985889.795967:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1788985889.795985:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993394176 00000100:00100000:2.0:1788985889.795989:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993394176 00000100:00100000:2.0:1788985889.796015:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:2.0:1788985889.796022:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993394176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985889.796051:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993394176:12345-0@lo:400:kworker.0 Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985889.796067:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00080000:2.0:1788985889.796085:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985889.796125:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993394176:0@lo:400:kworker.0 00000100:00100000:2.0:1788985889.796135:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993394048:0@lo:400:kworker.0 00000100:00100000:2.0:1788985889.796165:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094139ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993394304:0@lo:400:kworker.0 00000100:00100000:0.0:1788985890.305693:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993394560:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985890.305757:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985890.305822:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993394560 00000100:00100000:0.0:1788985890.305829:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993394560 00000100:00100000:0.0:1788985890.305870:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1788985890.305877:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993394560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985890.305908:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985890.305951:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993394560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985890.305968:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00000100:00100000:0.0:1788985890.306011:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993394560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788985890.752249:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985891.220128:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:0.0:1788985891.224299:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985891.227065:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985891.227165:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971176192 00000100:00100000:1.0:1788985891.227174:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971176192 00000100:00100000:1.0:1788985891.227229:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 481 00000100:00100000:1.0:1788985891.227238:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38233:x1875885971176192:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:1.0:1788985891.227257:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985891.227277:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54752a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0db8 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.227536:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547531 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.227551:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547531 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.227778:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547531 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.227848:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547538 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.227857:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.227872:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788985891.230908:0:15241:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x10:0x0], index 0: 0 00010000:00010000:1.0:1788985891.231277:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54753f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.231294:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54753f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.231305:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54753f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.231340:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547531 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.231348:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547531 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.231354:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547531 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.231359:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985891.231364:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547531 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.231372:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547531 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.231383:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:1.0:1788985891.231386:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985891.231397:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547531 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.231403:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547531 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788985891.235337:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000727e6783 reply state 00000000aa40bbdc transno 4294967480 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985891.235427:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788985891.235488:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54752a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0db8 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.235513:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54753f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0db8 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.235522:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9b0a45316200) 00010000:00010000:1.0:1788985891.235526:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788985891.235529:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788985891.235616:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:38233:x1875885971176192:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 8378us (8558us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1788985891.235625:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 481 00010000:00010000:2.0:1788985891.239558:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.239574:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547538 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.239582:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.239589:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985891.239593:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.239601:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547538 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.239616:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x93c5647 (ffff9b0a45316d00) 00010000:00010000:2.0:1788985891.239619:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985891.239624:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547538 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.239630:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547538 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985891.242174:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:1.0:1788985891.248499:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54754d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.248516:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54754d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.248523:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54754d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.248554:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985891.248559:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54754d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.248567:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54754d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.248582:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:1.0:1788985891.248586:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985891.248590:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54754d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.248596:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54754d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985891.249164:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971176576 00000100:00100000:0.0:1788985891.249174:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971176576 00000100:00100000:0.0:1788985891.249222:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 483 00000100:00100000:0.0:1788985891.249232:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:38233:x1875885971176576:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788985891.249260:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985891.249278:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547554 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0dbf expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.249329:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dbf expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.249342:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547554 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x28:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dbf expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.249358:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788985891.249361:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788985891.249363:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eee00, rc 0) 00000100:00100000:0.0:1788985891.249493:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:38233:x1875885971176576:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 261us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985891.249500:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 483 00000100:00100000:1.0:1788985891.259471:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985891.259699:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971176704 00000100:00100000:0.0:1788985891.259710:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971176704 00000100:00100000:0.0:1788985891.259790:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 254 00000100:00080000:2.0:1788985891.259797:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985891.259803:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971176704:12345-192.168.206.21@tcp:2:touch.60003 00000100:00100000:0.0:1788985891.260156:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971176704:12345-192.168.206.21@tcp:2:touch.60003 Request processed in 356us (691us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1788985891.260164:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 254 00000100:00100000:2.0:1788985891.265082:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985891.266916:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971176960 00000100:00100000:0.0:1788985891.266932:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971176960 00000100:00100000:0.0:1788985891.267007:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:0.0:1788985891.267018:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:38233:x1875885971176960:12345-192.168.206.21@tcp:35:touch.60003 00000100:00100000:0.0:1788985891.267465:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:38233:x1875885971176960:12345-192.168.206.21@tcp:35:touch.60003 Request processed in 448us (2390us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788985891.267474:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 50 00000100:00100000:1.0:1788985891.371965:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971177088 00000100:00100000:1.0:1788985891.371976:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971177088 00000100:00100000:1.0:1788985891.372053:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 484 00000100:00100000:1.0:1788985891.372064:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:38237:x1875885971177088:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:1.0:1788985891.372086:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985891.372158:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54755b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0dc6 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372221:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547562 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372235:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547562 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372265:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547562 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372282:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547569 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372290:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372297:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372540:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372550:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372558:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788985891.372590:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x28:0x0]: returning size 0 00000004:00200000:1.0:1788985891.372595:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788985891.372614:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372625:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372633:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547562 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372650:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547562 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372655:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547562 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372661:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985891.372665:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547562 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372671:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547562 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372683:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:1.0:1788985891.372686:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985891.372691:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547562 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372698:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547562 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372712:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547569 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372718:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547569 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372724:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372729:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985891.372739:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547569 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372745:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547569 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372754:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x93c5647 (ffff9b0a45316e00) 00010000:00010000:1.0:1788985891.372757:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985891.372760:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547569 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372766:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547569 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372798:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54755b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dc6 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372813:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dc6 expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985891.372820:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:1.0:1788985891.372823:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788985891.372825:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788985891.372887:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:38237:x1875885971177088:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 825us (1389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985891.372895:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 484 00000100:00100000:2.0:1788985891.385135:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985891.385218:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971177216 00000100:00100000:0.0:1788985891.385228:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971177216 00000100:00100000:0.0:1788985891.385293:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 255 00000100:00100000:0.0:1788985891.385304:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971177216:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:0.0:1788985891.385320:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985891.385339:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf547577 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0dcd expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788985891.385377:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x6aa1c222, atime: 0x6aa1c222, ctime: 0x6aa1c222, blocks: 0x1 00010000:00010000:0.0:1788985891.385770:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=1675s v=(0 0) 00010000:00010000:0.0:1788985891.385776:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788985891.385786:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf547577 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dcd expref: 7 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.385805:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf547577 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dcd expref: 7 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.385817:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef800, rc 0) 00000100:00100000:0.0:1788985891.385872:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971177216:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 570us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985891.385880:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 255 00000100:00100000:2.0:1788985891.392985:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985891.393862:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971177472 00000100:00100000:0.0:1788985891.393885:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971177472 00000100:00100000:0.0:1788985891.393992:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 485 00000100:00100000:0.0:1788985891.394003:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:38237:x1875885971177472:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:0.0:1788985891.394050:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788985891.394075:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x28:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dc6 expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.394135:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547554 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x28:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dbf expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.394355:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788985891.394368:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985891.394390:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54757e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.394403:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54757e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.394413:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54757e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.394427:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547585 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.394434:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.394440:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.394643:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54758c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.394659:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54758c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.394666:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54758c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788985891.398835:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].16, 64 off9216 00000004:00080000:0.0:1788985891.398851:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1675301761244ns, next at 1676301758010ns, rc = 0 00010000:00010000:0.0:1788985891.398925:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547593 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.398941:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.398963:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.398972:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547593 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.398979:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547593 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.398984:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547593 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399009:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788985891.399032:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54758c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399039:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54758c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399059:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54758c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399065:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985891.399069:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54758c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399076:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54758c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399108:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9b0a4823b000) 00010000:00010000:0.0:1788985891.399112:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788985891.399118:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54758c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399124:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54758c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x28:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399142:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54757e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399159:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54757e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399164:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54757e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399169:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985891.399172:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54757e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399188:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54757e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399196:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:0.0:1788985891.399199:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985891.399201:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54757e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.399206:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54757e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x24:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788985891.399216:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000560ec6a0 reply state 00000000f37f8411 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985891.399225:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788985891.399304:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:38237:x1875885971177472:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 5300us (6325us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788985891.399313:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 485 00010000:00010000:2.0:1788985891.399381:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985891.399387:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547593 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.399393:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985891.399397:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547593 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.399403:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547593 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.399412:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x28:0x0].0x0 (ffff9b0a4823b000) 00010000:00010000:2.0:1788985891.399415:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788985891.399418:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547593 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.399423:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547593 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x28:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.399440:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985891.399441:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985891.399443:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985891.404460:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547585 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.404476:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547585 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.404507:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547585 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.404512:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985891.404517:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547585 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.404524:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547585 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.404540:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x93c5647 (ffff9b0a4823b200) 00010000:00010000:2.0:1788985891.404544:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985891.404548:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547585 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985891.404554:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547585 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x24:0x0].0x93c5647 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985891.777024:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985891.953147:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971177728 00000100:00100000:1.0:1788985891.953151:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971177728 00000100:00100000:1.0:1788985891.953189:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1149 00000100:00100000:1.0:1788985891.953198:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:2349:x1875885971177728:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985891.953258:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:2349:x1875885971177728:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 61us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985891.953265:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1149 00000001:00080000:0.0:1788985892.437928:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967483 is committed 00000004:00080000:0.0:1788985892.437941:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 39 committed 00000100:00100000:0.0:1788985892.439268:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993394688:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788985892.439333:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985892.439435:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993394688 00000100:00100000:1.0:1788985892.439443:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993394688 00000100:00100000:1.0:1788985892.439511:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788985892.439521:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993394688:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788985892.439547:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:16 count 1 00010000:00010000:1.0:1788985892.439570:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.439591:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf547577 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dcd expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.439600:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788985892.439604:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788985892.439608:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.439634:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf547577 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dcd expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.439648:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf547577 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dcd expref: 6 pid: 8478 timeout: 1776 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985892.439659:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875885993394816:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788985892.439721:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a4991b900 going to sleep for 11 seconds 00000100:00080000:0.0:1788985892.439920:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985892.447153:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875885993394816:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788985892.447182:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985892.471019:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985892.471073:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971178112 00000100:00100000:1.0:1788985892.471249:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971178112 00010000:00010000:1.0:1788985892.471286:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf547577 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dcd expref: 7 pid: 8478 timeout: 1776 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985892.471325:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 308 00000100:00100000:1.0:1788985892.471335:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971178112:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788985892.471348:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788985892.471597:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf547577 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dcd expref: 7 pid: 8478 timeout: 1776 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.471611:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf547577 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dcd expref: 7 pid: 8478 timeout: 1776 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.471636:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf547577 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dcd expref: 7 pid: 8478 timeout: 1776 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.471649:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788985892.471653:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788985892.471658:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.471680:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.471703:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788985892.471749:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971178112:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 415us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985892.471756:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 308 00010000:00010000:1.0:1788985892.471852:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.471861:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.471871:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.471878:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.471895:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788985892.472907:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993394688:12345-0@lo:6:osp-syn-0-0.0 Request processed in 33385us (33570us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788985892.472916:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00010000:00010000:1.0:1788985892.472953:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788985892.472960:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.472975:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788985892.472979:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.472989:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.473004:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.473011:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf54759a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985892.473041:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985892.473044:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985892.473045:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788985892.473079:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0942741f80/2, rc 0, transno 4294967328 00000100:00100000:1.0:1788985892.473111:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942741f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993394688:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788985892.800422:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788985893.246568:0:65077:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb9593d90 20000000:00000080:0.0:1788985893.246585:0:65077:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a797ab800 uarg=0000000000000000 00010000:00010000:0.0:1788985893.247058:0:65077:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788985893.247144:0:65077:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:0.0:1788985893.247147:0:65077:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788985893.247159:0:65077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547523 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0db1 expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985893.247181:0:65077:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1788985893.247198:0:65077:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985893.247211:0:65077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf5475a1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985893.247225:0:65077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf547507 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547500 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985893.247233:0:65077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf5475a1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985893.247267:0:65077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf547507 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547500 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985893.247280:0:65077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf547507 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547500 expref: 18 pid: 5848 timeout: 1777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985893.247293:0:65077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65077:1875885993394944:0@lo:104: 00000100:00100000:0.0:1788985893.247352:0:65077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985893.251996:0:65077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09429d0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788985893.252123:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993394944 00000100:00100000:1.0:1788985893.252132:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993394944 00000100:00100000:1.0:1788985893.252185:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788985893.252195:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:65077:x1875885993394944:12345-0@lo:104: 00010000:00010000:1.0:1788985893.252224:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547507 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985893.252323:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788985893.252330:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:65077:x1875885993394944:12345-0@lo:104: Request processed in 137us (4978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985893.252337:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00010000:00010000:1.0:1788985893.252359:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788985893.252364:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547507 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985893.252372:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788985893.252375:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547507 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985893.252382:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547507 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788985893.252389:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547507 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985893.252394:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788985893.252425:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547507 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985893.252432:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788985893.252450:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547507 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985893.252457:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf547500 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547507 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985893.252482:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985893.252483:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985893.252485:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985893.252503:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993395072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788985893.252539:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985893.252977:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993395072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985893.828165:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985893.892227:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993395200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788985893.892286:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985893.892365:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993395200 00000100:00100000:0.0:1788985893.892373:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993395200 00000100:00100000:0.0:1788985893.892429:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:0.0:1788985893.892437:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993395200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788985893.892476:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985893.894954:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993395200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2511us (2662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985893.894966:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00000100:00100000:1.0:1788985893.895251:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993395200:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1788985894.464202:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788985894.464209:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788985894.464214:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788985894.464260:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985894.464272:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985894.464283:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985894.464320:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993395328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788985894.464390:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985894.464446:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09427c4300 going to sleep for 11 seconds 00000100:00100000:2.0:1788985894.464529:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993395328 00000100:00100000:2.0:1788985894.464536:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993395328 00000100:00100000:2.0:1788985894.464589:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:2.0:1788985894.464598:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993395328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985894.464612:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985894.464625:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf5475af lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5475a8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985894.464648:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf5475af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5475a8 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985894.464659:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf5475af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5475a8 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985894.464680:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1800, rc 0) 00000100:00100000:2.0:1788985894.464737:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993395328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985894.464743:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:1.0:1788985894.464878:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993395328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985894.464900:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5475af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985894.464909:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5475af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985894.464943:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788985894.464948:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5475af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985894.464955:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5475af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985894.850277:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788985894.930601:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985894.930660:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1788985894.930670:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993395584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985894.930732:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941f78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993395584:12345-0@lo:400:kworker.0 Request processed in 64us (1378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985894.930739:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1788985894.930758:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1788985894.930764:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993395840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985894.930798:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993395840:12345-0@lo:400:kworker.0 Request processed in 34us (975us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985894.930803:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:0.0:1788985894.931618:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1788985894.931629:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993395968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985894.931666:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993395968:12345-0@lo:400:kworker.0 Request processed in 40us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985894.931672:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00080000:2.0:1788985894.932266:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788985894.932271:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788985894.932274:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985894.932307:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993395840:0@lo:400:kworker.0 00000100:00100000:2.0:1788985894.932320:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993395712:0@lo:400:kworker.0 00000100:00100000:2.0:1788985894.933991:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993395968:0@lo:400:kworker.0 00000100:00100000:2.0:1788985894.934004:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993395584:0@lo:400:kworker.0 00000100:00100000:0.0:1788985895.426889:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788985895.426909:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993396096:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985895.426986:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985895.427047:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993396096 00000100:00100000:0.0:1788985895.427054:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993396096 00000100:00100000:0.0:1788985895.427117:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1788985895.427126:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993396096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985895.427160:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985895.427207:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993396096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985895.427214:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00000100:00100000:0.0:1788985895.427260:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993396096:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788985895.872281:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788985896.000697:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967327 is committed 00000001:00080000:2.0:1788985896.000714:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967328 is committed 00000100:00100000:2.0:1788985896.562971:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985896.563010:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971178240 00000100:00100000:2.0:1788985896.563019:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971178240 00000100:00100000:2.0:1788985896.563110:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 486 00000100:00100000:2.0:1788985896.563121:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38325:x1875885971178240:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:2.0:1788985896.563139:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985896.563160:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5475b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0dd4 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985896.563217:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5475bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985896.563240:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5475bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985896.563253:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5475bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788985896.563285:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00000004:00200000:2.0:1788985896.563288:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788985896.563305:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5475bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985896.563340:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5475b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dd4 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985896.563361:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5475bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dd4 expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985896.563369:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788985896.563372:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788985896.563375:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0200, rc 0) 00000100:00100000:2.0:1788985896.563430:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38325:x1875885971178240:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 311us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985896.563438:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 486 00000100:00100000:1.0:1788985896.567144:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985896.568261:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971178496 00000100:00100000:0.0:1788985896.568273:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971178496 00000100:00100000:0.0:1788985896.568342:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 487 00000100:00100000:0.0:1788985896.568359:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38325:x1875885971178496:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788985896.568407:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788985896.568432:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5475bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dd4 expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985896.568448:0:5854:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf547523) 00010000:00010000:0.0:1788985896.568452:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:0.0:1788985896.568463:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985896.568485:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5475c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985896.568498:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5475c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985896.568508:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5475c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788985896.626421:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000089f0d7ea reply state 00000000c332d6c0 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5475c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985896.626435:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788985896.626449:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00010000:00080000:0.0:1788985896.626544:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788985896.626566:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38325:x1875885971178496:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 58206us (59425us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1788985896.626574:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 487 00010000:00010000:1.0:1788985896.903068:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985897.076480:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985897.076519:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985897.076550:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985897.076576:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985897.076604:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971178880 00000100:00100000:1.0:1788985897.076613:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971178880 00000100:00100000:1.0:1788985897.076660:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971179008 00000100:00100000:1.0:1788985897.076663:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971179008 00000100:00100000:1.0:1788985897.076683:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 787 00000100:00100000:1.0:1788985897.076692:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971178880:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985897.076755:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971178880:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985897.076762:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 787 00000100:00100000:1.0:1788985897.076777:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 788 00000100:00100000:1.0:1788985897.076794:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971179008:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985897.076818:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971179008:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985897.076824:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 788 00000100:00100000:1.0:1788985897.076841:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971178752 00000100:00100000:1.0:1788985897.076844:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971178752 00000100:00100000:1.0:1788985897.076868:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1153 00000100:00100000:1.0:1788985897.076874:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971178752:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985897.076902:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971178752:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985897.076908:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1153 00000100:00080000:1.0:1788985897.076935:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985897.076939:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788985897.549166:0:65275:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcc80c3de0 20000000:00000080:1.0:1788985897.549182:0:65275:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f427400 uarg=0000000000000000 00010000:00010000:0.0:1788985897.555375:0:65275:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788985897.555725:0:65275:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788985897.555746:0:65275:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985897.555777:0:65275:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985897.556487:0:65275:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf5475af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5475a8 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985897.556497:0:65275:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985897.556538:0:65275:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf5475af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5475a8 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985897.556553:0:65275:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf5475af lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5475a8 expref: 18 pid: 5848 timeout: 1781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985897.556567:0:65275:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65275:1875885993396224:0@lo:104: 00000100:00100000:0.0:1788985897.556622:0:65275:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985897.556733:0:65275:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eac780 going to sleep for 11 seconds 00000100:00100000:2.0:1788985897.562608:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993396224 00000100:00100000:2.0:1788985897.562622:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993396224 00010000:00010000:1.0:1788985897.567223:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788985897.567231:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5475af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567239:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788985897.567243:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5475af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567252:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5475af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788985897.567259:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5475af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985897.567265:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788985897.567315:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5475af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567322:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788985897.567352:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5475af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567360:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5475a8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5475af expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567376:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985897.567378:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985897.567380:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985897.567404:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788985897.567425:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993396352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788985897.567463:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985897.567503:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993396352 00000100:00100000:1.0:1788985897.567510:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993396352 00010000:00010000:1.0:1788985897.567707:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf5475af lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5475a8 expref: 19 pid: 5848 timeout: 1781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985897.567741:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788985897.567749:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993396352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985897.567760:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788985897.567767:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf5475af lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5475a8 expref: 19 pid: 5848 timeout: 1781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567778:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf5475af lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5475a8 expref: 19 pid: 5848 timeout: 1781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567928:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567937:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567954:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567960:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567967:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567985:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.567991:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788985897.567994:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.568001:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985897.568134:0:65275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf5475af lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5475a8 expref: 19 pid: 5848 timeout: 1781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985897.568147:0:65275:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65275:1875885993396224:0@lo:104: 00010000:00010000:0.0:1788985897.568166:0:65275:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985897.568175:0:65275:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985897.568182:0:65275:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.569819:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.569828:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5475cb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65275 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985897.569846:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788985897.569927:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993396352:12345-0@lo:103:ldlm_bl.0 Request processed in 2178us (2462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985897.569936:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1788985897.570498:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993396352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985897.921720:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985898.944307:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788985898.944889:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788985898.944894:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788985898.944922:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788985898.944958:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0800/0xc20d828fcf5475d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985898.944970:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0800/0xc20d828fcf5475d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985898.944992:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0800/0xc20d828fcf5475d2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985898.945179:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993396480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788985898.945243:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985898.945297:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a45664540 going to sleep for 11 seconds 00000100:00100000:2.0:1788985898.946600:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993396480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985898.946621:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0800/0xc20d828fcf5475d2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5475d9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985898.946632:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0800/0xc20d828fcf5475d2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5475d9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985898.946652:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788985898.946657:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0800/0xc20d828fcf5475d2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5475d9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985898.946665:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0800/0xc20d828fcf5475d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5475d9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985899.012388:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993396608 00000100:00100000:0.0:1788985899.012395:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993396608 00000100:00100000:0.0:1788985899.012453:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:0.0:1788985899.012462:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993396608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788985899.012492:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985899.012553:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993396608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985899.012560:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1788985899.012591:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967328 gen 2 00000004:00080000:2.0:1788985899.012597:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0942741f80, transno 4294967328 00000100:00100000:2.0:1788985899.012632:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993396608:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788985899.976954:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985900.032503:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993396992:0@lo:400:kworker.0 00000100:00100000:2.0:1788985900.032564:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985900.032616:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788985900.032622:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993397120:0@lo:400:kworker.0 00000100:00100000:2.0:1788985900.032647:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985900.032677:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993396992 00000100:00100000:2.0:1788985900.032685:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993396992 00000100:00100000:2.0:1788985900.032735:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1788985900.032744:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993396992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985900.032936:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993396992:12345-0@lo:400:kworker.0 Request processed in 192us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985900.032943:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00080000:2.0:1788985900.032964:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985900.032994:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993396992:0@lo:400:kworker.0 00000100:00100000:2.0:1788985900.033657:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993396736 00000100:00100000:2.0:1788985900.033661:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993396736 00000100:00100000:2.0:1788985900.033693:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1788985900.033700:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993396736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985900.033737:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993396736:12345-0@lo:400:kworker.0 Request processed in 38us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985900.033744:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00080000:2.0:1788985900.033765:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985900.033794:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993396736:0@lo:400:kworker.0 00000100:00100000:1.0:1788985900.033978:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993397120 00000100:00100000:1.0:1788985900.033982:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993397120 00000100:00100000:1.0:1788985900.034153:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993397376 00000100:00100000:1.0:1788985900.034157:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993397376 00000100:00100000:1.0:1788985900.034183:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:1.0:1788985900.034189:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993397120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985900.034230:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993397120:12345-0@lo:400:kworker.0 Request processed in 41us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985900.034243:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:1.0:1788985900.034269:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1788985900.034275:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993397376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985900.034310:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993397376:12345-0@lo:400:kworker.0 Request processed in 35us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985900.034316:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00080000:2.0:1788985900.036252:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788985900.036322:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993397120:0@lo:400:kworker.0 00000100:00100000:1.0:1788985900.036551:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79725500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993397376:0@lo:400:kworker.0 00000100:00100000:0.0:1788985900.932557:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985900.932656:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971179136 00000100:00100000:2.0:1788985900.932666:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971179136 00000100:00100000:2.0:1788985900.932742:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 488 00000100:00100000:2.0:1788985900.932753:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38402:x1875885971179136:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788985900.932772:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985900.932793:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5475e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ddb expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.932867:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5475e7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.932882:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5475e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.932894:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5475e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.932916:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5475ee lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.932923:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5475ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.932930:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5475ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933255:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5475f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933264:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5475f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933280:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5475f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788985900.933304:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00000004:00200000:2.0:1788985900.933308:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788985900.933325:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5475f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933337:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5475e7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933344:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5475e7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933350:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5475e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933356:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985900.933360:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5475e7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933373:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5475e7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933385:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:2.0:1788985900.933388:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985900.933392:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5475e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933398:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5475e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933421:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5475ee lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933427:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5475ee lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933433:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5475ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933438:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985900.933441:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5475ee lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933447:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5475ee lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933455:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9b0a45aca000) 00010000:00010000:2.0:1788985900.933457:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985900.933460:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5475ee lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933466:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5475ee lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933495:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5475e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ddb expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933511:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5475f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ddb expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985900.933529:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788985900.933531:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788985900.933534:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0200, rc 0) 00000100:00100000:2.0:1788985900.933592:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38402:x1875885971179136:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 841us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985900.933599:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 488 00010000:00010000:2.0:1788985902.016554:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985902.205176:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971179264 00000100:00100000:1.0:1788985902.205180:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971179264 00000100:00100000:1.0:1788985902.205219:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 986 00000100:00100000:1.0:1788985902.205227:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971179264:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985902.205270:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971179264:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 45us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985902.205276:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 986 00000100:00100000:2.0:1788985902.209230:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971179392 00000100:00100000:2.0:1788985902.209241:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971179392 00000100:00080000:0.0:1788985902.211498:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985902.214614:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971179648 00000100:00100000:2.0:1788985902.214624:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971179648 00000100:00100000:2.0:1788985902.214694:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 257 00000100:00100000:2.0:1788985902.214704:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971179648:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:2.0:1788985902.214732:0:8478:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54745f 00000100:00080000:2.0:1788985902.214740:0:8478:0:(import.c:65:import_set_state_nolock()) ffff9b0a76747000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788985902.214785:0:8478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00080000:0.0:1788985902.214983:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788985902.215709:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971179648:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 1003us (1250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985902.215719:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 257 00000020:00000080:2.0:1788985902.601989:0:65519:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe1105a080 20000000:00000080:2.0:1788985902.602006:0:65519:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a79741c00 uarg=0000000000000000 00010000:00010000:2.0:1788985902.608636:0:65519:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788985902.608676:0:65519:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788985902.608680:0:65519:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788985902.608691:0:65519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5475f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ddb expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.608727:0:65519:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1788985902.608746:0:65519:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788985902.608759:0:65519:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.608773:0:65519:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5475d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5475d2 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.608780:0:65519:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.608815:0:65519:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5475d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5475d2 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.608830:0:65519:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5475d9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5475d2 expref: 18 pid: 5849 timeout: 1786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985902.608843:0:65519:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65519:1875885993397632:0@lo:104: 00000100:00100000:2.0:1788985902.608913:0:65519:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985902.609627:0:65519:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76356d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788985902.609688:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993397632 00000100:00100000:1.0:1788985902.609696:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993397632 00000100:00100000:1.0:1788985902.609901:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788985902.609912:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:65519:x1875885993397632:12345-0@lo:104: 00010000:00010000:1.0:1788985902.609924:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0800/0xc20d828fcf5475d2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5475d9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985902.609997:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788985902.610003:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:65519:x1875885993397632:12345-0@lo:104: Request processed in 93us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985902.610009:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:2.0:1788985902.613932:0:65519:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:65519:1875885993397632:0@lo:104: 00010000:00010000:2.0:1788985902.613958:0:65519:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985902.614140:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993397760 00000100:00100000:2.0:1788985902.614149:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993397760 00010000:00010000:2.0:1788985902.614186:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5475d9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5475d2 expref: 19 pid: 5849 timeout: 1786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985902.614236:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788985902.614244:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993397760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985902.614257:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985902.614263:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5475d9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5475d2 expref: 19 pid: 5849 timeout: 1786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.614274:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5475d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5475d2 expref: 19 pid: 5849 timeout: 1786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.614289:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5475d9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5475d2 expref: 19 pid: 5849 timeout: 1786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.614302:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.614310:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.614324:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.614331:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.614338:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.614344:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.614360:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985902.614364:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.614372:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.614394:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985902.614403:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985902.614463:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993397760:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (4187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985902.614470:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00010000:0.0:1788985902.614661:0:65519:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985902.614669:0:65519:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985902.614676:0:65519:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5475fc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65519 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985903.041920:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985904.128511:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788985904.128533:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993397888:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985904.128596:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985904.128774:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993397888 00000100:00100000:2.0:1788985904.128782:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993397888 00000100:00100000:2.0:1788985904.128850:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1788985904.128860:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993397888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985904.128901:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985904.128952:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993397888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985904.128959:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 586 00000100:00100000:2.0:1788985904.129003:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993397888:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788985904.129110:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1788985904.194517:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788985904.194524:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788985904.194528:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788985904.194573:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985904.194591:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985904.194603:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985904.194626:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993398016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788985904.194694:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985904.194751:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7977d000 going to sleep for 11 seconds 00000100:00100000:0.0:1788985904.194956:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993398016 00000100:00100000:0.0:1788985904.194965:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993398016 00000100:00100000:0.0:1788985904.195020:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1788985904.195048:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993398016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985904.195065:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985904.195079:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54760a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547603 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985904.195128:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54760a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547603 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985904.195139:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54760a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547603 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985904.195148:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788985904.195191:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993398016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985904.195198:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1788985904.195246:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993398016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985904.195261:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54760a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985904.195271:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54760a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985904.195289:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788985904.195295:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54760a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985904.195302:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54760a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985905.090080:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985905.166064:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993398144:0@lo:400:kworker.0 00000100:00100000:0.0:1788985905.166119:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985905.166156:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993398656:0@lo:400:kworker.0 00000100:00100000:0.0:1788985905.166178:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985905.166196:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788985905.166202:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993398528:0@lo:400:kworker.0 00000100:00100000:0.0:1788985905.166222:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985905.166247:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993398656 00000100:00100000:0.0:1788985905.166251:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993398656 00000100:00100000:0.0:1788985905.166279:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1788985905.166286:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993398656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985905.166317:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993398656:12345-0@lo:400:kworker.0 Request processed in 32us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985905.166322:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00080000:0.0:1788985905.166340:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788985905.166343:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985905.166354:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993398528 00000100:00100000:0.0:1788985905.166357:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993398528 00000100:00100000:0.0:1788985905.166378:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:0.0:1788985905.166384:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993398528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985905.166412:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993398528:12345-0@lo:400:kworker.0 Request processed in 28us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985905.166417:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:0.0:1788985905.166445:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993398528:0@lo:400:kworker.0 00000100:00100000:0.0:1788985905.166465:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993398656:0@lo:400:kworker.0 00000100:00100000:0.0:1788985905.172199:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993398144:0@lo:400:kworker.0 00000100:00100000:1.0:1788985905.671314:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788985905.671342:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993398912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985905.671410:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985905.671474:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993398912 00000100:00100000:1.0:1788985905.671481:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993398912 00000100:00100000:1.0:1788985905.671536:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1788985905.671545:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993398912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985905.671579:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788985905.671625:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993398912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985905.671632:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1788985905.671679:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993398912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788985905.902219:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985905.902854:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971179776 00000100:00100000:1.0:1788985905.902865:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971179776 00000100:00100000:1.0:1788985905.902950:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 489 00000100:00100000:1.0:1788985905.902960:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38489:x1875885971179776:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788985905.902979:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1788985905.902981:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788985905.903002:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547611 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0de2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985905.903067:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547618 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985905.903080:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985905.903110:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788985905.903157:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00000004:00200000:1.0:1788985905.903161:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788985905.903179:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985905.903204:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf547611 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0de2 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985905.903228:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0de2 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985905.903237:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:1.0:1788985905.903240:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788985905.903243:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788985905.903305:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38489:x1875885971179776:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 346us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985905.903312:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 489 00000100:00100000:0.0:1788985905.915036:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971180032 00000100:00100000:0.0:1788985905.915046:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971180032 00000100:00100000:0.0:1788985905.915114:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 490 00000100:00100000:0.0:1788985905.915125:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38489:x1875885971180032:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788985905.920484:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788985905.920518:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547618 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0de2 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985905.920537:0:5854:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf5475f5) 00010000:00010000:1.0:1788985905.920541:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:1.0:1788985905.920552:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788985905.920577:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54761f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985905.920589:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54761f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985905.920613:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54761f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788985905.920918:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009a501d74 reply state 0000000059b9c086 transno 4294967485 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54761f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x24:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985905.920928:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788985905.920935:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00000100:00100000:1.0:1788985905.921022:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:38489:x1875885971180032:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 5898us (6453us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788985905.921030:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 490 00000001:00100000:1.0:1788985906.237394:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788985906.237401:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b0a76744800/d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:0.0:1788985906.726994:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993399040 00000100:00100000:0.0:1788985906.727001:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993399040 00000100:00100000:0.0:1788985906.727117:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788985906.727128:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:65717:x1875885993399040:12345-0@lo:104: 00010000:00010000:0.0:1788985906.727140:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54760a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985906.727192:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985906.727198:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:65717:x1875885993399040:12345-0@lo:104: Request processed in 73us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985906.727205:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00010000:00010000:2.0:1788985906.727368:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985906.727375:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54760a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727382:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788985906.727386:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54760a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727394:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54760a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985906.727401:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54760a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985906.727406:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985906.727434:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54760a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727450:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985906.727470:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54760a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727477:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547603 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54760a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727490:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985906.727492:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985906.727493:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985906.727504:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993399168:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985906.727536:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985906.727573:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993399168 00000100:00100000:2.0:1788985906.727576:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993399168 00010000:00010000:2.0:1788985906.727595:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54760a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547603 expref: 19 pid: 5849 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985906.727619:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788985906.727625:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993399168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985906.727633:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985906.727638:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54760a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547603 expref: 19 pid: 5849 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727646:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54760a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547603 expref: 19 pid: 5849 timeout: 1790 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727673:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547626 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 65717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727691:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547626 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 65717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727705:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547626 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 65717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727712:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547626 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727718:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547626 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 65717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727725:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547626 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727730:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985906.727734:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547626 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 65717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727741:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547626 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 65717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727748:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547626 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 65717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985906.727757:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985906.727787:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993399168:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985906.727793:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:2.0:1788985906.727852:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993399168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985907.312353:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971180288 00000100:00100000:0.0:1788985907.312361:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971180288 00000100:00100000:0.0:1788985907.312415:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1161 00000100:00100000:0.0:1788985907.312426:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971180288:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985907.312614:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971180160 00000100:00100000:2.0:1788985907.312619:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971180160 00000100:00100000:2.0:1788985907.312647:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 989 00000100:00100000:2.0:1788985907.312653:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971180160:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:1.0:1788985907.314327:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788985907.314335:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985907.314848:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971180288:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 2417us (2581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985907.314859:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1161 00000100:00100000:2.0:1788985907.318625:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971180160:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5960us (6304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985907.318640:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 989 10000000:01000000:1.0:1788985908.162178:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788985908.162185:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788985908.162190:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788985908.162234:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54762d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985908.162246:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54762d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985908.162259:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54762d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985908.162285:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993399296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788985908.162348:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985908.162411:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788985908.162480:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993399296 00000100:00100000:0.0:1788985908.162492:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993399296 00000100:00100000:0.0:1788985908.162555:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1788985908.162564:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993399296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985908.162578:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985908.162589:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547634 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54762d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985908.162611:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547634 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54762d expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985908.162621:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547634 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54762d expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985908.162630:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efe00, rc 0) 00000100:00100000:0.0:1788985908.162666:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993399296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985908.162673:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1788985908.163055:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993399296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985908.163070:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54762d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547634 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985908.163079:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54762d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547634 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985908.163122:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788985908.163127:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54762d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547634 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985908.163135:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54762d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547634 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985908.163571:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985909.248314:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993399424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985909.248387:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985909.248593:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993399424 00000100:00100000:2.0:1788985909.248600:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993399424 00000100:00100000:2.0:1788985909.248661:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1788985909.248670:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993399424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985909.248702:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985909.248751:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993399424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985909.248758:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:2.0:1788985909.248803:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993399424:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788985909.248989:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985909.735251:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985909.737470:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971180544 00000100:00100000:1.0:1788985909.737484:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971180544 00000100:00100000:1.0:1788985909.737619:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 491 00000100:00100000:1.0:1788985909.737631:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38573:x1875885971180544:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788985909.737734:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38573:x1875885971180544:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 105us (2491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985909.737741:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 491 00000100:00080000:0.0:1788985909.740132:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985909.754581:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985909.759040:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971180672 00000100:00100000:2.0:1788985909.759055:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971180672 00000100:00080000:0.0:1788985909.766842:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985909.767713:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985909.775867:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:0.0:1788985909.778433:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985909.780527:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985909.780611:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971181056 00000100:00100000:0.0:1788985909.780621:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971181056 00000100:00100000:0.0:1788985909.780790:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 492 00000100:00100000:0.0:1788985909.780801:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38573:x1875885971181056:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788985909.781329:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38573:x1875885971181056:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 520us (800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985909.781338:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 492 00000100:00100000:2.0:1788985909.790591:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985909.790682:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971181184 00000100:00100000:0.0:1788985909.790692:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971181184 00000100:00100000:0.0:1788985909.790750:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 493 00000100:00100000:0.0:1788985909.790760:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38573:x1875885971181184:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788985909.790864:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38573:x1875885971181184:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 105us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985909.790871:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 493 00000100:00100000:2.0:1788985909.800405:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985909.800498:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971181312 00000100:00100000:0.0:1788985909.800507:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971181312 00000100:00100000:0.0:1788985909.800561:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 261 00000100:00100000:0.0:1788985909.800571:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38573:x1875885971181312:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788985909.800931:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38573:x1875885971181312:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 359us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985909.800938:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 261 00000100:00100000:1.0:1788985909.803645:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985909.807435:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985909.807531:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971181568 00000100:00100000:1.0:1788985909.807539:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971181568 00000100:00100000:1.0:1788985909.807590:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 494 00000100:00100000:1.0:1788985909.807612:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38573:x1875885971181568:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788985909.808027:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38573:x1875885971181568:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 415us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985909.808035:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 494 00000100:00100000:2.0:1788985909.877651:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985909.877742:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971181696 00000100:00100000:0.0:1788985909.877751:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971181696 00000100:00100000:0.0:1788985909.877812:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 495 00000100:00100000:0.0:1788985909.877822:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38577:x1875885971181696:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:0.0:1788985909.877842:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985909.877874:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547642 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0de9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.877954:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547649 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.877968:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.877981:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.877993:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547650 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878000:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878007:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878428:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878438:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878445:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985909.878468:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00000004:00200000:0.0:1788985909.878550:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788985909.878577:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878605:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547649 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878612:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547649 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878619:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547649 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878625:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985909.878629:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547649 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878636:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547649 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878647:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823be00) 00010000:00010000:0.0:1788985909.878650:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985909.878654:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547649 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878660:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547649 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878672:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547650 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878679:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547650 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878685:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878697:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985909.878701:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547650 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878707:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547650 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878715:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9b0a4823b500) 00010000:00010000:0.0:1788985909.878717:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985909.878720:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547650 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878726:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547650 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878756:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547642 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0de9 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878772:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0de9 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985909.878779:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a4823b800) 00010000:00010000:0.0:1788985909.878782:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788985909.878784:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee400, rc 0) 00000100:00100000:0.0:1788985909.878836:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38577:x1875885971181696:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 1015us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985909.878844:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 495 00000100:00100000:0.0:1788985909.883308:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985909.898818:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985909.920214:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985909.920363:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971182208 00000100:00100000:2.0:1788985909.920372:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971182208 00002000:00100000:2.0:1788985909.920420:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x10:0x0] (0->1048575) req@ffff9b0a7fb30700 x1875885971182208/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:585/0 lens 488/0 e 0 to 0 dl 1788985920 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1788985909.920450:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a7fb30700 with x1875885971182208 ext(0->1048575) 00002000:00010000:2.0:1788985909.920457:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a7fb30700 00000100:00100000:2.0:1788985909.920731:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:2.0:1788985909.920743:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971182208:12345-192.168.206.21@tcp:4:dd.60003 00000001:00100000:1.0:1788985910.060325:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:1.0:1788985910.068800:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985910.119420:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:38577:x1875885971182336:12345-192.168.206.21@tcp:44:dd.60003 Request processed in 50350us (50695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985910.119436:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 497 00000001:00080000:2.0:1788985910.121241:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967486 is committed 00000100:00100000:1.0:1788985910.122716:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985910.181963:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971182464:12345-192.168.206.21@tcp:16:dd.60003 Request processed in 58799us (59242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985910.181981:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 264 00000001:00080000:1.0:1788985910.182235:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967327 is committed 00000100:00100000:0.0:1788985910.185544:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985910.187082:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971182720 00000100:00100000:1.0:1788985910.187117:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971182720 00000100:00100000:1.0:1788985910.187247:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 51 00000100:00100000:1.0:1788985910.187260:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:38577:x1875885971182720:12345-192.168.206.21@tcp:35:dd.60003 00000100:00100000:1.0:1788985910.188228:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:38577:x1875885971182720:12345-192.168.206.21@tcp:35:dd.60003 Request processed in 966us (2693us total) trans 4294967487 rc 0/0 00000100:00100000:1.0:1788985910.188239:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 51 00010000:00010000:0.0:1788985910.208569:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985910.275042:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993399680:0@lo:400:kworker.0 00000100:00100000:0.0:1788985910.275084:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985910.275164:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993400192:0@lo:400:kworker.0 00000100:00100000:0.0:1788985910.275189:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985910.275211:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788985910.275217:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993399552:0@lo:400:kworker.0 00000100:00100000:0.0:1788985910.275245:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985910.275267:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993400064:0@lo:400:kworker.0 00000100:00100000:0.0:1788985910.275288:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985910.275319:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993399680 00000100:00100000:0.0:1788985910.275323:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993399680 00000100:00100000:0.0:1788985910.275355:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993400064 00000100:00100000:0.0:1788985910.275359:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993400064 00000100:00100000:0.0:1788985910.275385:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:0.0:1788985910.275393:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993399680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985910.275706:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993399552 00000100:00100000:2.0:1788985910.275711:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993399552 00000100:00100000:2.0:1788985910.275751:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1788985910.275758:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993399552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985910.275801:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993399552:12345-0@lo:400:kworker.0 Request processed in 44us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985910.275808:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1788985910.275841:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993400192 00000100:00100000:2.0:1788985910.275867:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993400192 00000100:00100000:2.0:1788985910.275903:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:2.0:1788985910.275910:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993400192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985910.275945:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993400192:12345-0@lo:400:kworker.0 Request processed in 35us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985910.275951:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00100000:0.0:1788985910.276135:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993399680:12345-0@lo:400:kworker.0 Request processed in 742us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985910.276142:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:1.0:1788985910.784365:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993400320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985910.784463:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985910.784739:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993400320 00000100:00100000:2.0:1788985910.784749:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993400320 00000100:00100000:2.0:1788985910.784815:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:2.0:1788985910.784827:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993400320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788985910.784863:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788985910.784937:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993400320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985910.784963:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00000100:00100000:0.0:1788985910.785211:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993400320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788985912.256334:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985912.438522:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971182848 00000100:00100000:0.0:1788985912.438542:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971182848 00000100:00100000:0.0:1788985912.438578:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 992 00000100:00100000:0.0:1788985912.438590:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971182848:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985912.438674:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971182848:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 86us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985912.438682:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 992 00000100:00100000:0.0:1788985912.440819:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 798 00000100:00100000:0.0:1788985912.440830:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971183232:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985912.441023:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971183232:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 194us (2902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985912.441030:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 798 00000004:00080000:2.0:1788985912.911893:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 40 committed 00000004:00080000:2.0:1788985912.911922:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 40 committed 00010000:00010000:0.0:1788985914.305545:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985914.373000:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993400448 00000100:00100000:2.0:1788985914.373009:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993400448 00000100:00100000:2.0:1788985914.373120:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1788985914.373131:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993400448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985914.373177:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985914.373247:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993400448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985914.373254:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00000100:00100000:2.0:1788985914.373323:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993400448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788985914.673732:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:0.0:1788985914.674674:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985914.685164:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985914.685209:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971183488 00000100:00100000:2.0:1788985914.685221:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971183488 00000100:00100000:2.0:1788985914.685294:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 265 00000100:00100000:2.0:1788985914.685307:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38770:x1875885971183488:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788985914.685819:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38770:x1875885971183488:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 513us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985914.685838:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 265 00000100:00080000:2.0:1788985914.685866:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985914.700859:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:2.0:1788985914.701902:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985914.705436:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985914.705549:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971183744 00000100:00100000:2.0:1788985914.705560:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971183744 00000100:00100000:2.0:1788985914.705631:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 499 00000100:00100000:2.0:1788985914.705653:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:38770:x1875885971183744:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788985914.706179:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:38770:x1875885971183744:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 526us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985914.706188:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 499 00000100:00100000:0.0:1788985914.712742:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971183872 00000100:00100000:0.0:1788985914.712755:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971183872 00000100:00100000:0.0:1788985914.712835:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 500 00000100:00100000:0.0:1788985914.712847:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:38770:x1875885971183872:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788985914.712975:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:38770:x1875885971183872:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 130us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985914.712983:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 500 00000100:00100000:2.0:1788985914.715535:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985914.726528:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971184000 00000100:00100000:0.0:1788985914.726550:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971184000 00000100:00100000:0.0:1788985914.726654:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 267 00000100:00100000:0.0:1788985914.726668:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38770:x1875885971184000:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788985914.731140:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38770:x1875885971184000:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 4460us (15601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985914.731160:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 267 00000100:00100000:2.0:1788985914.735210:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985914.735306:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971184128 00000100:00100000:0.0:1788985914.735319:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971184128 00000100:00100000:0.0:1788985914.735394:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 268 00000100:00100000:0.0:1788985914.735406:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38770:x1875885971184128:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788985914.735932:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38770:x1875885971184128:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 526us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985914.735942:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 268 00000100:00100000:0.0:1788985914.740727:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985914.804245:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:2.0:1788985914.811680:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985914.811693:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54769d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985914.811703:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985914.811708:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54769d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985914.811719:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54769d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985914.811734:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x29:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:2.0:1788985914.811737:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788985914.811742:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54769d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985914.811748:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54769d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x29:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985914.811802:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985914.811804:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985914.811806:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985915.332796:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985915.402059:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993400576:0@lo:400:kworker.0 00000100:00100000:0.0:1788985915.402188:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985915.402550:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993400576 00000100:00100000:2.0:1788985915.402561:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993400576 00000100:00100000:2.0:1788985915.402620:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1788985915.402630:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993400576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985915.407813:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993400576:12345-0@lo:400:kworker.0 Request processed in 5169us (5610us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985915.407841:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:1.0:1788985915.409694:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993400704:0@lo:400:kworker.0 00000100:00100000:1.0:1788985915.409741:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985915.409791:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993401216:0@lo:400:kworker.0 00000100:00100000:1.0:1788985915.409830:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985915.409852:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788985915.409858:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993401088:0@lo:400:kworker.0 00000100:00100000:1.0:1788985915.409880:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985915.409910:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993401216 00000100:00100000:1.0:1788985915.409913:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993401216 00000100:00100000:1.0:1788985915.409952:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1788985915.409959:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993401216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985915.409997:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993401216:12345-0@lo:400:kworker.0 Request processed in 39us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985915.410003:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:1.0:1788985915.410035:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993401216:0@lo:400:kworker.0 00000100:00100000:0.0:1788985915.411803:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993400576:0@lo:400:kworker.0 00000004:00080000:2.0:1788985915.905606:0:7935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1699808512574ns, next at 1700808508544ns, rc = 0 00000100:00100000:0.0:1788985915.905700:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993401344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985915.905794:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985915.905939:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993401344 00000100:00100000:2.0:1788985915.905950:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993401344 00000100:00100000:2.0:1788985915.906019:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1788985915.906030:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993401344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788985915.906081:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788985915.906184:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993401344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 155us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985915.906193:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:2.0:1788985915.906260:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993401344:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788985916.360914:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788985917.090417:0:66106:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1700993322947ns, next at 1676301758010ns, rc = 0 00000004:00080000:1.0:1788985917.090681:0:66106:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1700993591310ns, next at 1700808508544ns, rc = 0 00000004:00080000:0.0:1788985917.155836:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 43 committed 00000004:00080000:0.0:1788985917.155865:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 41 committed 00000004:00080000:0.0:1788985917.155880:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 42 committed 00000001:00080000:0.0:1788985917.155892:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967488 is committed 00000004:00080000:0.0:1788985917.155897:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 41 committed 00000100:00100000:0.0:1788985917.156191:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993401472:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788985917.156295:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985917.156394:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993401472 00000100:00100000:0.0:1788985917.156403:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993401472 00000100:00100000:0.0:1788985917.156473:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788985917.156486:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993401472:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788985917.156523:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:16 count 1 00010000:00010000:0.0:1788985917.156707:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985917.156734:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c56e880a/0xc20d828fcf547681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0df7 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985917.156744:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x10:0x0].0x0 since=8s v=(0 0) 00010000:00010000:0.0:1788985917.156750:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788985917.156756:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985917.156797:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c56e880a/0xc20d828fcf547681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0df7 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985917.156822:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c56e880a/0xc20d828fcf547681 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0df7 expref: 5 pid: 6695 timeout: 1801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985917.156836:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875885993401600:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788985917.156921:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51df2a80 going to sleep for 11 seconds 00000100:00080000:0.0:1788985917.156936:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788985917.162928:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971184640 00000100:00100000:2.0:1788985917.162943:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971184640 00010000:00010000:2.0:1788985917.163024:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c56e880a/0xc20d828fcf547681 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0df7 expref: 6 pid: 6695 timeout: 1801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985917.163077:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 313 00000100:00100000:2.0:1788985917.163146:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971184640:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788985917.163166:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985917.163173:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c56e880a/0xc20d828fcf547681 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0df7 expref: 6 pid: 6695 timeout: 1801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985917.163190:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c56e880a/0xc20d828fcf547681 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0df7 expref: 6 pid: 6695 timeout: 1801 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985917.163228:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788985917.163234:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788985917.163241:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985917.163254:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985917.163281:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985917.163360:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971184640:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 217us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985917.163368:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 313 00010000:00010000:1.0:1788985917.164061:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c56e880a/0xc20d828fcf547681 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0df7 expref: 5 pid: 6695 timeout: 1801 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985917.164129:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875885993401600:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788985917.164157:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985917.164170:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985917.164197:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985917.164211:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985917.164220:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985917.164240:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788985917.165025:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993401472:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8539us (8727us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1788985917.165036:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00010000:00010000:2.0:1788985917.166907:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985917.166922:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985917.166937:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985917.166943:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985917.166971:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985917.166995:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985917.167004:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf5476a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985917.167027:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985917.167029:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985917.167031:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985917.391269:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985917.552037:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985917.552193:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985917.552288:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985917.552341:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971184896 00000100:00100000:2.0:1788985917.552359:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971184896 00000100:00100000:2.0:1788985917.552478:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1169 00000100:00100000:2.0:1788985917.552502:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971184896:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985917.552616:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971184896:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 129us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985917.552624:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1169 00000100:00100000:1.0:1788985917.553947:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971185024 00000100:00100000:1.0:1788985917.553953:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971185024 00000100:00100000:1.0:1788985917.554011:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 801 00000100:00100000:1.0:1788985917.554021:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971185024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985917.554058:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971185024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 39us (1865us total) trans 0 rc 0/0 00000100:00080000:2.0:1788985917.554076:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788985917.554084:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985917.554251:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 801 00010000:00010000:2.0:1788985918.400267:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985919.424380:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985919.496952:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993401728 00000100:00100000:2.0:1788985919.496996:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993401728 00000100:00100000:2.0:1788985919.497135:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00000100:00100000:2.0:1788985919.497148:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993401728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985919.497199:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985919.497327:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993401728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 182us (8573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985919.497335:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00000100:00100000:1.0:1788985919.497670:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993401728:0@lo:13:osp-pre-0-0.0 00000001:00080000:0.0:1788985920.109403:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967328 is committed 00010000:00010000:1.0:1788985920.448751:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985920.514602:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993401984:0@lo:400:kworker.0 00000100:00100000:0.0:1788985920.514720:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993402240:0@lo:400:kworker.0 00000100:00100000:2.0:1788985920.521234:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985920.521982:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993402496:0@lo:400:kworker.0 00000100:00100000:0.0:1788985920.522053:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985920.522111:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788985920.522120:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993402368:0@lo:400:kworker.0 00000100:00100000:0.0:1788985920.522157:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985920.522244:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985920.522276:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788985920.522285:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993402112:0@lo:400:kworker.0 00000100:00100000:2.0:1788985920.522332:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993401856 00000100:00100000:2.0:1788985920.522342:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993401856 00000100:00100000:2.0:1788985920.522404:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1788985920.522415:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993401856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985920.522485:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993401856:12345-0@lo:400:kworker.0 Request processed in 70us (7727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985920.522493:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1788985920.522541:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993402240 00000100:00100000:2.0:1788985920.522547:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993402240 00000100:00100000:2.0:1788985920.522577:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993402496 00000100:00100000:2.0:1788985920.522581:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993402496 00000100:00100000:2.0:1788985920.522611:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1788985920.522618:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993402240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985920.522655:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993402240:12345-0@lo:400:kworker.0 Request processed in 38us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985920.522679:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:2.0:1788985920.522694:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:2.0:1788985920.522702:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993402496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985920.522744:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993402496:12345-0@lo:400:kworker.0 Request processed in 43us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985920.522749:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1788985920.527030:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993401984 00000100:00100000:1.0:1788985920.527049:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993401984 00000100:00100000:0.0:1788985920.528484:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985920.537368:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993402112:0@lo:400:kworker.0 00000100:00100000:1.0:1788985920.537387:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993401984:0@lo:400:kworker.0 00000100:00100000:1.0:1788985920.537401:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967328 gen 2 00000004:00080000:1.0:1788985920.537406:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7fb30a80, transno 4294967328 00000100:00100000:1.0:1788985920.537421:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993402496:0@lo:400:kworker.0 00000100:00100000:1.0:1788985921.024820:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788985921.024843:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993402624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985921.024909:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985921.025357:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993402624:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788985921.472306:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985922.496322:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985922.679529:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985922.679583:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985922.679622:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985922.679661:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985922.679698:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971185408 00000100:00100000:2.0:1788985922.679709:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971185408 00000100:00100000:2.0:1788985922.679774:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971185536 00000100:00100000:2.0:1788985922.679787:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971185536 00000100:00100000:2.0:1788985922.679817:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 804 00000100:00100000:2.0:1788985922.679829:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971185408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985922.679927:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971185408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 100us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985922.679935:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 804 00000100:00100000:2.0:1788985922.679953:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 805 00000100:00100000:2.0:1788985922.679959:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971185536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985922.679985:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971185536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985922.679992:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 805 00000100:00100000:0.0:1788985922.680483:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971185280 00000100:00100000:0.0:1788985922.680490:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971185280 00000100:00100000:0.0:1788985922.680544:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1173 00000100:00100000:0.0:1788985922.680553:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971185280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985922.680595:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971185280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985922.680601:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1173 00000100:00080000:2.0:1788985922.686079:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788985922.686135:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788985922.686139:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788985923.523709:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985924.544341:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985924.609722:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788985924.609753:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993402752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985924.609850:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985924.611147:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993402752 00000100:00100000:2.0:1788985924.611162:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993402752 00000100:00100000:2.0:1788985924.611255:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00000100:00100000:2.0:1788985924.611268:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993402752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985924.611312:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985924.611409:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993402752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985924.611416:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00010000:00010000:1.0:1788985925.569043:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985925.632816:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993403008:0@lo:400:kworker.0 00000100:00100000:2.0:1788985925.632911:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985925.633001:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993403520:0@lo:400:kworker.0 00000100:00100000:2.0:1788985925.633033:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985925.633065:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788985925.633072:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993403136:0@lo:400:kworker.0 00000100:00100000:2.0:1788985925.633120:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985925.633163:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993403520 00000100:00100000:2.0:1788985925.633173:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993403520 00000100:00100000:2.0:1788985925.633246:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1788985925.633257:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993403520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985925.633320:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993403520:12345-0@lo:400:kworker.0 Request processed in 65us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985925.633338:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1788985925.633395:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993403520:0@lo:400:kworker.0 00000100:00100000:0.0:1788985925.633661:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993402880:0@lo:400:kworker.0 00000100:00100000:0.0:1788985925.633711:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985925.633748:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993403392:0@lo:400:kworker.0 00000100:00100000:0.0:1788985925.633788:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985925.633813:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788985925.633823:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993403264:0@lo:400:kworker.0 00000100:00100000:0.0:1788985925.633856:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985925.633951:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993403392:0@lo:400:kworker.0 00000100:00100000:2.0:1788985925.634012:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993402880 00000100:00100000:2.0:1788985925.634016:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993402880 00000100:00100000:2.0:1788985925.634065:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1788985925.634072:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993402880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985925.634136:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993402880:12345-0@lo:400:kworker.0 Request processed in 65us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985925.634142:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1788985925.634241:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993403264 00000100:00100000:1.0:1788985925.634246:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993403264 00000100:00100000:1.0:1788985925.634282:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:1.0:1788985925.634290:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993403264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985925.634328:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993403264:12345-0@lo:400:kworker.0 Request processed in 39us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985925.634335:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:2.0:1788985926.144774:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788985926.144807:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993403648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788985926.144912:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985926.145817:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993403648:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788985926.593942:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985927.618230:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985927.792666:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985927.792710:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985927.792740:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985927.792782:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985927.792823:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971186048 00000100:00100000:2.0:1788985927.792832:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971186048 00000100:00100000:0.0:1788985927.792946:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971185792 00000100:00100000:0.0:1788985927.792951:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971185792 00000100:00100000:2.0:1788985927.792988:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971185920 00000100:00100000:2.0:1788985927.792991:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971185920 00000100:00100000:0.0:1788985927.792991:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1177 00000100:00100000:0.0:1788985927.793000:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971185792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985927.793010:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 808 00000100:00100000:2.0:1788985927.793017:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971186048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985927.793067:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971186048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 50us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985927.793075:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 808 00000100:00100000:2.0:1788985927.793124:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 809 00000100:00100000:2.0:1788985927.793131:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971185920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985927.793191:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971185792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 191us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985927.793198:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1177 00000100:00100000:2.0:1788985927.793359:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971185920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 228us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985927.793374:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 809 00000100:00100000:1.0:1788985927.793440:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971185664 00000100:00100000:1.0:1788985927.793445:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971185664 00000100:00100000:1.0:1788985927.793481:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 998 00000100:00100000:1.0:1788985927.793487:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971185664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985927.793514:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971185664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985927.793520:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 998 00010000:00010000:1.0:1788985928.640297:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985929.664353:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985929.728624:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788985929.728646:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993403776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985929.728711:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985929.728947:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993403776 00000100:00100000:2.0:1788985929.728956:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993403776 00000100:00100000:2.0:1788985929.729027:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1788985929.729036:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993403776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985929.729067:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985929.729141:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993403776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985929.729147:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 596 00000100:00100000:2.0:1788985929.729192:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993403776:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788985930.691368:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985930.753032:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993404032:0@lo:400:kworker.0 00000100:00100000:0.0:1788985930.753181:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985930.753263:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788985930.753270:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993404160:0@lo:400:kworker.0 00000100:00100000:0.0:1788985930.753295:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985930.753334:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993404032 00000100:00100000:0.0:1788985930.753344:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993404032 00000100:00100000:0.0:1788985930.753409:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993404160 00000100:00100000:0.0:1788985930.753413:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993404160 00000100:00100000:0.0:1788985930.753463:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1788985930.753474:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993404032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985930.753533:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993404032:12345-0@lo:400:kworker.0 Request processed in 60us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985930.753540:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:0.0:1788985930.753558:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1788985930.753565:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993404160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985930.753594:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993404160:12345-0@lo:400:kworker.0 Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985930.753599:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00080000:0.0:1788985930.753617:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985930.753655:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993404160:0@lo:400:kworker.0 00000100:00100000:0.0:1788985930.753667:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993404032:0@lo:400:kworker.0 00000100:00100000:2.0:1788985930.755878:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788985930.755912:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993404288:0@lo:400:kworker.0 00000100:00100000:2.0:1788985930.756001:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985930.756145:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993404288 00000100:00100000:2.0:1788985930.756154:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993404288 00000100:00100000:2.0:1788985930.756207:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1788985930.756216:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993404288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985930.756276:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993404288:12345-0@lo:400:kworker.0 Request processed in 61us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985930.756283:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 00000100:00100000:2.0:1788985930.756334:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993404288:0@lo:400:kworker.0 00000100:00100000:0.0:1788985930.756979:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993403904 00000100:00100000:0.0:1788985930.757001:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993403904 00000100:00100000:0.0:1788985930.757054:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:0.0:1788985930.757063:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993403904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985930.757132:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993403904:12345-0@lo:400:kworker.0 Request processed in 71us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985930.757139:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1788985930.757280:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993403904:0@lo:400:kworker.0 00000100:00100000:2.0:1788985930.758563:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993404416:0@lo:400:kworker.0 00000100:00100000:2.0:1788985930.758631:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985930.760024:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993404416 00000100:00100000:0.0:1788985930.760050:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993404416 00000100:00100000:0.0:1788985930.760169:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1180 00000100:00100000:0.0:1788985930.760181:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993404416:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788985930.760300:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985930.760330:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788985930.760350:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993404544:0@lo:400:kworker.0 00000100:00100000:1.0:1788985930.760407:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788985930.763385:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985930.764114:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993404416:12345-0@lo:400:kworker.0 Request processed in 3910us (5457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985930.764131:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1180 00000100:00100000:2.0:1788985930.764853:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993404416:0@lo:400:kworker.0 00000100:00100000:2.0:1788985931.207903:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985931.208237:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971186176 00000100:00100000:0.0:1788985931.208251:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971186176 00000100:00100000:0.0:1788985931.208356:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 503 00000100:00100000:0.0:1788985931.208368:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38951:x1875885971186176:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788985931.208498:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38951:x1875885971186176:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 131us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985931.208506:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 503 00000100:00080000:1.0:1788985931.209919:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985931.213044:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985931.213152:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971186304 00000100:00100000:2.0:1788985931.213165:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971186304 00000100:00100000:2.0:1788985931.213274:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 270 00000100:00100000:2.0:1788985931.213287:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38951:x1875885971186304:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00080000:1.0:1788985931.213966:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788985931.214261:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38951:x1875885971186304:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 972us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985931.214272:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 270 00000100:00100000:2.0:1788985931.230382:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:1.0:1788985931.232754:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985931.250476:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971186560 00000100:00100000:0.0:1788985931.250491:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971186560 00000100:00100000:0.0:1788985931.250567:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 504 00000100:00100000:0.0:1788985931.250580:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38951:x1875885971186560:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788985931.251156:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38951:x1875885971186560:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 576us (1469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985931.251175:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 504 00000100:00100000:0.0:1788985931.257176:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985931.265015:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993404672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985931.265154:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985931.273630:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993404672:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788985931.280555:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971186944 00000100:00100000:2.0:1788985931.280569:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971186944 00000100:00100000:2.0:1788985931.280648:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 273 00000100:00100000:2.0:1788985931.280662:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38951:x1875885971186944:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788985931.281083:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:38951:x1875885971186944:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 423us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985931.284632:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 273 00000100:00100000:2.0:1788985931.285475:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971187072 00000100:00100000:2.0:1788985931.285488:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971187072 00000100:00100000:2.0:1788985931.285547:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 506 00000100:00100000:2.0:1788985931.285558:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38951:x1875885971187072:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788985931.286074:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38951:x1875885971187072:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 515us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985931.286082:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 506 00000100:00100000:2.0:1788985931.352224:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985931.352288:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971187200 00000100:00100000:2.0:1788985931.352302:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971187200 00000100:00100000:2.0:1788985931.353525:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 507 00000100:00100000:2.0:1788985931.353540:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:38952:x1875885971187200:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788985931.353565:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985931.353594:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5476ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0dfe expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.354749:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5476b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.354776:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5476b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.354795:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5476b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788985931.354844:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00000004:00200000:2.0:1788985931.354848:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788985931.354872:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5476b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.354906:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5476ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dfe expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.354932:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5476b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dfe expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.354942:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a4823b800) 00010000:00010000:2.0:1788985931.354945:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788985931.354961:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788985931.356219:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:38952:x1875885971187200:12345-192.168.206.21@tcp:101:rm.0 Request processed in 2670us (3997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985931.356235:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 507 00000100:00100000:2.0:1788985931.365346:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985931.365392:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971187456 00000100:00100000:0.0:1788985931.365406:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971187456 00000100:00100000:0.0:1788985931.365566:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 508 00000100:00100000:0.0:1788985931.365866:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:38952:x1875885971187456:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788985931.365897:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985931.365931:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5476b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e05 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985931.366058:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x24:0x0]: returning size 16384 00010000:00010000:0.0:1788985931.366464:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5476b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e05 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985931.366483:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788985931.366487:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788985931.366494:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5476b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e05 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985931.366520:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788985931.366858:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:38952:x1875885971187456:12345-192.168.206.21@tcp:101:rm.0 Request processed in 1271us (1535us total) trans 4294967489 rc 301/301 00000100:00100000:0.0:1788985931.367023:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 508 00000100:00100000:1.0:1788985931.445123:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985931.445169:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971187840 00000100:00100000:1.0:1788985931.445178:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971187840 00000100:00100000:1.0:1788985931.445228:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:1.0:1788985931.445237:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:38952:x1875885971187840:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:1.0:1788985931.445521:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:38952:x1875885971187840:12345-192.168.206.21@tcp:35:rm.0 Request processed in 283us (442us total) trans 4294967490 rc 0/0 00000100:00100000:1.0:1788985931.445528:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 53 00000100:00100000:2.0:1788985931.456394:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971188096 00000100:00100000:2.0:1788985931.456408:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971188096 00000100:00100000:2.0:1788985931.456501:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 509 00000100:00100000:2.0:1788985931.456519:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:38952:x1875885971188096:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:2.0:1788985931.456601:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788985931.456769:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5476b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0dfe expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.456793:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547657 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x24:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0de9 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.456804:0:7899:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf5472b4) 00010000:00010000:2.0:1788985931.456810:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a4823b800) 00010000:00010000:2.0:1788985931.456823:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788985931.456855:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5476c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.456871:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5476c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.457437:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5476c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.457459:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5476ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.457485:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5476ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.457494:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5476ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458454:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5476d5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458471:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5476d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458483:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5476d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458539:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5476d5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458547:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5476d5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458554:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5476d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458561:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985931.458567:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5476d5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458576:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5476d5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458591:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x24:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788985931.458604:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788985931.458792:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5476d5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458803:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5476d5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x24:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458846:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5476c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458854:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5476c7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458862:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5476c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458869:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985931.458948:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5476c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458958:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5476c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.458978:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788985931.458981:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985931.458986:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5476c7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.462815:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5476c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.462861:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5476ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.463065:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5476ce lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.463073:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5476ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.463080:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985931.463290:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5476ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.463302:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5476ce lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.463375:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xf54a44cb (ffff9b0a45aca400) 00010000:00010000:2.0:1788985931.463380:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985931.463386:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5476ce lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985931.463393:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5476ce lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xf54a44cb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985931.463534:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:38952:x1875885971188096:12345-192.168.206.21@tcp:36:rm.0 Request processed in 7016us (7540us total) trans 0 rc -13/-13 00000100:00100000:2.0:1788985931.463546:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 509 00010000:00010000:1.0:1788985931.713381:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985932.737323:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788985932.873175:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967489 is committed 00000001:00080000:1.0:1788985932.873365:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967490 is committed 00000100:00100000:2.0:1788985932.917662:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971188352 00000100:00100000:2.0:1788985932.917671:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971188352 00000100:00100000:2.0:1788985932.917716:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1181 00000100:00100000:2.0:1788985932.917738:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971188352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985932.917793:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971188352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985932.917806:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1181 00000020:00000080:2.0:1788985933.224003:0:66281:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff04a0ecf0 20000000:00000080:2.0:1788985933.224085:0:66281:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b09436cb800 uarg=0000000000000000 00010000:00010000:2.0:1788985933.228822:0:66281:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788985933.228844:0:66281:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788985933.228883:0:66281:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788985933.228901:0:66281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5476dc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985933.228917:0:66281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547634 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54762d expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985933.228925:0:66281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5476dc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985933.228959:0:66281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547634 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54762d expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985933.228973:0:66281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547634 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54762d expref: 18 pid: 5849 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985933.228985:0:66281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80716d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66281:1875885993404800:0@lo:104: 00000100:00100000:2.0:1788985933.229461:0:66281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985933.229563:0:66281:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f5509c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788985933.229681:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993404800 00000100:00100000:1.0:1788985933.229689:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993404800 00000100:00100000:1.0:1788985933.229744:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:1.0:1788985933.229754:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:66281:x1875885993404800:12345-0@lo:104: 00010000:00010000:1.0:1788985933.229766:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54762d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547634 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985933.229908:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788985933.229915:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:66281:x1875885993404800:12345-0@lo:104: Request processed in 164us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985933.229922:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788985933.230375:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993404928:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985933.230413:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985933.230996:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993404928:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985933.231654:0:66281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547634 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54762d expref: 18 pid: 5849 timeout: 1817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985933.231668:0:66281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80716d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66281:1875885993404800:0@lo:104: 00010000:00010000:2.0:1788985933.231683:0:66281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5476dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985933.231797:0:66281:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5476dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985933.231805:0:66281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5476dc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985933.231811:0:66281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5476dc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985933.762406:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788985934.046471:0:66329:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd7cd71100 20000000:00000080:2.0:1788985934.046492:0:66329:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a794ac000 uarg=0000000000000000 00010000:00010000:2.0:1788985934.046707:0:66329:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788985934.046732:0:66329:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788985934.046752:0:66329:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788985934.046769:0:66329:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5476e3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.046783:0:66329:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5476e3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.046793:0:66329:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5476e3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.046799:0:66329:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5476e3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.047175:0:66329:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5476e3 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.047297:0:66329:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5476e3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.047316:0:66329:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985934.047321:0:66329:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5476e3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.047329:0:66329:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5476e3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.047342:0:66329:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5476e3 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.047350:0:66329:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5476e3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.047356:0:66329:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5476e3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66329 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985934.784299:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788985934.784303:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788985934.784307:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788985934.784346:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985934.784358:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985934.784368:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985934.784392:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993405056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788985934.784459:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985934.784619:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76628e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788985934.784939:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993405056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985934.784959:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5476f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985934.784968:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5476f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985934.784986:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788985934.784991:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5476f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985934.784998:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5476f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985934.856227:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788985934.856248:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993405184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788985934.856307:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985934.856370:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993405184 00000100:00100000:1.0:1788985934.856377:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993405184 00000100:00100000:1.0:1788985934.856425:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1788985934.856433:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993405184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788985934.856464:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788985934.856505:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993405184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985934.856512:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00080000:1.0:1788985934.856532:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985934.856565:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993405184:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788985934.925693:0:66377:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde1cd37b0 20000000:00000080:1.0:1788985934.925708:0:66377:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80b1d000 uarg=0000000000000000 00010000:00010000:1.0:1788985934.925924:0:66377:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985934.925939:0:66377:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788985934.925957:0:66377:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985934.925973:0:66377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985934.925989:0:66377:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5476f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5476ea expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985934.925997:0:66377:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985934.926040:0:66377:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5476f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5476ea expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985934.926055:0:66377:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5476f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5476ea expref: 18 pid: 5848 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985934.926069:0:66377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66377:1875885993405312:0@lo:104: 00000100:00100000:1.0:1788985934.926159:0:66377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985934.926283:0:66377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a44d99000 going to sleep for 11 seconds 00000100:00100000:0.0:1788985934.926465:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993405312 00000100:00100000:0.0:1788985934.926472:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993405312 00000100:00100000:0.0:1788985934.926521:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788985934.926530:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:66377:x1875885993405312:12345-0@lo:104: 00010000:00010000:0.0:1788985934.926543:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5476f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985934.926604:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985934.926610:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:66377:x1875885993405312:12345-0@lo:104: Request processed in 82us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985934.926617:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00010000:00010000:0.0:1788985934.926636:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985934.926642:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5476f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985934.926649:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788985934.926660:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5476f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985934.926668:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5476f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788985934.926676:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5476f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985934.926682:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788985934.926709:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5476f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985934.926725:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788985934.926744:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5476f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985934.926751:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5476ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5476f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985934.926765:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985934.926767:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985934.926769:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985934.926787:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993405440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985934.926816:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985934.927405:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993405440 00000100:00100000:2.0:1788985934.927411:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993405440 00010000:00010000:2.0:1788985934.927434:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5476f1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5476ea expref: 19 pid: 5848 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985934.927464:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788985934.927471:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993405440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985934.927481:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985934.927486:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5476f1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5476ea expref: 19 pid: 5848 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927496:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5476f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5476ea expref: 19 pid: 5848 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927523:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927531:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927545:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927552:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927559:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927565:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927570:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985934.927574:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927582:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927591:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927601:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985934.927650:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993405440:12345-0@lo:103:ldlm_bl.0 Request processed in 179us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985934.927666:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:2.0:1788985934.927706:0:66377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5476f1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5476ea expref: 18 pid: 5848 timeout: 1818 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985934.927733:0:66377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:66377:1875885993405312:0@lo:104: 00010000:00010000:2.0:1788985934.927750:0:66377:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927758:0:66377:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927765:0:66377:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985934.927771:0:66377:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5476f8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985934.928021:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993405440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985935.873617:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993405568:0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.873683:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985935.873730:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993406080:0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.873758:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985935.873788:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788985935.873793:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993405952:0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.873812:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985935.873840:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993405696:0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.873858:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985935.873870:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993406208:0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.873884:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985935.873896:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788985935.873900:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993405824:0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.873914:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985935.874080:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993405568 00000100:00100000:0.0:1788985935.874086:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993405568 00000100:00100000:0.0:1788985935.874146:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1788985935.874153:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993405568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.874205:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993405568:12345-0@lo:400:kworker.0 Request processed in 52us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985935.874211:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1788985935.874235:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993406080 00000100:00100000:0.0:1788985935.874238:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993406080 00000100:00100000:0.0:1788985935.874261:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993405696 00000100:00100000:0.0:1788985935.874263:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993405696 00000100:00100000:0.0:1788985935.874273:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993405824 00000100:00100000:0.0:1788985935.874275:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993405824 00000100:00100000:0.0:1788985935.874285:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1788985935.874395:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993406080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.874422:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993406080:12345-0@lo:400:kworker.0 Request processed in 30us (663us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985935.874433:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00100000:0.0:1788985935.874445:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1788985935.874449:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993405696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.874476:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993405696:12345-0@lo:400:kworker.0 Request processed in 27us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985935.874481:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1788985935.874491:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:0.0:1788985935.874495:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993405824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.874518:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993405824:12345-0@lo:400:kworker.0 Request processed in 23us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985935.874523:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:0.0:1788985935.874551:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993405824:0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.874560:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993405696:0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.874581:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993405568:0@lo:400:kworker.0 00000100:00100000:0.0:1788985935.874589:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993406080:0@lo:400:kworker.0 00000100:00080000:1.0:1788985935.875272:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985935.875520:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993405952 00000100:00100000:2.0:1788985935.875526:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993405952 00000100:00100000:2.0:1788985935.875557:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993406208 00000100:00100000:2.0:1788985935.875560:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993406208 00000100:00100000:2.0:1788985935.875587:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:2.0:1788985935.875595:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993405952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985935.875665:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993405952:12345-0@lo:400:kworker.0 Request processed in 71us (1851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985935.875671:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00100000:1.0:1788985935.875675:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1788985935.875683:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993406208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985935.875717:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993405952:0@lo:400:kworker.0 00000100:00100000:1.0:1788985935.875733:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993406208:12345-0@lo:400:kworker.0 Request processed in 52us (1847us total) trans 0 rc 0/0 00000100:00080000:2.0:1788985935.875735:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985935.875739:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:1.0:1788985935.875762:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993406208:0@lo:400:kworker.0 10000000:01000000:0.0:1788985936.384204:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788985936.384212:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788985936.384217:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788985936.384260:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5476ff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985936.384272:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5476ff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985936.384282:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5476ff lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985936.384318:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993406336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788985936.384380:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985936.384439:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76320000 going to sleep for 11 seconds 00000100:00100000:1.0:1788985936.384788:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788985936.384801:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993406464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985936.384835:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985936.384908:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993406464 00000100:00100000:2.0:1788985936.384915:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993406464 00000100:00100000:2.0:1788985936.384964:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1788985936.384983:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993406464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788985936.385012:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985936.385058:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993406464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985936.385065:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:1.0:1788985936.385625:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993406464:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788985937.865251:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985938.032331:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971188864 00000100:00100000:1.0:1788985938.032342:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971188864 00000100:00100000:1.0:1788985938.032403:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1185 00000100:00100000:2.0:1788985938.032413:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971189120 00000100:00100000:1.0:1788985938.032413:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971188864:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985938.032417:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971189120 00000100:00100000:2.0:1788985938.032445:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971188992 00000100:00100000:2.0:1788985938.032447:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971188992 00000100:00100000:2.0:1788985938.032465:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 816 00000100:00100000:2.0:1788985938.032471:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971189120:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985938.032479:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971188864:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985938.032495:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971189120:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985938.032498:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1185 00000100:00100000:2.0:1788985938.032500:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 816 00000100:00100000:2.0:1788985938.032513:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 817 00000100:00100000:2.0:1788985938.032520:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971188992:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985938.032548:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971188992:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985938.032554:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 817 00000100:00100000:2.0:1788985938.032581:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971188736 00000100:00100000:2.0:1788985938.032584:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971188736 00000100:00100000:2.0:1788985938.032613:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1004 00000100:00100000:2.0:1788985938.032620:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971188736:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985938.032655:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971188736:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985938.032662:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1004 00000100:00080000:2.0:1788985938.032689:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788985938.032692:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788985938.032704:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985938.753893:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788985938.753905:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993406592 00000100:00100000:1.0:1788985938.753911:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993406592 00000100:00100000:1.0:1788985938.754364:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1788985938.754375:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79742450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:66572:x1875885993406592:12345-0@lo:104: 00010000:00010000:1.0:1788985938.754388:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5476ff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547706 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985938.754455:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788985938.754462:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79742450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:66572:x1875885993406592:12345-0@lo:104: Request processed in 89us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985938.754469:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00010000:00010000:2.0:1788985938.754527:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985938.754533:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5476ff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547706 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754540:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788985938.754544:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5476ff lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547706 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754552:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5476ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547706 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985938.754559:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5476ff lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547706 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985938.754564:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985938.754594:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5476ff lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547706 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754600:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985938.754618:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5476ff lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547706 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754625:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5476ff lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547706 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754652:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985938.754654:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985938.754655:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985938.754679:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993406720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985938.754718:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985938.754764:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993406720 00000100:00100000:2.0:1788985938.754768:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993406720 00010000:00010000:2.0:1788985938.754787:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547706 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5476ff expref: 19 pid: 5849 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985938.754809:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788985938.754815:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993406720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985938.754824:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985938.754829:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547706 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5476ff expref: 19 pid: 5849 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754838:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547706 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5476ff expref: 19 pid: 5849 timeout: 1822 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754852:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54770d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 66572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754860:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54770d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 66572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754874:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54770d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 66572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754881:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54770d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754894:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54770d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 66572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754900:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54770d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754905:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985938.754909:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54770d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 66572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754917:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54770d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 66572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754925:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54770d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 66572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985938.754934:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985938.754962:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993406720:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985938.754969:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788985938.755003:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993406720:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985938.887328:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788985939.840208:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788985939.840216:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788985939.840221:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788985939.840268:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547714 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985939.840281:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547714 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985939.840310:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547714 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985939.840334:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993406848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788985939.840398:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985939.840477:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788985939.840606:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993406848 00000100:00100000:0.0:1788985939.840614:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993406848 00000100:00100000:0.0:1788985939.840664:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1788985939.840673:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993406848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985939.840693:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985939.840706:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54771b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547714 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985939.840727:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54771b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547714 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985939.840738:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54771b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547714 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985939.840746:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788985939.842485:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993406848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1807us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985939.842495:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00010000:00010000:2.0:1788985939.904316:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985939.968432:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788985939.968454:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993406976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788985939.968519:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985939.968589:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993406976 00000100:00100000:1.0:1788985939.968597:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993406976 00000100:00100000:1.0:1788985939.968649:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1788985939.968657:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993406976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788985939.968700:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788985939.968742:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993406976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985939.968749:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00080000:1.0:1788985939.968777:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985939.969139:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993406976:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788985940.928235:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985940.995323:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993407232:0@lo:400:kworker.0 00000100:00100000:0.0:1788985940.995401:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985940.995450:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993407744:0@lo:400:kworker.0 00000100:00100000:0.0:1788985940.995506:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985940.995533:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788985940.995539:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993407104:0@lo:400:kworker.0 00000100:00100000:1.0:1788985940.995753:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993407360:0@lo:400:kworker.0 00000100:00100000:1.0:1788985940.995785:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985940.995812:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788985940.995818:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993407488:0@lo:400:kworker.0 00000100:00100000:1.0:1788985940.995842:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985940.995873:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993407232 00000100:00100000:1.0:1788985940.995881:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993407232 00000100:00100000:1.0:1788985940.995922:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993407360 00000100:00100000:1.0:1788985940.995925:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993407360 00000100:00100000:1.0:1788985940.995959:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1788985940.995970:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993407232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985940.996030:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993407232:12345-0@lo:400:kworker.0 Request processed in 63us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985940.996038:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1186 00000100:00100000:1.0:1788985940.996056:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1788985940.996062:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993407360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985940.996125:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993407360:12345-0@lo:400:kworker.0 Request processed in 63us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985940.996132:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1788985940.996154:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993407744 00000100:00100000:1.0:1788985940.996157:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993407744 00000100:00100000:1.0:1788985940.996185:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993407488 00000100:00100000:1.0:1788985940.996188:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993407488 00000100:00100000:1.0:1788985940.996206:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:1.0:1788985940.996212:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993407744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985940.996242:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993407744:12345-0@lo:400:kworker.0 Request processed in 30us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985940.996258:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:1.0:1788985940.996272:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:1.0:1788985940.996278:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993407488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985940.996307:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993407488:12345-0@lo:400:kworker.0 Request processed in 29us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985940.996312:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00080000:1.0:1788985940.996331:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985940.996335:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985940.996379:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993407488:0@lo:400:kworker.0 00000100:00100000:1.0:1788985940.996391:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993407360:0@lo:400:kworker.0 00000100:00100000:0.0:1788985940.996695:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985940.996728:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993407616:0@lo:400:kworker.0 00000100:00100000:0.0:1788985940.996755:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985940.996785:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993407232:0@lo:400:kworker.0 00000100:00100000:0.0:1788985940.996795:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993407744:0@lo:400:kworker.0 00000100:00100000:0.0:1788985940.996822:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993407616 00000100:00100000:0.0:1788985940.996825:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993407616 00000100:00100000:0.0:1788985940.996851:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1788985940.996857:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993407616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985940.996888:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993407616:12345-0@lo:400:kworker.0 Request processed in 31us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985940.996894:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1788985940.996925:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993407616:0@lo:400:kworker.0 00000100:00100000:1.0:1788985940.997295:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993407104 00000100:00100000:1.0:1788985940.997300:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993407104 00000100:00100000:1.0:1788985940.997333:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:1.0:1788985940.997339:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993407104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985940.997396:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993407104:12345-0@lo:400:kworker.0 Request processed in 57us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985940.997402:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00080000:1.0:1788985940.997434:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985941.506789:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993407872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985941.506858:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985941.514925:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993407872 00000100:00100000:1.0:1788985941.514951:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993407872 00000100:00100000:1.0:1788985941.515021:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1788985941.515032:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993407872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985941.515067:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788985941.515195:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993407872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (8336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985941.515202:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:2.0:1788985941.515234:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993407872:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788985941.952352:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985942.978714:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985943.159849:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985943.161693:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985943.162127:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971189632 00000100:00100000:0.0:1788985943.162139:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971189632 00000100:00100000:0.0:1788985943.162225:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 820 00000100:00100000:0.0:1788985943.162238:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971189632:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985943.162333:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971189632:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 98us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985943.162341:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 820 00000100:00100000:0.0:1788985943.162739:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971189248 00000100:00100000:0.0:1788985943.162760:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971189248 00000100:00100000:0.0:1788985943.162792:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1007 00000100:00100000:0.0:1788985943.162801:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971189248:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985943.162832:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971189248:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985943.162840:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1007 00000100:00100000:1.0:1788985943.164273:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971189376 00000100:00100000:1.0:1788985943.164286:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971189376 00000100:00100000:1.0:1788985943.164355:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1189 00000100:00100000:1.0:1788985943.164445:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971189376:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985943.164512:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971189376:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 80us (4676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985943.164519:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1189 00000100:00080000:1.0:1788985943.164550:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788985943.164556:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788985943.170194:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985943.170314:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971189504 00000100:00100000:0.0:1788985943.170326:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971189504 00000100:00100000:0.0:1788985943.170407:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 821 00000100:00100000:0.0:1788985943.170420:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971189504:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985943.170527:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971189504:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 109us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985943.170535:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 821 00000100:00080000:1.0:1788985943.171023:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788985944.002436:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985945.038701:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985945.091442:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993408000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985945.091535:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985945.091681:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993408000 00000100:00100000:2.0:1788985945.091691:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993408000 00000100:00100000:2.0:1788985945.091765:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1788985945.091776:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993408000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985945.091818:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985945.091881:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993408000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985945.091889:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00000100:00100000:2.0:1788985945.091941:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993408000:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788985945.092332:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788985946.048312:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985946.112958:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993408512:0@lo:400:kworker.0 00000100:00100000:1.0:1788985946.113024:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985946.113079:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788985946.113116:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993408384:0@lo:400:kworker.0 00000100:00100000:1.0:1788985946.113144:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985946.113178:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993408512 00000100:00100000:1.0:1788985946.113186:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993408512 00000100:00100000:1.0:1788985946.113234:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1788985946.113256:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993408512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985946.113306:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993408512:12345-0@lo:400:kworker.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985946.113327:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1788985946.113349:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993408384 00000100:00100000:1.0:1788985946.113353:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993408384 00000100:00100000:1.0:1788985946.113382:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1788985946.113387:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993408384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985946.113419:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993408384:12345-0@lo:400:kworker.0 Request processed in 32us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985946.113425:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00080000:1.0:1788985946.113442:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985946.113511:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993408384:0@lo:400:kworker.0 00000100:00100000:1.0:1788985946.113520:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993408512:0@lo:400:kworker.0 00000100:00100000:0.0:1788985946.113693:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993408128:0@lo:400:kworker.0 00000100:00100000:0.0:1788985946.113726:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985946.113750:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a808cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993408640:0@lo:400:kworker.0 00000100:00100000:0.0:1788985946.113771:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985946.113788:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788985946.113795:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993408256:0@lo:400:kworker.0 00000100:00100000:0.0:1788985946.113816:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985946.113830:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993408768:0@lo:400:kworker.0 00000100:00100000:0.0:1788985946.113861:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985946.116631:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993408128 00000100:00100000:1.0:1788985946.116644:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993408128 00000100:00100000:1.0:1788985946.116719:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:1.0:1788985946.116729:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993408128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985946.116815:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993408128:12345-0@lo:400:kworker.0 Request processed in 88us (3088us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985946.116823:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:1.0:1788985946.116858:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993408640 00000100:00100000:1.0:1788985946.116862:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993408640 00000100:00100000:1.0:1788985946.116891:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993408256 00000100:00100000:1.0:1788985946.116894:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993408256 00000100:00100000:1.0:1788985946.116911:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1788985946.116917:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993408640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985946.116958:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993408640:12345-0@lo:400:kworker.0 Request processed in 41us (3185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985946.116981:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1788985946.116995:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1788985946.117001:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993408256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985946.117032:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993408256:12345-0@lo:400:kworker.0 Request processed in 32us (3215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985946.117038:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:1.0:1788985946.117057:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985946.117189:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993408256:0@lo:400:kworker.0 00000100:00100000:0.0:1788985946.117202:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993408128:0@lo:400:kworker.0 00000100:00100000:0.0:1788985946.117213:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a808cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993408640:0@lo:400:kworker.0 00000100:00080000:0.0:1788985946.127762:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788985946.626553:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993408896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788985946.626621:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985946.627155:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993408896:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788985947.073230:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788985947.798481:0:66916:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 18: test nodemap mapped_noadmin fileops ========================================================== 16:32:26 (1788985946) 00010000:00010000:0.0:1788985948.101885:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985948.273372:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971189888 00000100:00100000:1.0:1788985948.273385:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971189888 00000100:00100000:1.0:1788985948.273458:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1193 00000100:00100000:1.0:1788985948.273469:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971189888:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985948.273563:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971190144 00000100:00100000:0.0:1788985948.273567:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971190144 00000100:00100000:0.0:1788985948.273597:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971190016 00000100:00100000:0.0:1788985948.273600:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971190016 00000100:00100000:0.0:1788985948.273624:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 824 00000100:00100000:0.0:1788985948.273631:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971190144:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985948.273746:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 825 00000100:00100000:2.0:1788985948.273777:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971190016:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985948.274058:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971189888:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 590us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985948.274067:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1193 00000100:00080000:1.0:1788985948.274118:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788985948.274122:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985948.274125:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985948.274404:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971190144:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 772us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985948.274413:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 824 00000100:00100000:2.0:1788985948.294565:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971190016:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 20771us (21124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985948.294585:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 825 00010000:00010000:1.0:1788985949.122593:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788985950.063924:0:67012:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffefc1aee40 20000000:00000080:0.0:1788985950.063949:0:67012:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f58c000 uarg=0000000000000000 10000000:01000000:0.0:1788985950.066106:0:67012:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985950.066134:0:67012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985950.066167:0:67012:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54771b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547714 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985950.066176:0:67012:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985950.066225:0:67012:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54771b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547714 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985950.066243:0:67012:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54771b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547714 expref: 18 pid: 5846 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985950.066275:0:67012:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c90700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67012:1875885993409024:0@lo:104: 00000100:00100000:0.0:1788985950.066366:0:67012:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985950.066457:0:67012:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c4f00 going to sleep for 11 seconds 00010000:00010000:3.0:1788985950.066732:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547714 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54771b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985950.066812:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788985950.066819:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:67012:x1875885993409024:12345-0@lo:104: Request processed in 106us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985950.066827:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00010000:00010000:2.0:1788985950.066835:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985950.066846:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547714 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54771b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.066855:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788985950.066859:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547714 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54771b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.066873:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547714 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54771b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985950.066881:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547714 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54771b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985950.066887:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985950.066929:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547714 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54771b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.066937:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985950.066981:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547714 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54771b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.066989:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547714 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54771b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985950.066997:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993409152:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985950.067032:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985950.067035:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985950.067037:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985950.067042:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985950.067386:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993409152 00000100:00100000:2.0:1788985950.067393:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993409152 00010000:00010000:2.0:1788985950.067418:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54771b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547714 expref: 19 pid: 5846 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985950.067450:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788985950.067457:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993409152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985950.067469:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985950.067474:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54771b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547714 expref: 19 pid: 5846 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.067485:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54771b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547714 expref: 19 pid: 5846 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.067502:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.067510:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.067524:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.067530:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.067537:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.067551:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.067557:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985950.067561:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.067568:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.067575:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.067584:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985950.067645:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993409152:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985950.067652:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:1.0:1788985950.067710:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993409152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985950.067866:0:67012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54771b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547714 expref: 18 pid: 5846 timeout: 1833 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985950.067878:0:67012:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c90700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67012:1875885993409024:0@lo:104: 00010000:00010000:0.0:1788985950.067897:0:67012:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985950.067908:0:67012:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985950.067915:0:67012:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985950.067922:0:67012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf547722 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67012 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985950.145252:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985950.218427:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993409280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788985950.218556:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985950.218652:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993409280 00000100:00100000:0.0:1788985950.218670:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993409280 00000100:00100000:0.0:1788985950.218902:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1788985950.218916:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993409280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788985950.218966:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985950.219341:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993409280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985950.219935:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993409280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1019us (1375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985950.219945:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00080000:1.0:1788985950.222222:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788985950.958307:0:67060:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc46078de0 20000000:00000080:1.0:1788985950.958329:0:67060:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a73ab4800 uarg=0000000000000000 10000000:01000000:1.0:1788985950.958798:0:67060:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985950.958826:0:67060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547729 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985950.958845:0:67060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547729 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985950.958857:0:67060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547729 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985950.958865:0:67060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547729 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985950.958872:0:67060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547729 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985950.958880:0:67060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547729 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985950.958886:0:67060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788985950.958891:0:67060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547729 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985950.958899:0:67060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547729 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985950.958914:0:67060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547729 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985950.958933:0:67060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547729 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985950.958940:0:67060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547729 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985951.174545:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985951.239972:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993409536:0@lo:400:kworker.0 00000100:00100000:0.0:1788985951.240038:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985951.240080:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993410048:0@lo:400:kworker.0 00000100:00100000:0.0:1788985951.240125:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985951.240145:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788985951.240151:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993409664:0@lo:400:kworker.0 00000100:00100000:0.0:1788985951.240170:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985951.240238:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993409792:0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240267:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985951.240292:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788985951.240298:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993409408:0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240325:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985951.240349:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993409920:0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240371:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985951.240403:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993409536 00000100:00100000:1.0:1788985951.240410:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993409536 00000100:00100000:1.0:1788985951.240447:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993409664 00000100:00100000:1.0:1788985951.240450:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993409664 00000100:00100000:1.0:1788985951.240471:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993409920 00000100:00100000:1.0:1788985951.240473:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993409920 00000100:00100000:1.0:1788985951.240488:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1788985951.240494:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993409536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240538:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993409536:12345-0@lo:400:kworker.0 Request processed in 44us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985951.240544:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1194 00000100:00100000:1.0:1788985951.240558:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:1.0:1788985951.240564:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993409664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240596:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993409664:12345-0@lo:400:kworker.0 Request processed in 33us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985951.240601:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:1.0:1788985951.240612:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:1.0:1788985951.240618:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993409920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240658:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993409920:12345-0@lo:400:kworker.0 Request processed in 40us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985951.240663:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:1.0:1788985951.240680:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993410048 00000100:00100000:1.0:1788985951.240682:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993410048 00000100:00100000:1.0:1788985951.240704:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993409792 00000100:00100000:1.0:1788985951.240707:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993409792 00000100:00100000:1.0:1788985951.240726:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:1.0:1788985951.240733:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993410048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985951.240737:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:2.0:1788985951.240745:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993409792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240763:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993410048:12345-0@lo:400:kworker.0 Request processed in 31us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985951.240768:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:2.0:1788985951.240776:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993409792:12345-0@lo:400:kworker.0 Request processed in 33us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985951.240781:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:1.0:1788985951.240788:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993409408 00000100:00100000:1.0:1788985951.240792:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993409408 00000100:00100000:1.0:1788985951.240821:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:1.0:1788985951.240827:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993409408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240857:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993409408:12345-0@lo:400:kworker.0 Request processed in 30us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985951.240862:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00080000:1.0:1788985951.240892:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985951.240896:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985951.240923:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993409408:0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240944:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993409920:0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240952:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993409792:0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240980:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993409664:0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240989:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993409536:0@lo:400:kworker.0 00000100:00100000:1.0:1788985951.240997:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993410048:0@lo:400:kworker.0 00000100:00100000:0.0:1788985951.748864:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993410176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985951.748939:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985951.749107:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993410176 00000100:00100000:0.0:1788985951.749116:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993410176 00000100:00100000:0.0:1788985951.749163:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1788985951.749172:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993410176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985951.749208:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985951.749270:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993410176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985951.749277:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:0.0:1788985951.749334:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993410176:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788985951.780020:0:67108:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe46c10630 20000000:00000080:1.0:1788985951.780043:0:67108:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76002800 uarg=0000000000000000 10000000:01000000:1.0:1788985951.780305:0:67108:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985951.780331:0:67108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547730 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985951.780351:0:67108:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547730 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985951.780364:0:67108:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547730 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985951.780371:0:67108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547730 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985951.780379:0:67108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547730 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985951.780387:0:67108:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547730 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985951.780395:0:67108:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788985951.780410:0:67108:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547730 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985951.780420:0:67108:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547730 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985951.780436:0:67108:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547730 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985951.780444:0:67108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547730 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985951.780450:0:67108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547730 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985951.939186:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788985951.939196:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788985951.939202:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788985951.939261:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985951.939276:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985951.939304:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985951.939337:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993410304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788985951.939433:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985951.939497:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a45b97300 going to sleep for 11 seconds 00000100:00100000:0.0:1788985951.939540:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993410304 00000100:00100000:0.0:1788985951.939549:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993410304 00000100:00100000:0.0:1788985951.939611:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1788985951.939634:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993410304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985951.939650:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985951.939667:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54773e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547737 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985951.939696:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54773e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547737 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985951.939708:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54773e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547737 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985951.939718:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788985951.939761:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993410304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985951.939768:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1788985951.939826:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993410304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985951.939844:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54773e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985951.939862:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54773e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985951.939899:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788985951.939904:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54773e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985951.939912:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54773e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.193460:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788985952.704451:0:67156:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb3918c10 20000000:00000080:1.0:1788985952.704475:0:67156:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a797dd400 uarg=0000000000000000 10000000:01000000:1.0:1788985952.704736:0:67156:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985952.704760:0:67156:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985952.704781:0:67156:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54773e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547737 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985952.704791:0:67156:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985952.704836:0:67156:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54773e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547737 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985952.704853:0:67156:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54773e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547737 expref: 18 pid: 5849 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985952.704884:0:67156:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767ff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67156:1875885993410432:0@lo:104: 00000100:00100000:1.0:1788985952.704964:0:67156:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985952.705147:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993410432 00000100:00100000:0.0:1788985952.705155:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993410432 00000100:00100000:0.0:1788985952.705272:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1788985952.705283:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:67156:x1875885993410432:12345-0@lo:104: 00010000:00010000:0.0:1788985952.705299:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54773e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985952.705357:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985952.705364:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79725500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:67156:x1875885993410432:12345-0@lo:104: Request processed in 83us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985952.705371:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788985952.705489:0:67156:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5ab76900 going to sleep for 11 seconds 00000100:00100000:1.0:1788985952.705516:0:67156:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767ff100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67156:1875885993410432:0@lo:104: 00010000:00010000:1.0:1788985952.705536:0:67156:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.705723:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985952.705732:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54773e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.705741:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788985952.705745:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54773e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.705754:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54773e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985952.705761:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54773e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985952.705767:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985952.705843:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54773e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.705851:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985952.705875:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54773e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.705882:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf547737 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54773e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.705900:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985952.705902:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985952.705904:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985952.705916:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993410560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985952.705954:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985952.706012:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993410560 00000100:00100000:2.0:1788985952.706016:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993410560 00010000:00010000:2.0:1788985952.706039:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54773e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547737 expref: 19 pid: 5849 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985952.706063:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788985952.706070:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993410560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985952.708226:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985952.708247:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54773e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547737 expref: 19 pid: 5849 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.708269:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54773e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547737 expref: 19 pid: 5849 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.708291:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54773e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547737 expref: 19 pid: 5849 timeout: 1836 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.708314:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.708324:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.708353:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.708361:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.708369:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.708396:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.708404:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985952.708409:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.708418:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.708444:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.708458:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985952.708631:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993410560:12345-0@lo:103:ldlm_bl.0 Request processed in 2559us (2673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985952.708642:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788985952.708715:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993410560:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985952.710239:0:67156:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.710258:0:67156:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985952.710266:0:67156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547745 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67156 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985953.217568:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985953.393919:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985953.394020:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985953.394061:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985953.394134:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971190272 00000100:00100000:0.0:1788985953.394146:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971190272 00000100:00100000:0.0:1788985953.394221:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1012 00000100:00100000:0.0:1788985953.394234:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971190272:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985953.394349:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971190272:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 117us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985953.394369:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1012 00000100:00100000:2.0:1788985953.399173:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971190528 00000100:00100000:2.0:1788985953.399208:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971190528 00000100:00100000:3.0:1788985953.399447:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985953.399628:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971190400 00000100:00100000:1.0:1788985953.399635:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971190400 00000100:00100000:1.0:1788985953.399719:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1197 00000100:00100000:1.0:1788985953.399732:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971190400:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985953.399814:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971190656 00000100:00100000:1.0:1788985953.399831:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971190400:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 102us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985953.399839:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1197 00000100:00100000:0.0:1788985953.400116:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971190656 00000100:00100000:0.0:1788985953.400160:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 274 00000100:00100000:0.0:1788985953.400170:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971190656:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:0.0:1788985953.400196:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54763b 00000100:00080000:0.0:1788985953.400208:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9b094371e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788985953.400540:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967328 00000100:00080000:2.0:1788985953.400647:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788985953.400654:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985953.401315:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 275 00000100:00100000:2.0:1788985953.401327:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971190528:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:2.0:1788985953.401351:0:8478:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf546e23 00000100:00080000:2.0:1788985953.401360:0:8478:0:(import.c:65:import_set_state_nolock()) ffff9b0a7fa0a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788985953.401409:0:8478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967328 00000100:00080000:1.0:1788985953.401755:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788985953.402142:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985953.402432:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971190528:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 1102us (8520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985953.402445:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 275 00010000:00010000:1.0:1788985953.407304:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985953.409071:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971190656:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 8887us (14994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985953.409106:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 274 00000020:00000080:0.0:1788985953.666909:0:67205:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee6e732b0 20000000:00000080:0.0:1788985953.666931:0:67205:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f9e3c00 uarg=0000000000000000 10000000:01000000:0.0:1788985953.668444:0:67205:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985953.668814:0:67205:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54774c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985953.668835:0:67205:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54774c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985953.668848:0:67205:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54774c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985953.668855:0:67205:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54774c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985953.668863:0:67205:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54774c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985953.668890:0:67205:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54774c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985953.668898:0:67205:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788985953.668903:0:67205:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54774c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985953.668912:0:67205:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54774c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985953.668929:0:67205:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54774c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985953.668938:0:67205:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54774c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985953.668945:0:67205:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54774c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67205 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985954.112274:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788985954.112284:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788985954.112291:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788985954.112350:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985954.112364:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985954.112378:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985954.112424:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993410688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788985954.112510:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985954.112580:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f89e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788985954.112749:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993410688 00000100:00100000:1.0:1788985954.112760:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993410688 00000100:00100000:1.0:1788985954.112830:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1788985954.112841:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993410688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985954.112857:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985954.112874:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54775a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547753 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985954.112901:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54775a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547753 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985954.112928:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54775a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547753 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985954.112939:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788985954.113001:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993410688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 162us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985954.113009:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:2.0:1788985954.113223:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c92d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993410688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985954.113241:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54775a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985954.113250:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54775a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985954.113287:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788985954.113293:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54775a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985954.113301:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54775a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.240276:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788985954.548349:0:67254:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe3296d0c0 20000000:00000080:3.0:1788985954.548364:0:67254:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76002c00 uarg=0000000000000000 10000000:01000000:3.0:1788985954.548547:0:67254:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788985954.548566:0:67254:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.548584:0:67254:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54775a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547753 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.548592:0:67254:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.548638:0:67254:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54775a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547753 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.548652:0:67254:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54775a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547753 expref: 18 pid: 5846 timeout: 1838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985954.548669:0:67254:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c78700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67254:1875885993410816:0@lo:104: 00000100:00100000:3.0:1788985954.548726:0:67254:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985954.548831:0:67254:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a4991b780 going to sleep for 11 seconds 00000100:00100000:1.0:1788985954.548946:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993410816 00000100:00100000:1.0:1788985954.548953:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993410816 00000100:00100000:1.0:1788985954.551408:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788985954.551424:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:67254:x1875885993410816:12345-0@lo:104: 00010000:00010000:1.0:1788985954.551444:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54775a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985954.551557:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788985954.551563:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:67254:x1875885993410816:12345-0@lo:104: Request processed in 145us (2837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985954.551572:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788985954.551658:0:67254:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c78700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67254:1875885993410816:0@lo:104: 00010000:00010000:0.0:1788985954.551682:0:67254:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985954.551845:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788985954.551851:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54775a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985954.551858:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788985954.551862:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54775a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985954.551943:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54775a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788985954.551966:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54775a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985954.551971:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788985954.552054:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54775a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985954.552060:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788985954.552146:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788985954.552166:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54775a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985954.552174:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547753 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54775a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985954.552190:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985954.552192:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985954.552193:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985954.552463:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993410944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985954.552507:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985954.552587:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993410944 00000100:00100000:3.0:1788985954.552594:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993410944 00010000:00010000:3.0:1788985954.552628:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54775a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547753 expref: 19 pid: 5846 timeout: 1838 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985954.552660:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788985954.552667:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993410944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788985954.552679:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788985954.552684:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54775a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547753 expref: 19 pid: 5846 timeout: 1838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.552693:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54775a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547753 expref: 19 pid: 5846 timeout: 1838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.552716:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54775a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547753 expref: 19 pid: 5846 timeout: 1838 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.552729:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.552738:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.552753:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.552764:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.552770:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.552777:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.552782:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788985954.552786:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.552793:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.552811:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985954.552820:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788985954.552855:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993410944:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985954.552861:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788985954.552926:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993410944:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985954.553209:0:67254:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985954.553218:0:67254:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985954.553225:0:67254:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf547761 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67254 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985955.264362:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985955.329322:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993411072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985955.329418:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985955.329508:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993411072 00000100:00100000:0.0:1788985955.329517:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993411072 00000100:00100000:0.0:1788985955.329580:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:0.0:1788985955.329590:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993411072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788985955.329646:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985955.330582:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993411072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 988us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985955.330611:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00080000:1.0:1788985955.333250:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985955.334343:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c78700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993411072:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788985955.380898:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:0.0:1788985955.380907:0:6721:0:(genops.c:885:class_export_put()) final put ffff9b0a7fa0e000/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788985955.380972:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a7fa0e000/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0000 00000020:00000080:2.0:1788985955.381022:0:489:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a7fa0a000 for lustre-OST0000 00000001:00100000:0.0:1788985955.891029:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:0.0:1788985955.891035:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b0943718800/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788985955.891206:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0943718800/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0001 00000020:00000080:2.0:1788985955.891265:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b094371e800 for lustre-OST0001 10000000:01000000:2.0:1788985956.033157:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788985956.033165:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788985956.033171:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788985956.033219:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985956.033230:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985956.033241:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985956.033266:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993411200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788985956.033333:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985956.033383:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51a116c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788985956.033525:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993411200 00000100:00100000:0.0:1788985956.033533:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993411200 00000100:00100000:0.0:1788985956.033584:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1788985956.033593:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993411200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985956.033617:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985956.033631:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54776f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547768 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985956.033652:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54776f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547768 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985956.033663:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54776f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547768 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985956.033672:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788985956.033716:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993411200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985956.033723:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1788985956.033819:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993411200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985956.033832:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54776f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985956.033841:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54776f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985956.033859:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788985956.033864:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54776f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985956.033870:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54776f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985956.288328:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985956.354841:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993411328:0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.354913:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985956.354957:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993411840:0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355020:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985956.355046:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788985956.355052:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993411712:0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355075:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985956.355117:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993411456:0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355140:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985956.355158:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993411968:0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355176:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985956.355191:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788985956.355208:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993411584:0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355228:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985956.355257:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993411328 00000100:00100000:2.0:1788985956.355263:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993411328 00000100:00100000:2.0:1788985956.355301:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1788985956.355308:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993411328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355350:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993411328:12345-0@lo:400:kworker.0 Request processed in 42us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985956.355356:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1788985956.355385:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993411840 00000100:00100000:2.0:1788985956.355388:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993411840 00000100:00100000:2.0:1788985956.355418:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993411456 00000100:00100000:2.0:1788985956.355430:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993411456 00000100:00100000:2.0:1788985956.355449:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993411584 00000100:00100000:2.0:1788985956.355452:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993411584 00000100:00100000:2.0:1788985956.355468:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1788985956.355474:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993411840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355508:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993411840:12345-0@lo:400:kworker.0 Request processed in 33us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985956.355514:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1198 00000100:00100000:2.0:1788985956.355526:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1788985956.355532:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993411456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355560:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993411456:12345-0@lo:400:kworker.0 Request processed in 28us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985956.355565:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1788985956.355578:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1788985956.355583:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993411584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355622:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993411584:12345-0@lo:400:kworker.0 Request processed in 38us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985956.355628:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1788985956.355647:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993411712 00000100:00100000:2.0:1788985956.355650:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993411712 00000100:00100000:2.0:1788985956.355670:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993411968 00000100:00100000:2.0:1788985956.355673:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993411968 00000100:00100000:2.0:1788985956.355692:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:2.0:1788985956.355699:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993411712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355728:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993411712:12345-0@lo:400:kworker.0 Request processed in 29us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985956.355734:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00100000:2.0:1788985956.355753:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1788985956.355758:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993411968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355785:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993411968:12345-0@lo:400:kworker.0 Request processed in 27us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985956.355790:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00080000:2.0:1788985956.355818:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788985956.355822:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985956.355858:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993411584:0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355868:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993411456:0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355876:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993411968:0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355917:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993411712:0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355925:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993411328:0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.355934:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993411840:0@lo:400:kworker.0 00000100:00100000:2.0:1788985956.864376:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993412096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788985956.864440:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985956.864561:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993412096 00000100:00100000:0.0:1788985956.864568:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993412096 00000100:00100000:0.0:1788985956.864640:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1788985956.864651:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993412096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985956.864683:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985956.864728:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993412096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985956.864735:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00000100:00100000:0.0:1788985956.864776:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993412096:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788985957.218701:0:67402:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea316ba80 20000000:00000080:0.0:1788985957.218718:0:67402:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a4395ac00 uarg=0000000000000000 10000000:01000000:0.0:1788985957.218993:0:67402:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985957.219014:0:67402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985957.219031:0:67402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54776f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547768 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985957.219041:0:67402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985957.220028:0:67402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54776f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547768 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985957.220054:0:67402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54776f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547768 expref: 18 pid: 5848 timeout: 1841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985957.220076:0:67402:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67402:1875885993412224:0@lo:104: 00000100:00100000:0.0:1788985957.220413:0:67402:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985957.220523:0:67402:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7977d600 going to sleep for 11 seconds 00000100:00100000:1.0:1788985957.220642:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993412224 00000100:00100000:1.0:1788985957.220649:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993412224 00000100:00100000:1.0:1788985957.220746:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788985957.220756:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:67402:x1875885993412224:12345-0@lo:104: 00010000:00010000:1.0:1788985957.220769:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54776f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985957.220837:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788985957.220843:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:67402:x1875885993412224:12345-0@lo:104: Request processed in 90us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985957.220850:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00010000:00010000:2.0:1788985957.220925:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985957.220932:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54776f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.220939:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788985957.220943:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54776f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.220952:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54776f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985957.220965:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54776f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985957.220970:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985957.221002:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54776f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221008:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985957.221027:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54776f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221034:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf547768 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54776f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221071:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985957.221073:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985957.221075:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985957.221116:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993412352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985957.221147:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985957.221186:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993412352 00000100:00100000:2.0:1788985957.221202:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993412352 00010000:00010000:2.0:1788985957.221223:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54776f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547768 expref: 19 pid: 5848 timeout: 1841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985957.221244:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788985957.221251:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993412352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985957.221262:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985957.221266:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54776f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547768 expref: 19 pid: 5848 timeout: 1841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221283:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54776f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547768 expref: 19 pid: 5848 timeout: 1841 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221301:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221308:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221322:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221328:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221334:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221340:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221344:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985957.221348:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221355:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221364:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985957.221383:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985957.221411:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993412352:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985957.221418:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788985957.221453:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993412352:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985957.221658:0:67402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54776f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547768 expref: 18 pid: 5848 timeout: 1841 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985957.221675:0:67402:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c90000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67402:1875885993412224:0@lo:104: 00010000:00010000:0.0:1788985957.221692:0:67402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985957.221701:0:67402:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985957.221707:0:67402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985957.221713:0:67402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf547776 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985957.313155:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788985958.183496:0:67450:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb9900690 20000000:00000080:0.0:1788985958.183512:0:67450:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a4395ac00 uarg=0000000000000000 10000000:01000000:0.0:1788985958.183712:0:67450:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985958.183732:0:67450:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54777d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985958.183747:0:67450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54777d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985958.183758:0:67450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54777d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985958.183764:0:67450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54777d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985958.183770:0:67450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54777d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985958.183784:0:67450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54777d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985958.183789:0:67450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788985958.183793:0:67450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54777d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985958.183800:0:67450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54777d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985958.183812:0:67450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54777d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985958.183958:0:67450:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54777d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985958.183967:0:67450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54777d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67450 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985958.337322:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985958.515027:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985958.515077:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985958.515254:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971190784 00000100:00100000:1.0:1788985958.515264:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971190784 00000100:00100000:0.0:1788985958.515365:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1016 00000100:00100000:0.0:1788985958.515378:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971190784:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985958.515402:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971190912 00000100:00100000:2.0:1788985958.515407:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971190912 00000100:00100000:0.0:1788985958.515440:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971190784:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985958.515444:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1201 00000100:00100000:0.0:1788985958.515447:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1016 00000100:00100000:2.0:1788985958.515450:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971190912:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985958.515485:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971190912:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985958.515491:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1201 00000100:00080000:2.0:1788985958.515507:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1788985958.656635:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788985958.656640:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788985958.656644:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788985958.656682:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985958.656694:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985958.656707:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985958.656732:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993412480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788985958.656795:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985958.656854:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eac300 going to sleep for 11 seconds 00000100:00100000:3.0:1788985958.656902:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993412480 00000100:00100000:3.0:1788985958.656909:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993412480 00000100:00100000:3.0:1788985958.656958:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1788985958.656967:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993412480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788985958.656981:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788985958.656994:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54778b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547784 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985958.657015:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54778b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547784 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985958.657026:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54778b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547784 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985958.657034:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788985958.657079:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993412480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985958.657085:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1788985958.658132:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993412480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985958.658152:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54778b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985958.658164:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54778b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985958.658182:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788985958.658187:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54778b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985958.658195:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54778b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985959.362016:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985960.385492:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985960.454590:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993412608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788985960.454657:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985960.454745:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993412608 00000100:00100000:2.0:1788985960.454753:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993412608 00000100:00100000:2.0:1788985960.454819:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:2.0:1788985960.454830:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993412608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788985960.454967:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985960.455013:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993412608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985960.455020:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00080000:2.0:1788985960.455052:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788985960.457265:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993412608:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788985961.410202:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985961.472332:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993412992:0@lo:400:kworker.0 00000100:00100000:1.0:1788985961.472393:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985961.472443:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788985961.472450:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993413120:0@lo:400:kworker.0 00000100:00100000:1.0:1788985961.472474:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985961.472507:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993412992 00000100:00100000:1.0:1788985961.472514:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993412992 00000100:00100000:1.0:1788985961.472562:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1788985961.472585:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993412992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985961.472632:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993412992:12345-0@lo:400:kworker.0 Request processed in 49us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985961.472639:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1202 00000100:00100000:1.0:1788985961.472663:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993413120 00000100:00100000:1.0:1788985961.472667:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993413120 00000100:00100000:1.0:1788985961.472690:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:1.0:1788985961.472696:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993413120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985961.472725:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993413120:12345-0@lo:400:kworker.0 Request processed in 29us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985961.472731:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00080000:1.0:1788985961.472746:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985961.472777:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993413120:0@lo:400:kworker.0 00000100:00100000:1.0:1788985961.472787:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993412992:0@lo:400:kworker.0 00000100:00100000:2.0:1788985961.472854:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993412736:0@lo:400:kworker.0 00000100:00100000:2.0:1788985961.472898:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985961.472914:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993412864:0@lo:400:kworker.0 00000100:00100000:2.0:1788985961.472938:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094242c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993413248:0@lo:400:kworker.0 00000100:00100000:3.0:1788985961.472951:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985961.472974:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985961.472980:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094242e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993413376:0@lo:400:kworker.0 00000100:00100000:3.0:1788985961.473013:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985961.473013:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993412864 00000100:00100000:2.0:1788985961.473018:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993412864 00000100:00100000:2.0:1788985961.473047:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993413248 00000100:00100000:2.0:1788985961.473051:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993413248 00000100:00100000:3.0:1788985961.473057:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1788985961.473067:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993412864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985961.473079:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1788985961.473114:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993413248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985961.473128:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993412864:12345-0@lo:400:kworker.0 Request processed in 63us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985961.473135:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1788985961.473160:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993413248:12345-0@lo:400:kworker.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985961.473167:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00100000:3.0:1788985961.473179:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993413376 00000100:00100000:3.0:1788985961.473184:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993413376 00000100:00100000:2.0:1788985961.473206:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094242c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993413248:0@lo:400:kworker.0 00000100:00100000:3.0:1788985961.473220:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1788985961.473228:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993413376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985961.473263:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993413376:12345-0@lo:400:kworker.0 Request processed in 36us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985961.473269:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:1.0:1788985961.473294:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993412736 00000100:00100000:3.0:1788985961.473306:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993412864:0@lo:400:kworker.0 00000100:00100000:1.0:1788985961.473306:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993412736 00000100:00100000:3.0:1788985961.473320:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094242e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993413376:0@lo:400:kworker.0 00000100:00100000:1.0:1788985961.473348:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:1.0:1788985961.473357:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993412736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985961.473401:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993412736:12345-0@lo:400:kworker.0 Request processed in 45us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985961.473408:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:3.0:1788985961.473433:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993412736:0@lo:400:kworker.0 00000100:00080000:2.0:1788985961.478393:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788985961.478402:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1788985961.721936:0:67651:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffdfd735b0 20000000:00000080:1.0:1788985961.721953:0:67651:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a797de400 uarg=0000000000000000 00010000:00010000:1.0:1788985961.723891:0:67651:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985961.723908:0:67651:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788985961.723919:0:67651:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985961.723936:0:67651:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985961.723952:0:67651:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54778b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547784 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985961.723960:0:67651:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985961.723996:0:67651:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54778b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547784 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985961.724011:0:67651:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54778b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547784 expref: 18 pid: 5848 timeout: 1845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985961.724024:0:67651:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094242ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67651:1875885993413504:0@lo:104: 00000100:00100000:1.0:1788985961.724080:0:67651:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985961.724311:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993413504 00000100:00100000:0.0:1788985961.724333:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993413504 00000100:00100000:0.0:1788985961.724391:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788985961.724396:0:67651:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812600 going to sleep for 11 seconds 00000100:00100000:0.0:1788985961.724403:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:67651:x1875885993413504:12345-0@lo:104: 00010000:00010000:0.0:1788985961.724417:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54778b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.724478:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985961.724485:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:67651:x1875885993413504:12345-0@lo:104: Request processed in 87us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985961.724494:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788985961.724501:0:67651:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094242ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67651:1875885993413504:0@lo:104: 00010000:00010000:1.0:1788985961.724529:0:67651:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985961.724588:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985961.724594:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54778b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985961.724602:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788985961.724606:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54778b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985961.724613:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54778b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985961.724620:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54778b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985961.724636:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985961.724672:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54778b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985961.724679:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985961.724701:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54778b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985961.724708:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf547784 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54778b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985961.724722:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985961.724724:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985961.724725:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985961.724733:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788985961.724743:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993413632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985961.724775:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985961.725142:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993413632 00000100:00100000:0.0:1788985961.725147:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993413632 00010000:00010000:0.0:1788985961.725168:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54778b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547784 expref: 19 pid: 5848 timeout: 1845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985961.725200:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788985961.725218:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993413632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985961.725229:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985961.725234:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54778b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547784 expref: 19 pid: 5848 timeout: 1845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.725246:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54778b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547784 expref: 19 pid: 5848 timeout: 1845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.725259:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54778b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547784 expref: 19 pid: 5848 timeout: 1845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.725272:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.725280:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.725301:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.725308:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.725314:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.725535:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.725540:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788985961.725543:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.725551:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.725577:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985961.725587:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788985961.725604:0:67651:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985961.725614:0:67651:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985961.725620:0:67651:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf547792 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67651 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985961.725641:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993413632:12345-0@lo:103:ldlm_bl.0 Request processed in 421us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985961.725649:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788985961.726164:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993413632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788985961.988262:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788985961.988283:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993413760:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985961.988347:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985961.988444:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993413760 00000100:00100000:0.0:1788985961.988452:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993413760 00000100:00100000:0.0:1788985961.988505:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 609 00000100:00100000:0.0:1788985961.988514:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993413760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985961.988554:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985961.988615:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993413760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985961.988622:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 609 00000100:00100000:0.0:1788985961.988666:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993413760:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788985962.434167:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788985962.881164:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788985962.881172:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788985962.881177:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788985962.881220:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985962.881233:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985962.881244:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985962.881269:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993413888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788985962.881332:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985962.881391:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7977d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788985962.881468:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993413888 00000100:00100000:2.0:1788985962.881476:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993413888 00000100:00100000:2.0:1788985962.881580:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1788985962.881589:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993413888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985962.881601:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985962.881612:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5477a0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547799 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985962.881634:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5477a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547799 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985962.881652:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5477a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547799 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985962.881660:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0a00, rc 0) 00000100:00100000:2.0:1788985962.881707:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993413888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985962.881713:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:0.0:1788985962.881783:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993413888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985962.881797:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5477a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985962.881805:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5477a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985962.881833:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788985962.881837:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5477a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985962.881843:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5477a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985963.456489:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985963.636312:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985963.636359:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985963.636584:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971191040 00000100:00100000:0.0:1788985963.636592:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971191040 00000100:00100000:2.0:1788985963.636673:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971191168 00000100:00100000:2.0:1788985963.636677:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971191168 00000100:00100000:0.0:1788985963.636718:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1020 00000100:00100000:0.0:1788985963.636728:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971191040:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985963.636732:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1205 00000100:00100000:2.0:1788985963.636738:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971191168:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985963.636786:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971191040:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 59us (426us total) trans 0 rc 0/0 00000100:00080000:1.0:1788985963.636790:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985963.636793:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1020 00000100:00100000:2.0:1788985963.641744:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971191168:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 4995us (5431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985963.641759:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1205 00010000:00010000:0.0:1788985964.480519:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788985965.382406:0:67846:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff7dd9abd0 20000000:00000080:3.0:1788985965.382422:0:67846:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094295e800 uarg=0000000000000000 10000000:01000000:3.0:1788985965.382463:0:67846:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788985965.382481:0:67846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985965.382974:0:67846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5477a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547799 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985965.382984:0:67846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985965.383021:0:67846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5477a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547799 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985965.383035:0:67846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5477a0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547799 expref: 18 pid: 5846 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985965.383053:0:67846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67846:1875885993414016:0@lo:104: 00000100:00100000:3.0:1788985965.383150:0:67846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985965.383207:0:67846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a41254540 going to sleep for 11 seconds 00000100:00100000:1.0:1788985965.383344:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993414016 00000100:00100000:1.0:1788985965.383351:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993414016 00000100:00100000:1.0:1788985965.383399:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1788985965.383409:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:67846:x1875885993414016:12345-0@lo:104: 00010000:00010000:1.0:1788985965.383422:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5477a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985965.383493:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788985965.383499:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:67846:x1875885993414016:12345-0@lo:104: Request processed in 93us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985965.383506:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00010000:00010000:2.0:1788985965.383726:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985965.383733:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5477a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.383740:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788985965.383744:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5477a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.383752:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5477a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985965.383759:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5477a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985965.383775:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985965.383811:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5477a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.383818:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985965.383847:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5477a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.383854:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf547799 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5477a0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.383870:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985965.383872:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985965.383873:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985965.383881:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788985965.383909:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993414144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985965.383939:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985965.383970:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993414144 00000100:00100000:2.0:1788985965.383974:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993414144 00010000:00010000:2.0:1788985965.383992:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5477a0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547799 expref: 19 pid: 5846 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985965.384012:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788985965.384017:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993414144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985965.384027:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985965.384032:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5477a0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547799 expref: 19 pid: 5846 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.384053:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5477a0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547799 expref: 19 pid: 5846 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.384067:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.384075:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.384114:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.384121:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.384127:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.384132:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.384137:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985965.384141:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.384146:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.384154:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985965.384172:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985965.384201:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993414144:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985965.384208:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788985965.384243:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993414144:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788985965.384401:0:67846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf5477a0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547799 expref: 18 pid: 5846 timeout: 1849 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985965.384411:0:67846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:67846:1875885993414016:0@lo:104: 00010000:00010000:3.0:1788985965.384425:0:67846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985965.384434:0:67846:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985965.384439:0:67846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985965.384445:0:67846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf5477a7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985965.505526:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985965.568411:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993414272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788985965.568973:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985965.569426:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993414272 00000100:00100000:0.0:1788985965.569434:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993414272 00000100:00100000:0.0:1788985965.569578:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1788985965.569589:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993414272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788985965.569624:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985965.569679:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993414272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985965.569686:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 610 00000100:00100000:0.0:1788985965.569734:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993414272:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788985965.569943:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1788985966.169162:0:67896:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4ed1d1b0 20000000:00000080:0.0:1788985966.169185:0:67896:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a46319400 uarg=0000000000000000 10000000:01000000:0.0:1788985966.169234:0:67896:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985966.169254:0:67896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5477ae lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 67896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.169885:0:67896:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5477ae lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 67896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.169897:0:67896:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5477ae lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 67896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.169903:0:67896:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5477ae lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.169910:0:67896:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5477ae lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 67896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.169917:0:67896:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5477ae lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.169923:0:67896:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788985966.169927:0:67896:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5477ae lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 67896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.169934:0:67896:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5477ae lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 67896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.169946:0:67896:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5477ae lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.169953:0:67896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5477ae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.169970:0:67896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5477ae lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 67896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985966.530083:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985966.592438:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788985966.592561:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788985966.592588:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993414528:0@lo:400:kworker.0 00000100:00100000:0.0:1788985966.592672:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985966.592741:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993414528 00000100:00100000:0.0:1788985966.592750:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993414528 00000100:00100000:0.0:1788985966.592799:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1788985966.592807:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993414528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985966.592877:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993414528:12345-0@lo:400:kworker.0 Request processed in 70us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985966.592884:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1206 00000100:00100000:0.0:1788985966.592930:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993414528:0@lo:400:kworker.0 10000000:01000000:1.0:1788985966.593084:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788985966.593137:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788985966.593141:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788985966.593181:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985966.593194:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985966.593206:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985966.593225:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094242d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993414656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788985966.593264:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985966.593292:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a808db780 going to sleep for 11 seconds 00000100:00100000:0.0:1788985966.593404:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993414656 00000100:00100000:0.0:1788985966.593719:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993414656 00000100:00100000:0.0:1788985966.593809:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1788985966.593819:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993414656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985966.593833:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985966.593851:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5477bc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5477b5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.593891:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5477bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5477b5 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.593908:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5477bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5477b5 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985966.593927:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eec00, rc 0) 00000100:00100000:0.0:1788985966.593974:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993414656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985966.593980:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1788985966.594474:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993414400:0@lo:400:kworker.0 00000100:00100000:2.0:1788985966.594522:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985966.594764:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993414784:0@lo:400:kworker.0 00000100:00100000:3.0:1788985966.594811:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985966.594845:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788985966.594852:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993414912:0@lo:400:kworker.0 00000100:00100000:3.0:1788985966.594887:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985966.594944:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993414784 00000100:00100000:3.0:1788985966.594958:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993414784 00000100:00100000:3.0:1788985966.595294:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1788985966.595305:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993414784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985966.595361:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993414784:12345-0@lo:400:kworker.0 Request processed in 58us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985966.595368:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:3.0:1788985966.595397:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993414912 00000100:00100000:3.0:1788985966.595401:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993414912 00000100:00100000:3.0:1788985966.595437:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1788985966.595444:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993414912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985966.595477:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993414912:12345-0@lo:400:kworker.0 Request processed in 35us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985966.595483:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00080000:3.0:1788985966.595589:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788985966.595648:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993414912:0@lo:400:kworker.0 00000100:00100000:3.0:1788985966.595669:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993414784:0@lo:400:kworker.0 00000100:00100000:3.0:1788985966.595708:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993415040:0@lo:400:kworker.0 00000100:00100000:3.0:1788985966.595875:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985966.596288:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788985966.596297:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993415168:0@lo:400:kworker.0 00000100:00100000:3.0:1788985966.596333:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985966.596368:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993415040 00000100:00100000:3.0:1788985966.596373:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993415040 00000100:00100000:3.0:1788985966.596417:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1788985966.596425:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993415040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985966.596466:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993415040:12345-0@lo:400:kworker.0 Request processed in 43us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985966.596474:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:3.0:1788985966.596495:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993415168 00000100:00100000:3.0:1788985966.596499:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993415168 00000100:00100000:3.0:1788985966.596525:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:3.0:1788985966.596531:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993415168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985966.596576:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993415168:12345-0@lo:400:kworker.0 Request processed in 45us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985966.596583:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00080000:3.0:1788985966.596602:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788985966.596605:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788985966.596630:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993415168:0@lo:400:kworker.0 00000100:00100000:3.0:1788985966.596640:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993415040:0@lo:400:kworker.0 00000100:00100000:1.0:1788985966.597198:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993414400 00000100:00100000:1.0:1788985966.597205:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993414400 00000100:00100000:1.0:1788985966.597240:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:1.0:1788985966.597249:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993414400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985966.597324:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993414400:12345-0@lo:400:kworker.0 Request processed in 75us (2800us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985966.597332:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:2.0:1788985966.597344:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993414400:0@lo:400:kworker.0 00000100:00100000:1.0:1788985966.597489:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094242d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993414656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985966.597515:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5477bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985966.597529:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5477bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985966.597559:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788985966.597584:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5477bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985966.597592:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5477bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985967.104478:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993415296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788985967.104585:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985967.104838:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993415296 00000100:00100000:0.0:1788985967.104849:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993415296 00000100:00100000:0.0:1788985967.104917:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1788985967.104928:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993415296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985967.104975:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985967.105047:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993415296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985967.105055:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1788985967.105510:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993415296:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788985967.552426:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985968.576931:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985968.753309:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985968.753369:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985968.753387:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971191296 00000100:00100000:1.0:1788985968.753403:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971191296 00000100:00100000:1.0:1788985968.753490:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1023 00000100:00100000:1.0:1788985968.753501:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971191296:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985968.753600:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971191296:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 100us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985968.753608:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1023 00000100:00100000:3.0:1788985968.753744:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971191424 00000100:00100000:3.0:1788985968.753750:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971191424 00000100:00100000:3.0:1788985968.753817:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1209 00000100:00100000:3.0:1788985968.753826:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971191424:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788985968.753862:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971191424:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985968.753869:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1209 00000100:00080000:1.0:1788985968.754171:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788985969.600957:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985970.627867:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985970.696835:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993415424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788985970.696929:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985970.697282:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993415424 00000100:00100000:3.0:1788985970.698273:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993415424 00000100:00100000:3.0:1788985970.698497:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 612 00000100:00100000:3.0:1788985970.698509:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993415424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788985970.698566:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788985970.698648:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993415424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985970.698657:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 612 00000100:00080000:3.0:1788985970.698687:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788985970.698739:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993415424:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788985971.652242:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985971.713702:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a808cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993415808:0@lo:400:kworker.0 00000100:00100000:0.0:1788985971.713766:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985971.713817:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788985971.713824:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993415936:0@lo:400:kworker.0 00000100:00100000:0.0:1788985971.713849:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985971.713911:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993415552:0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.713954:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985971.714065:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993415552 00000100:00100000:0.0:1788985971.714079:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993415552 00000100:00100000:0.0:1788985971.714147:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1788985971.714156:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993415552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985971.714200:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993415552:12345-0@lo:400:kworker.0 Request processed in 45us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985971.714207:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:3.0:1788985971.714345:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993415552:0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.714353:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993416064:0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.714377:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985971.714422:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788985971.714428:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993415680:0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.714450:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985971.714467:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993416192:0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.714488:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985971.714526:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993415808 00000100:00100000:3.0:1788985971.714530:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993415808 00000100:00100000:3.0:1788985971.714568:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993416064 00000100:00100000:3.0:1788985971.714571:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993416064 00000100:00100000:3.0:1788985971.714587:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993415680 00000100:00100000:3.0:1788985971.714589:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993415680 00000100:00100000:3.0:1788985971.714603:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1788985971.714609:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993415808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.714646:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993415808:12345-0@lo:400:kworker.0 Request processed in 38us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985971.714652:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1210 00000100:00100000:3.0:1788985971.714665:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1788985971.714671:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993416064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.714702:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993416064:12345-0@lo:400:kworker.0 Request processed in 31us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985971.714708:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1788985971.714720:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1788985971.714726:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993415680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.714752:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993415680:12345-0@lo:400:kworker.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985971.714758:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1788985971.714778:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993415936 00000100:00100000:3.0:1788985971.714782:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993415936 00000100:00100000:3.0:1788985971.714804:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993416192 00000100:00100000:3.0:1788985971.714807:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993416192 00000100:00100000:3.0:1788985971.714824:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1788985971.714830:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993415936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.714859:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993415936:12345-0@lo:400:kworker.0 Request processed in 29us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985971.714864:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00100000:3.0:1788985971.714874:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:3.0:1788985971.714879:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993416192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.714904:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993416192:12345-0@lo:400:kworker.0 Request processed in 25us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985971.714909:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00080000:3.0:1788985971.715248:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788985971.715252:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788985971.715292:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993415936:0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.715306:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a808cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993415808:0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.715333:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993415680:0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.715341:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993416192:0@lo:400:kworker.0 00000100:00100000:3.0:1788985971.715348:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993416064:0@lo:400:kworker.0 00000100:00100000:0.0:1788985972.226523:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788985972.226542:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993416320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985972.226599:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985972.226650:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993416320 00000100:00100000:0.0:1788985972.226656:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993416320 00000100:00100000:0.0:1788985972.226696:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1788985972.226703:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993416320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985972.226731:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985972.226767:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993416320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985972.226773:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 613 00000100:00100000:0.0:1788985972.226810:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993416320:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788985972.247437:0:68188:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff992bac10 20000000:00000080:1.0:1788985972.247452:0:68188:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a797de400 uarg=0000000000000000 00010000:00010000:1.0:1788985972.247916:0:68188:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985972.247931:0:68188:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788985972.247944:0:68188:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985972.247961:0:68188:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985972.247978:0:68188:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5477bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5477b5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985972.247987:0:68188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985972.248029:0:68188:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5477bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5477b5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985972.248042:0:68188:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5477bc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5477b5 expref: 18 pid: 5846 timeout: 1856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985972.248057:0:68188:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094242d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68188:1875885993416448:0@lo:104: 00000100:00100000:1.0:1788985972.248145:0:68188:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985972.248191:0:68188:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0942afe240 going to sleep for 11 seconds 00000100:00100000:0.0:1788985972.250813:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788985972.250838:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993416448 00000100:00100000:0.0:1788985972.250845:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993416448 00000100:00100000:0.0:1788985972.250901:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788985972.250911:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7663e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:68188:x1875885993416448:12345-0@lo:104: 00010000:00010000:0.0:1788985972.250926:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5477bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251011:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985972.251028:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7663e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:68188:x1875885993416448:12345-0@lo:104: Request processed in 120us (2883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985972.251035:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00010000:00010000:0.0:1788985972.251081:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985972.251101:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5477bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251110:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788985972.251114:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5477bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251121:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5477bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788985972.251128:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5477bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985972.251133:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788985972.251165:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5477bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251171:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788985972.251190:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5477bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251196:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5477b5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5477bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251213:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985972.251215:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985972.251216:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985972.251236:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788985972.251249:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993416576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985972.251286:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985972.251319:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993416576 00000100:00100000:0.0:1788985972.251323:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993416576 00010000:00010000:0.0:1788985972.251341:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5477bc lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5477b5 expref: 19 pid: 5846 timeout: 1856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985972.251363:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788985972.251370:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993416576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985972.251379:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985972.251384:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5477bc lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5477b5 expref: 19 pid: 5846 timeout: 1856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251395:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5477bc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5477b5 expref: 19 pid: 5846 timeout: 1856 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251412:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251421:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251435:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251442:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251449:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251467:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251472:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788985972.251477:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251484:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251492:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.251501:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788985972.251541:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993416576:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985972.251547:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788985972.251584:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993416576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788985972.251689:0:68188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf5477bc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5477b5 expref: 18 pid: 5846 timeout: 1856 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985972.251700:0:68188:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094242d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68188:1875885993416448:0@lo:104: 00010000:00010000:3.0:1788985972.251714:0:68188:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985972.251722:0:68188:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985972.251728:0:68188:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985972.251734:0:68188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5477c3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985972.673802:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788985973.023588:0:68236:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcd35a8900 20000000:00000080:0.0:1788985973.023604:0:68236:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f58d000 uarg=0000000000000000 00010000:00010000:0.0:1788985973.023984:0:68236:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788985973.024000:0:68236:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788985973.024082:0:68236:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985973.024144:0:68236:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5477ca lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.024220:0:68236:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5477ca lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.024239:0:68236:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5477ca lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.024245:0:68236:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5477ca lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.024251:0:68236:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5477ca lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.024258:0:68236:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5477ca lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.024264:0:68236:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788985973.024268:0:68236:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5477ca lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.024274:0:68236:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5477ca lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.024287:0:68236:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5477ca lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.024295:0:68236:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5477ca lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.024300:0:68236:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5477ca lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985973.568299:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788985973.568309:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788985973.568315:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788985973.568390:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.568404:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.568418:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985973.568449:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993416704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788985973.569056:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985973.569627:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993416704 00000100:00100000:2.0:1788985973.569637:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993416704 00000100:00100000:2.0:1788985973.569705:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1788985973.569717:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993416704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985973.569735:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985973.569755:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0400/0xc20d828fcf5477d8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5477d1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985973.569784:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0400/0xc20d828fcf5477d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5477d1 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985973.569797:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0400/0xc20d828fcf5477d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5477d1 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985973.569820:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0400, rc 0) 00000100:00100000:2.0:1788985973.569873:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993416704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985973.569880:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1788985973.570382:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a59f52c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788985973.570415:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993416704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985973.570437:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5477d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.570449:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5477d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985973.571567:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788985973.571580:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5477d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.571592:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5477d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985973.697305:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985973.872373:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985973.872443:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985973.872572:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971191552 00000100:00100000:2.0:1788985973.872585:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971191552 00000100:00100000:2.0:1788985973.872654:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1026 00000100:00100000:2.0:1788985973.872667:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971191552:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985973.872761:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971191552:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 97us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985973.872769:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1026 00000100:00100000:3.0:1788985973.874945:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971191680 00000100:00100000:3.0:1788985973.874957:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971191680 00000100:00100000:3.0:1788985973.875027:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1213 00000100:00100000:3.0:1788985973.875037:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971191680:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788985973.875155:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971191680:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 118us (2720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985973.875171:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1213 00000100:00080000:2.0:1788985973.875181:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788985974.724770:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985975.744249:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985975.808420:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788985975.808441:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993416832:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788985975.808512:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985975.808617:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993416832 00000100:00100000:0.0:1788985975.808635:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993416832 00000100:00100000:0.0:1788985975.808693:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 614 00000100:00100000:0.0:1788985975.808702:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993416832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788985975.808734:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985975.808787:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993416832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985975.808794:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 614 00000100:00080000:2.0:1788985975.808901:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788985975.808935:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993416832:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788985976.294735:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985976.294883:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971191808 00000100:00100000:0.0:1788985976.294892:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971191808 00000100:00100000:0.0:1788985976.294968:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 510 00000100:00100000:0.0:1788985976.294980:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40183:x1875885971191808:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788985976.295000:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985976.295061:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5477df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e0c expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.295160:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5477e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.295173:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5477e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.295186:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5477e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985976.295219:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788985976.295222:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788985976.295242:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5477e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.295262:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5477df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e0c expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.295290:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5477e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e0c expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.295298:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bb00) 00010000:00010000:0.0:1788985976.295301:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788985976.295304:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef200, rc 0) 00000100:00100000:0.0:1788985976.295350:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40183:x1875885971191808:12345-192.168.206.21@tcp:101:rm.0 Request processed in 373us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985976.295356:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 510 00000100:00080000:2.0:1788985976.295416:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985976.299878:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985976.300122:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971191936 00000100:00100000:3.0:1788985976.300132:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971191936 00000100:00100000:3.0:1788985976.300190:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 511 00000100:00100000:3.0:1788985976.300199:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40183:x1875885971191936:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788985976.300218:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788985976.300386:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5477ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e13 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300449:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5477f4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300464:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5477f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300475:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5477f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300720:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5477fb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300729:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5477fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300737:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5477fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300927:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5477f4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300939:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5477f4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300945:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5477f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300951:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788985976.300966:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5477f4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300974:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5477f4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300985:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bb00) 00010000:00010000:3.0:1788985976.300988:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788985976.300992:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5477f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.300998:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5477f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.301012:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5477fb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.301017:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5477fb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.301024:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5477fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.301028:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788985976.301032:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5477fb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.301038:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5477fb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.301044:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a55745300) 00010000:00010000:3.0:1788985976.301047:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788985976.301050:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5477fb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.301056:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5477fb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.301085:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5477ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e13 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.302511:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bb00) 00010000:00010000:3.0:1788985976.302520:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788985976.302540:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5477ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e13 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.302559:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788985976.302994:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40183:x1875885971191936:12345-192.168.206.21@tcp:101:rm.0 Request processed in 2793us (3123us total) trans 0 rc 301/301 00000100:00100000:3.0:1788985976.303003:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 511 00000100:00100000:1.0:1788985976.408868:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985976.408922:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985976.409028:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971192064 00000100:00100000:0.0:1788985976.409039:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971192064 00000100:00100000:0.0:1788985976.409124:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971192320 00000100:00100000:0.0:1788985976.409128:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971192320 00000100:00100000:0.0:1788985976.409168:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 512 00000100:00100000:0.0:1788985976.409178:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971192064:12345-192.168.206.21@tcp:41:mkdir.0 00000004:00000024:0.0:1788985976.409221:0:5855:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788985976.409287:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971192064:12345-192.168.206.21@tcp:41:mkdir.0 Request processed in 111us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985976.409294:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 512 00000100:00100000:0.0:1788985976.409311:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 513 00000100:00100000:0.0:1788985976.409317:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40187:x1875885971192320:12345-192.168.206.21@tcp:36:mkdir.0 00010000:00010000:0.0:1788985976.409350:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985976.409374:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5477e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e0c expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.409408:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bb00) 00010000:00010000:0.0:1788985976.409418:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985976.409831:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547802 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.409846:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547802 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.409857:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547802 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.409874:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547809 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.409882:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547809 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.409888:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547809 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985976.413041:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00010000:00010000:0.0:1788985976.413060:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547802 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.413070:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547802 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.413079:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547802 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.413085:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985976.413124:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547802 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.413133:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547802 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.413613:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788985976.413617:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985976.413622:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547802 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.413630:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547802 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788985976.413723:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000279375a4 reply state 00000000f5ff231b transno 4294967491 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547809 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985976.413733:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788985976.413888:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40187:x1875885971192320:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 4567us (4962us total) trans 4294967491 rc 0/0 00000100:00100000:0.0:1788985976.413897:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 513 00010000:00010000:3.0:1788985976.425864:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547809 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.425882:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547809 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.425890:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547809 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.425896:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788985976.425900:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547809 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.425908:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547809 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.425923:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a4823bd00) 00010000:00010000:3.0:1788985976.425926:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788985976.425931:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547809 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.425938:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547809 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985976.499004:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985976.499573:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971192448 00000100:00100000:3.0:1788985976.499583:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971192448 00000100:00100000:3.0:1788985976.499681:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 514 00000100:00100000:3.0:1788985976.499691:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40191:x1875885971192448:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:3.0:1788985976.499713:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788985976.499733:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e1a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.499790:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547817 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.499808:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.499818:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788985976.499853:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788985976.499856:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788985976.499890:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.499912:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e1a expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.499928:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547817 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e1a expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.499936:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788985976.499938:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788985976.499941:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788985976.500003:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40191:x1875885971192448:12345-192.168.206.21@tcp:101:chown.0 Request processed in 314us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985976.500009:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 514 00000100:00100000:1.0:1788985976.504029:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985976.504356:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971192576 00000100:00100000:3.0:1788985976.504366:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971192576 00000100:00100000:3.0:1788985976.504580:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 515 00000100:00100000:3.0:1788985976.504591:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40191:x1875885971192576:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:3.0:1788985976.504612:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788985976.504635:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54781e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e21 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.504698:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547825 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.504713:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547825 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.504725:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547825 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.504739:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54782c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.504747:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54782c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.504760:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54782c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.508017:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547833 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.508041:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.508054:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788985976.508943:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:3.0:1788985976.508951:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788985976.508979:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547833 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.508994:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547825 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509001:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547825 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509008:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547825 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509014:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788985976.509019:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547825 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509026:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547825 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509040:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788985976.509043:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788985976.509048:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547825 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509054:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547825 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509071:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54782c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509077:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54782c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509083:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54782c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509295:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788985976.509299:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54782c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509305:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54782c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509314:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a55745000) 00010000:00010000:3.0:1788985976.509316:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788985976.509320:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54782c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509326:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54782c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509365:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54781e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e21 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509589:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547833 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e21 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.509598:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:3.0:1788985976.509600:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788985976.509603:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788985976.509715:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:40191:x1875885971192576:12345-192.168.206.21@tcp:101:chown.0 Request processed in 5124us (5694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985976.509723:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 515 00000100:00100000:1.0:1788985976.519290:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985976.519683:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971192832 00000100:00100000:1.0:1788985976.519697:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971192832 00000100:00100000:2.0:1788985976.520310:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 516 00000100:00100000:2.0:1788985976.520336:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:40191:x1875885971192832:12345-192.168.206.21@tcp:36:chown.0 00010000:00010000:2.0:1788985976.520526:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985976.520554:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547833 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e21 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985976.520594:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:2.0:1788985976.520605:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788985976.520637:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54783a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985976.520649:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54783a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985976.520658:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54783a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788985976.521620:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000387b3ecc reply state 00000000bc8beaef transno 4294967492 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54783a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985976.521634:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788985976.521644:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000100:00100000:2.0:1788985976.521757:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:40191:x1875885971192832:12345-192.168.206.21@tcp:36:chown.0 Request processed in 1431us (2482us total) trans 4294967492 rc 0/0 00000100:00100000:2.0:1788985976.521766:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 516 00010000:00010000:3.0:1788985976.525689:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54783a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.525714:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54783a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.525724:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54783a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.525732:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788985976.525737:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54783a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.525746:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54783a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.525767:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:3.0:1788985976.525771:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788985976.525778:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54783a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985976.525784:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54783a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985976.768602:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985976.832561:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993417088:0@lo:400:kworker.0 00000100:00100000:0.0:1788985976.832629:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985976.832680:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993417600:0@lo:400:kworker.0 00000100:00100000:0.0:1788985976.832704:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985976.832726:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788985976.832731:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993417216:0@lo:400:kworker.0 00000100:00100000:0.0:1788985976.832750:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985976.832799:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993417088 00000100:00100000:0.0:1788985976.832807:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993417088 00000100:00100000:0.0:1788985976.832844:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993417216 00000100:00100000:0.0:1788985976.832847:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993417216 00000100:00100000:0.0:1788985976.832873:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1214 00000100:00100000:0.0:1788985976.832881:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993417088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985976.832930:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993417088:12345-0@lo:400:kworker.0 Request processed in 49us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985976.832937:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1214 00000100:00100000:1.0:1788985976.833175:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993417088:0@lo:400:kworker.0 00000100:00100000:3.0:1788985976.833442:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993416960:0@lo:400:kworker.0 00000100:00100000:3.0:1788985976.833478:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985976.833519:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993417472:0@lo:400:kworker.0 00000100:00100000:3.0:1788985976.833542:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985976.833561:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788985976.833566:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993417344:0@lo:400:kworker.0 00000100:00100000:3.0:1788985976.833588:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985976.833616:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993417472 00000100:00100000:3.0:1788985976.833620:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993417472 00000100:00080000:2.0:1788985976.833714:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985976.833896:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:0.0:1788985976.833907:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993417216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985976.834968:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993417216:12345-0@lo:400:kworker.0 Request processed in 1059us (2211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985976.835046:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993417216:0@lo:400:kworker.0 00000100:00100000:3.0:1788985976.835400:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1788985976.835416:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993417472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985976.835482:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993417472:12345-0@lo:400:kworker.0 Request processed in 72us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985976.835499:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:3.0:1788985976.835530:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993417600 00000100:00100000:3.0:1788985976.835535:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993417600 00000100:00100000:3.0:1788985976.835575:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993417344 00000100:00100000:3.0:1788985976.835578:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993417344 00000100:00100000:3.0:1788985976.835598:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:3.0:1788985976.835605:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993417600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985976.835636:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993417600:12345-0@lo:400:kworker.0 Request processed in 31us (2930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985976.835642:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:3.0:1788985976.835654:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1788985976.835660:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993417344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985976.835686:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993417344:12345-0@lo:400:kworker.0 Request processed in 26us (2097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985976.835691:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:3.0:1788985976.835712:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993416960 00000100:00100000:3.0:1788985976.835716:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993416960 00000100:00100000:3.0:1788985976.835738:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1788985976.835743:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993416960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985976.835772:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993416960:12345-0@lo:400:kworker.0 Request processed in 29us (2293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985976.835781:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00080000:3.0:1788985976.835822:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788985976.835855:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993417344:0@lo:400:kworker.0 00000100:00100000:3.0:1788985976.835865:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993416960:0@lo:400:kworker.0 00000100:00100000:3.0:1788985976.835875:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993417472:0@lo:400:kworker.0 00000100:00100000:1.0:1788985976.836111:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993417600:0@lo:400:kworker.0 00000100:00100000:0.0:1788985976.842903:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000020:00000080:2.0:1788985977.259721:0:68433:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7b7ec400 20000000:00000080:2.0:1788985977.259738:0:68433:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a8207ac00 uarg=0000000000000000 00010000:00010000:2.0:1788985977.260266:0:68433:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788985977.260301:0:68433:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:2.0:1788985977.260305:0:68433:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788985977.260315:0:68433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547817 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e1a expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985977.260351:0:68433:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1788985977.260369:0:68433:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788985977.260385:0:68433:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985977.260605:0:68433:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0400/0xc20d828fcf5477d8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5477d1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985977.260615:0:68433:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985977.260650:0:68433:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0400/0xc20d828fcf5477d8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5477d1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985977.260664:0:68433:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0400/0xc20d828fcf5477d8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5477d1 expref: 18 pid: 5846 timeout: 1861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985977.260678:0:68433:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68433:1875885993417728:0@lo:104: 00000100:00100000:2.0:1788985977.260734:0:68433:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985977.260853:0:68433:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a6b2f90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788985977.260931:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993417728 00000100:00100000:3.0:1788985977.260938:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993417728 00000100:00100000:3.0:1788985977.261017:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788985977.261027:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:68433:x1875885993417728:12345-0@lo:104: 00010000:00010000:3.0:1788985977.261039:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5477d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985977.261123:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788985977.261128:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:68433:x1875885993417728:12345-0@lo:104: Request processed in 104us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985977.261135:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00010000:00010000:1.0:1788985977.261185:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788985977.261191:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5477d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261211:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788985977.261215:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5477d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261223:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5477d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788985977.261230:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5477d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985977.261236:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788985977.261264:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5477d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261272:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788985977.261291:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5477d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261297:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf5477d1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5477d8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261313:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985977.261314:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985977.261316:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985977.261337:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993417856:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788985977.261368:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985977.261421:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993417856 00000100:00100000:1.0:1788985977.261426:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993417856 00010000:00010000:1.0:1788985977.261444:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0400/0xc20d828fcf5477d8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5477d1 expref: 19 pid: 5846 timeout: 1861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985977.261474:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788985977.261491:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993417856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985977.261501:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788985977.261506:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0400/0xc20d828fcf5477d8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5477d1 expref: 19 pid: 5846 timeout: 1861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261516:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0400/0xc20d828fcf5477d8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5477d1 expref: 19 pid: 5846 timeout: 1861 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261529:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261537:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261549:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261557:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261564:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261570:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261576:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788985977.261580:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261593:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261601:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985977.261609:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788985977.261639:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993417856:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985977.261646:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788985977.261680:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094242f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993417856:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985977.261781:0:68433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0400/0xc20d828fcf5477d8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5477d1 expref: 18 pid: 5846 timeout: 1861 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985977.261791:0:68433:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68433:1875885993417728:0@lo:104: 00010000:00010000:2.0:1788985977.261803:0:68433:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985977.261812:0:68433:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985977.261823:0:68433:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985977.261830:0:68433:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf547841 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68433 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985977.344235:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788985977.344257:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993417984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985977.344328:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985977.344391:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993417984 00000100:00100000:0.0:1788985977.344411:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993417984 00000100:00100000:0.0:1788985977.344460:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 615 00000100:00100000:0.0:1788985977.344468:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993417984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985977.344512:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985977.344555:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993417984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985977.344562:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 615 00000100:00100000:0.0:1788985977.344606:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993417984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788985977.799258:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788985978.113776:0:68481:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc1426a020 20000000:00000080:1.0:1788985978.113792:0:68481:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a797dec00 uarg=0000000000000000 00010000:00010000:1.0:1788985978.114001:0:68481:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985978.114015:0:68481:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788985978.114028:0:68481:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985978.114046:0:68481:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547848 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.114061:0:68481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547848 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.114071:0:68481:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547848 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.114078:0:68481:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547848 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.114084:0:68481:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547848 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.114661:0:68481:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547848 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.114668:0:68481:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788985978.114672:0:68481:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547848 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.114680:0:68481:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547848 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.114694:0:68481:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547848 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.114702:0:68481:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547848 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.114708:0:68481:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547848 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985978.497350:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788985978.497358:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788985978.497363:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788985978.497406:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.497419:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.497430:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985978.497463:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094242f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993418112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788985978.497536:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985978.497579:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788985978.497601:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993418112 00000100:00100000:1.0:1788985978.497608:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993418112 00000100:00100000:1.0:1788985978.497653:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1788985978.497662:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993418112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985978.497674:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985978.497686:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547856 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54784f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.497708:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547856 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54784f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.497719:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547856 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54784f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.497728:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788985978.497767:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993418112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985978.497774:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1788985978.497814:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094242f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993418112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985978.497827:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.497836:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788985978.497861:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788985978.497866:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.497873:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985978.816317:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985978.999082:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985978.999155:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985979.001170:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971193088 00000100:00100000:0.0:1788985979.001191:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971193088 00000100:00100000:0.0:1788985979.001326:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1217 00000100:00100000:0.0:1788985979.001338:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971193088:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985979.001443:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971193088:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 106us (2375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985979.001461:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1217 00000100:00100000:3.0:1788985979.002702:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971192960 00000100:00100000:3.0:1788985979.002714:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971192960 00000100:00100000:3.0:1788985979.002769:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1029 00000100:00100000:3.0:1788985979.002779:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971192960:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788985979.002838:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971192960:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 61us (3683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985979.002845:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1029 00000100:00080000:3.0:1788985979.002881:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1788985979.007931:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967491 is committed 00000001:00080000:1.0:1788985979.007967:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967492 is committed 00010000:00010000:2.0:1788985979.840304:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985980.864447:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985980.929141:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993418240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788985980.929258:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985980.931930:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993418240 00000100:00100000:0.0:1788985980.931957:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993418240 00000100:00100000:0.0:1788985980.932041:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 616 00000100:00100000:0.0:1788985980.932053:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993418240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788985980.932129:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788985980.932564:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788985980.941551:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993418240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 9487us (12279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985980.941570:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 616 00000100:00100000:1.0:1788985980.945118:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993418240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788985981.443412:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985981.443547:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971193216 00000100:00100000:0.0:1788985981.443556:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971193216 00000100:00100000:0.0:1788985981.443634:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00100000:0.0:1788985981.443644:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5588:x1875885971193216:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788985981.443658:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985981.443661:0:5841:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf547817) 00010000:00010000:0.0:1788985981.443662:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788985981.443708:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5588:x1875885971193216:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 65us (305us total) trans 0 rc 116/116 00000100:00100000:0.0:1788985981.443715:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 9 00000100:00080000:3.0:1788985981.443806:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788985981.890438:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985981.953767:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993418624:0@lo:400:kworker.0 00000100:00100000:1.0:1788985981.953767:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993418368:0@lo:400:kworker.0 00000100:00100000:2.0:1788985981.953831:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993418496:0@lo:400:kworker.0 00000100:00100000:1.0:1788985981.956770:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985981.956830:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993418880:0@lo:400:kworker.0 00000100:00100000:1.0:1788985981.956866:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985981.957802:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993418880 00000100:00100000:1.0:1788985981.957811:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993418880 00000100:00100000:1.0:1788985981.957875:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:1.0:1788985981.957885:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993418880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985981.957947:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993418368 00000100:00100000:0.0:1788985981.957951:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993418368 00000100:00100000:1.0:1788985981.957964:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993418880:12345-0@lo:400:kworker.0 Request processed in 81us (1097us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985981.957978:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:0.0:1788985981.957983:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993418368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985981.957986:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:0.0:1788985981.958018:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993418368:12345-0@lo:400:kworker.0 Request processed in 34us (1254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985981.958024:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1788985981.958034:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993418752:0@lo:400:kworker.0 00000100:00100000:1.0:1788985981.958066:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985981.958136:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993418368:0@lo:400:kworker.0 00000100:00100000:0.0:1788985981.958145:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993418752 00000100:00100000:0.0:1788985981.958149:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993418752 00000100:00100000:1.0:1788985981.958151:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993418880:0@lo:400:kworker.0 00000100:00100000:0.0:1788985981.958175:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:0.0:1788985981.958180:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993418752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985981.958218:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993418752:12345-0@lo:400:kworker.0 Request processed in 38us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985981.958225:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1788985981.958242:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993418752:0@lo:400:kworker.0 00000100:00100000:2.0:1788985981.961072:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985981.961262:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993419008:0@lo:400:kworker.0 00000100:00100000:2.0:1788985981.961314:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985981.961517:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993418496 00000100:00100000:2.0:1788985981.961524:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993418496 00000100:00100000:2.0:1788985981.961567:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:2.0:1788985981.961574:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993418496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985981.961620:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993418496:12345-0@lo:400:kworker.0 Request processed in 46us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985981.961625:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:2.0:1788985981.961676:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993418496:0@lo:400:kworker.0 00000100:00080000:2.0:1788985981.961928:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985981.962136:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993419008 00000100:00100000:0.0:1788985981.962142:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993419008 00000100:00100000:0.0:1788985981.962177:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:0.0:1788985981.962183:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993419008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985981.962226:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993419008:12345-0@lo:400:kworker.0 Request processed in 42us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985981.962232:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00080000:2.0:1788985981.962280:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788985981.962300:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993419008:0@lo:400:kworker.0 00000100:00100000:3.0:1788985981.962685:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985981.962766:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993418624 00000100:00100000:2.0:1788985981.962771:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993418624 00000100:00100000:2.0:1788985981.962816:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1788985981.962830:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993418624:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788985981.962925:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788985981.963078:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993418624:12345-0@lo:400:kworker.0 Request processed in 248us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985981.963085:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:3.0:1788985981.964990:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993418624:0@lo:400:kworker.0 00000100:00100000:1.0:1788985982.466427:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993419136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985982.466502:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985982.466577:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993419136 00000100:00100000:1.0:1788985982.466585:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993419136 00000100:00100000:1.0:1788985982.466653:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1788985982.466662:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993419136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788985982.466698:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788985982.466759:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993419136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985982.466766:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 617 00000100:00100000:1.0:1788985982.466811:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993419136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788985982.919566:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788985983.009607:0:68726:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff353e41a0 20000000:00000080:1.0:1788985983.009622:0:68726:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a797dc800 uarg=0000000000000000 00010000:00010000:1.0:1788985983.010076:0:68726:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788985983.010578:0:68726:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788985983.010598:0:68726:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788985983.010615:0:68726:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985983.010639:0:68726:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547856 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54784f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985983.010648:0:68726:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985983.010682:0:68726:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547856 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54784f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985983.010696:0:68726:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547856 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54784f expref: 18 pid: 5846 timeout: 1866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985983.010710:0:68726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094242e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68726:1875885993419264:0@lo:104: 00000100:00100000:1.0:1788985983.010763:0:68726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985983.010815:0:68726:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09426a6240 going to sleep for 11 seconds 00000100:00100000:0.0:1788985983.010879:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993419264 00000100:00100000:0.0:1788985983.010885:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993419264 00000100:00100000:0.0:1788985983.010933:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788985983.010942:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:68726:x1875885993419264:12345-0@lo:104: 00010000:00010000:0.0:1788985983.010955:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985983.011018:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985983.011025:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:68726:x1875885993419264:12345-0@lo:104: Request processed in 84us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985983.011031:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788985983.011119:0:68726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094242e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68726:1875885993419264:0@lo:104: 00010000:00010000:3.0:1788985983.011137:0:68726:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011215:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985983.011223:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011230:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788985983.011234:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011241:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985983.011248:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985983.011254:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985983.011288:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011294:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985983.011319:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011326:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54784f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547856 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011342:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985983.011350:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985983.011352:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985983.011359:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788985983.011368:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993419392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985983.011398:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985983.011432:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993419392 00000100:00100000:2.0:1788985983.011435:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993419392 00010000:00010000:2.0:1788985983.011465:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547856 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54784f expref: 19 pid: 5846 timeout: 1866 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985983.011486:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788985983.011492:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993419392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985983.011502:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985983.011506:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547856 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54784f expref: 19 pid: 5846 timeout: 1866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011515:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547856 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54784f expref: 19 pid: 5846 timeout: 1866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011526:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547856 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54784f expref: 19 pid: 5846 timeout: 1866 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011539:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011546:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011557:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011574:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011581:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011588:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011593:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985983.011597:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011604:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011614:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985983.011622:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985983.011649:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993419392:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985983.011656:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788985983.011705:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993419392:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788985983.011876:0:68726:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985983.011885:0:68726:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985983.011891:0:68726:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54785d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985983.937068:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788985984.064237:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788985984.064249:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788985984.064255:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788985984.064325:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985984.064340:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985984.064354:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985984.064390:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993419520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788985984.064668:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985984.064868:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c61540 going to sleep for 11 seconds 00000100:00100000:1.0:1788985984.068685:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993419520 00000100:00100000:1.0:1788985984.068703:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993419520 00000100:00100000:0.0:1788985984.071959:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1788985984.071976:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993419520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985984.072001:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985984.072028:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54786b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547864 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985984.072068:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54786b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547864 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985984.072080:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54786b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547864 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985984.072127:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788985984.072222:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993419520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 250us (7555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985984.072228:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:3.0:1788985984.073068:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993419520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788985984.073120:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54786b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985984.073133:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54786b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788985984.073158:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788985984.073164:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54786b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985984.073173:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54786b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985984.112644:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985984.112707:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985984.112896:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971193472 00000100:00100000:3.0:1788985984.112909:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971193472 00000100:00100000:3.0:1788985984.113005:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1221 00000100:00100000:3.0:1788985984.113018:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971193472:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788985984.113129:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971193472:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 114us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985984.113138:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1221 00000100:00080000:2.0:1788985984.113452:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985984.113524:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971193344 00000100:00100000:1.0:1788985984.113531:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971193344 00000100:00100000:1.0:1788985984.113574:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1032 00000100:00100000:1.0:1788985984.113583:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971193344:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985984.113617:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971193344:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985984.113624:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1032 00010000:00010000:2.0:1788985984.962232:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985985.744757:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985985.744823:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971193600 00000100:00100000:0.0:1788985985.744832:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971193600 00000100:00100000:0.0:1788985985.744928:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 517 00000100:00100000:0.0:1788985985.744938:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40369:x1875885971193600:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788985985.744958:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985985.744979:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547872 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e28 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985985.745049:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547879 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985985.745062:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985985.745074:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985985.745137:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788985985.745141:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788985985.745161:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547879 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985985.745181:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547872 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e28 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985985.745198:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547879 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e28 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985985.745206:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:0.0:1788985985.745209:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788985985.745212:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eea00, rc 0) 00000100:00100000:0.0:1788985985.745272:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40369:x1875885971193600:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 335us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985985.745279:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 517 00000100:00100000:2.0:1788985985.753507:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985985.754036:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971193728 00000100:00100000:1.0:1788985985.754046:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971193728 00000100:00100000:1.0:1788985985.754120:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 518 00000100:00100000:1.0:1788985985.754130:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40369:x1875885971193728:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788985985.754150:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985985.754170:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e2f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754226:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547887 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754241:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754251:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754265:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54788e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754272:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54788e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754279:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54788e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754541:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547895 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754549:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754557:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788985985.754597:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:1.0:1788985985.754601:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788985985.754622:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547895 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754634:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754640:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547887 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754647:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754652:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985985.754655:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754662:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547887 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754673:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:1.0:1788985985.754676:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985985.754680:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754686:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754696:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54788e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754710:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54788e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754715:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54788e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754720:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985985.754722:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54788e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754728:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54788e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754734:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a45316f00) 00010000:00010000:1.0:1788985985.754736:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985985.754739:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54788e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754744:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54788e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754770:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e2f expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754782:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547895 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e2f expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985985.754789:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:1.0:1788985985.754792:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788985985.754799:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788985985.754851:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40369:x1875885971193728:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 724us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985985.754871:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 518 00000100:00100000:1.0:1788985985.760541:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985985.761580:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971193984 00000100:00100000:2.0:1788985985.761592:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971193984 00000100:00100000:2.0:1788985985.761658:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 519 00000100:00100000:2.0:1788985985.761668:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40369:x1875885971193984:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788985985.761716:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985985.761741:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547895 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e2f expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985985.761759:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:2.0:1788985985.761769:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788985985.761792:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54789c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985985.761805:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54789c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985985.761814:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54789c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788985985.796612:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967493 is committed 00000004:00010000:2.0:1788985985.800178:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a2e8f09b reply state 000000003d9c1cbe transno 4294967493 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54789c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985985.800195:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788985985.800211:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00010000:00080000:2.0:1788985985.800352:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788985985.800378:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40369:x1875885971193984:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 38707us (39842us total) trans 4294967493 rc 0/0 00000100:00100000:2.0:1788985985.800387:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 519 00010000:00010000:0.0:1788985985.800509:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54789c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985985.800532:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54789c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985985.800540:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54789c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985985.800547:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985985.800551:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54789c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985985.800559:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54789c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985985.800573:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:0.0:1788985985.800576:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788985985.800580:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54789c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985985.800586:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54789c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985985.991232:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985986.056244:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788985986.056275:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993419648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788985986.056342:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985986.056865:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993419648 00000100:00100000:3.0:1788985986.056873:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993419648 00000100:00100000:3.0:1788985986.056939:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 618 00000100:00100000:3.0:1788985986.056949:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993419648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788985986.056983:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788985986.057039:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993419648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985986.057045:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 618 00000100:00080000:2.0:1788985986.057105:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788985986.057117:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993419648:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788985986.731643:0:68921:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb5925440 20000000:00000080:3.0:1788985986.731661:0:68921:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f424400 uarg=0000000000000000 00010000:00010000:3.0:1788985986.732418:0:68921:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788985986.732464:0:68921:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:3.0:1788985986.732468:0:68921:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788985986.732478:0:68921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547879 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e28 expref: 5 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985986.732500:0:68921:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1788985986.732575:0:68921:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788985986.732594:0:68921:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985986.732607:0:68921:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54786b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547864 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985986.732615:0:68921:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985986.732651:0:68921:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54786b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547864 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985986.732666:0:68921:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54786b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547864 expref: 18 pid: 5846 timeout: 1870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985986.732686:0:68921:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68921:1875885993419776:0@lo:104: 00000100:00100000:3.0:1788985986.732746:0:68921:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985986.732864:0:68921:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a511f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1788985986.733076:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993419776 00000100:00100000:1.0:1788985986.733083:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993419776 00000100:00100000:0.0:1788985986.733348:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788985986.733359:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:68921:x1875885993419776:12345-0@lo:104: 00010000:00010000:0.0:1788985986.733371:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54786b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985986.733441:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985986.733447:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:68921:x1875885993419776:12345-0@lo:104: Request processed in 91us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985986.733466:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00010000:00010000:2.0:1788985986.733513:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985986.733530:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54786b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.733538:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788985986.733542:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54786b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.733551:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54786b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788985986.733557:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54786b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985986.733564:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788985986.733595:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54786b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.733601:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788985986.733620:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54786b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.733626:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547864 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54786b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.733641:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985986.733643:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985986.733645:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985986.733775:0:68921:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:68921:1875885993419776:0@lo:104: 00010000:00010000:3.0:1788985986.733794:0:68921:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985986.733839:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993419904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788985986.733870:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985986.734040:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993419904 00000100:00100000:2.0:1788985986.734045:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993419904 00010000:00010000:2.0:1788985986.734067:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54786b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547864 expref: 19 pid: 5846 timeout: 1870 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985986.734157:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:2.0:1788985986.734165:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993419904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985986.734175:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788985986.734180:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54786b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547864 expref: 19 pid: 5846 timeout: 1870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.734189:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54786b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547864 expref: 19 pid: 5846 timeout: 1870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.734200:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54786b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547864 expref: 19 pid: 5846 timeout: 1870 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.734212:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.734220:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.734232:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.734239:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.734245:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.734264:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.734269:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985986.734273:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.734280:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.734294:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985986.734303:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788985986.734335:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993419904:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985986.734341:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00010000:00010000:3.0:1788985986.734397:0:68921:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985986.734404:0:68921:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985986.734410:0:68921:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5478a3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 68921 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985986.735342:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436ead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993419904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788985987.008190:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985987.072448:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993420032:0@lo:400:kworker.0 00000100:00100000:2.0:1788985987.072524:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985987.072652:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993420032 00000100:00100000:0.0:1788985987.072659:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993420032 00000100:00100000:0.0:1788985987.072720:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:0.0:1788985987.072731:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993420032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985987.074675:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993420160:0@lo:400:kworker.0 00000100:00100000:1.0:1788985987.074731:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985987.074787:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993420160 00000100:00100000:1.0:1788985987.074793:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993420160 00000100:00100000:1.0:1788985987.074838:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1788985987.074846:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993420160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985987.074887:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993420160:12345-0@lo:400:kworker.0 Request processed in 42us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985987.074893:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00080000:1.0:1788985987.074912:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985987.074937:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993420160:0@lo:400:kworker.0 00000100:00100000:2.0:1788985987.076790:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993420032:0@lo:400:kworker.0 00000100:00100000:1.0:1788985987.082994:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993420288:0@lo:400:kworker.0 00000100:00100000:3.0:1788985987.083043:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993420416:0@lo:400:kworker.0 00000100:00100000:0.0:1788985987.084545:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993420032:12345-0@lo:400:kworker.0 Request processed in 11810us (12015us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985987.084559:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:1.0:1788985987.086523:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985987.087508:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788985987.087541:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993420544:0@lo:400:kworker.0 00000100:00100000:1.0:1788985987.087584:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985987.089049:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985987.089143:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993420416 00000100:00100000:2.0:1788985987.089152:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993420416 00000100:00100000:2.0:1788985987.089440:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:2.0:1788985987.089450:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993420416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985987.089505:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993420416:12345-0@lo:400:kworker.0 Request processed in 56us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985987.089524:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00080000:3.0:1788985987.089625:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788985987.089655:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993420416:0@lo:400:kworker.0 00000100:00100000:0.0:1788985987.091465:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993420288 00000100:00100000:0.0:1788985987.091477:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993420288 00000100:00100000:3.0:1788985987.091496:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993420544 00000100:00100000:3.0:1788985987.091504:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993420544 00000100:00100000:0.0:1788985987.091543:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1788985987.091551:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1788985987.091556:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993420288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985987.091565:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993420544:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788985987.094201:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788985987.096370:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993420288:12345-0@lo:400:kworker.0 Request processed in 4812us (9844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985987.096385:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:1.0:1788985987.096885:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941f7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993420288:0@lo:400:kworker.0 00000100:00100000:3.0:1788985987.097068:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993420544:12345-0@lo:400:kworker.0 Request processed in 5505us (9481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985987.097076:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1788985987.097182:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993420544:0@lo:400:kworker.0 00000100:00100000:0.0:1788985987.584316:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993420672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788985987.584377:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985987.584451:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993420672 00000100:00100000:0.0:1788985987.584458:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993420672 00000100:00100000:0.0:1788985987.584501:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1788985987.584509:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993420672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985987.584551:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985987.584886:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993420672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 377us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985987.584904:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 619 00000100:00100000:0.0:1788985987.584950:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993420672:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1788985987.840373:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788985987.840380:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788985987.840384:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788985987.840440:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985987.840451:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985987.840461:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985987.840484:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993420800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788985987.840547:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985987.840670:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993420800 00000100:00100000:0.0:1788985987.840678:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993420800 00000100:00100000:0.0:1788985987.840722:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1788985987.840730:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993420800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788985987.840743:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985987.840758:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5478b1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5478aa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985987.840780:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5478b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5478aa expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985987.840791:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5478b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5478aa expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985987.840800:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efc00, rc 0) 00000100:00100000:0.0:1788985987.840833:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993420800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985987.840840:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:2.0:1788985987.840910:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c1600 going to sleep for 11 seconds 00000100:00100000:2.0:1788985987.840932:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436e9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993420800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985987.840944:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5478b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985987.840952:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5478b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788985987.840969:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788985987.840973:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5478b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985987.840980:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5478b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985988.032811:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985989.056268:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788985989.233993:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985989.234044:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985989.234071:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971194112 00000100:00100000:1.0:1788985989.234080:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971194112 00000100:00100000:1.0:1788985989.234144:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1034 00000100:00100000:1.0:1788985989.234153:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971194112:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985989.234216:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971194112:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 64us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985989.234223:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1034 00000100:00100000:3.0:1788985989.235360:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971194240 00000100:00100000:3.0:1788985989.235369:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971194240 00000100:00100000:3.0:1788985989.235444:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1225 00000100:00100000:3.0:1788985989.235454:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971194240:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788985989.235514:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971194240:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 61us (1526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985989.235521:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1225 00000100:00080000:0.0:1788985989.236634:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985989.718589:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985989.718677:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971194368 00000100:00100000:0.0:1788985989.718687:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971194368 00000100:00100000:0.0:1788985989.718797:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 520 00000100:00100000:0.0:1788985989.718809:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40445:x1875885971194368:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788985989.718827:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985989.718859:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5478b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e36 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.718917:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5478bf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.718930:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5478bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.718942:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5478bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.718954:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5478c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.718961:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5478c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.718968:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5478c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719508:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5478cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719519:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5478cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719540:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5478cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788985989.719562:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:1.0:1788985989.719565:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788985989.719583:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5478cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719594:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5478bf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719610:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5478bf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719616:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5478bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719622:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985989.719625:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5478bf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719633:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5478bf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719644:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:1.0:1788985989.719647:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985989.719651:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5478bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719667:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5478bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719678:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5478c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719684:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5478c6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719690:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5478c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719694:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985989.719702:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5478c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719708:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5478c6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719715:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a4823bd00) 00010000:00010000:1.0:1788985989.719718:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985989.719721:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5478c6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719726:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5478c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719758:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5478b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e36 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719774:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5478cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e36 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.719782:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316f00) 00010000:00010000:1.0:1788985989.719784:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788985989.719787:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788985989.719849:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941f7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40445:x1875885971194368:12345-192.168.206.21@tcp:101:touch.0 Request processed in 1042us (1267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985989.719857:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 520 00000100:00100000:1.0:1788985989.725979:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985989.726123:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971194624 00000100:00100000:2.0:1788985989.726132:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971194624 00000100:00100000:2.0:1788985989.726181:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 521 00000100:00100000:2.0:1788985989.726191:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40445:x1875885971194624:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788985989.726210:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985989.726229:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5478d4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e3d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.726619:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5478db lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.726633:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5478db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.726643:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5478db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.726675:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf5478e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.726684:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf5478e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.726691:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf5478e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788985989.727721:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x11:0x0], index 0: 0 00010000:00010000:2.0:1788985989.728524:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5478e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.728546:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5478e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.728556:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5478e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.728597:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5478db lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.728604:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5478db lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.728611:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5478db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.728617:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985989.728622:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5478db lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.728629:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5478db lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.728639:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316f00) 00010000:00010000:2.0:1788985989.728642:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985989.728646:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5478db lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.728652:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5478db lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788985989.728664:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000912fad88 reply state 00000000b04e9a16 transno 4294967494 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf5478e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985989.728673:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788985989.728706:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5478d4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e3d expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.728718:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5478e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e3d expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.728725:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:2.0:1788985989.728727:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788985989.728729:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788985989.728834:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:40445:x1875885971194624:12345-192.168.206.21@tcp:101:touch.0 Request processed in 2644us (2863us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1788985989.728842:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 521 00010000:00010000:0.0:1788985989.731080:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf5478e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.731124:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf5478e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.731137:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf5478e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.731143:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985989.731148:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf5478e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.731169:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf5478e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.731184:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a45acac00) 00010000:00010000:0.0:1788985989.731187:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985989.731193:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf5478e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.731199:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf5478e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985989.731944:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985989.732540:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971194880 00000100:00100000:3.0:1788985989.732550:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971194880 00000100:00100000:3.0:1788985989.732602:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 522 00000100:00100000:3.0:1788985989.732611:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:40445:x1875885971194880:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:3.0:1788985989.732666:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788985989.732688:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5478e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e3d expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985989.732703:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:3.0:1788985989.732712:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788985989.732751:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5478f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985989.732762:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5478f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985989.732771:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5478f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788985989.732900:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d2e99305 reply state 00000000efc0e1d3 transno 4294967495 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5478f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985989.732913:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788985989.732991:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:40445:x1875885971194880:12345-192.168.206.21@tcp:36:touch.0 Request processed in 380us (1052us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1788985989.732999:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 522 00010000:00010000:1.0:1788985989.737260:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5478f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.737289:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5478f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.737297:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5478f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.737303:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985989.737308:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5478f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.737326:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5478f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.737341:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:1.0:1788985989.737344:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985989.737349:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5478f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.737355:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5478f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985989.738563:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985989.738629:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971195008 00000100:00100000:0.0:1788985989.738638:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971195008 00000100:00100000:0.0:1788985989.738685:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 523 00000100:00100000:0.0:1788985989.738694:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:40445:x1875885971195008:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788985989.738716:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985989.738734:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5478fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e44 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.738784:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5478fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e44 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.738797:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5478fe lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e44 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.738814:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9b0a4823b000) 00010000:00010000:0.0:1788985989.738817:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788985989.738830:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eec00, rc 0) 00000100:00100000:0.0:1788985989.738892:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:40445:x1875885971195008:12345-192.168.206.21@tcp:101:touch.0 Request processed in 199us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985989.738898:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 523 00000100:00100000:3.0:1788985989.748384:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985989.748423:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971195136 00000100:00100000:2.0:1788985989.748433:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971195136 00000100:00100000:2.0:1788985989.748483:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 276 00000100:00100000:2.0:1788985989.748491:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1875885971195136:12345-192.168.206.21@tcp:8:touch.0 00010000:00080000:2.0:1788985989.748523:0:8478:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 1773 last 0 00000020:00000080:2.0:1788985989.748553:0:8478:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf547905 00002000:00100000:2.0:1788985989.748565:0:8478:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b0a76050000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788985989.748587:0:8478:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788985989.748800:0:8478:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788985989.748832:0:8478:0:(import.c:65:import_set_state_nolock()) ffff9b0a76051800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788985989.748905:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971195136:12345-192.168.206.21@tcp:8:touch.0 Request processed in 413us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985989.748916:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 276 00000100:00100000:1.0:1788985989.751479:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985989.751572:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971195264 00000100:00100000:3.0:1788985989.751579:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971195264 00000100:00100000:3.0:1788985989.751653:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 277 00000100:00100000:3.0:1788985989.751663:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:0:x1875885971195264:12345-192.168.206.21@tcp:2:touch.0 00000100:00080000:0.0:1788985989.751932:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788985989.842125:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000001:00080000:2.0:1788985989.842146:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967329 is committed 00000100:00100000:3.0:1788985989.842374:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:0:x1875885971195264:12345-192.168.206.21@tcp:2:touch.0 Request processed in 90707us (90897us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1788985989.842385:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 277 00000100:00100000:1.0:1788985989.852217:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985989.852306:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971195520 00000100:00100000:3.0:1788985989.852315:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971195520 00000100:00100000:3.0:1788985989.852378:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:3.0:1788985989.852388:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:40445:x1875885971195520:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:3.0:1788985989.852714:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:40445:x1875885971195520:12345-192.168.206.21@tcp:35:touch.0 Request processed in 327us (506us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788985989.852722:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 54 00000100:00100000:2.0:1788985989.930928:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985989.931077:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971195648 00000100:00100000:1.0:1788985989.931086:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971195648 00000100:00100000:1.0:1788985989.931173:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 524 00000100:00100000:1.0:1788985989.931182:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:40449:x1875885971195648:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788985989.931205:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985989.931236:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54790c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e4b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931296:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547913 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931310:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547913 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931320:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547913 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931500:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54791a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931508:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54791a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931515:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54791a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931596:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547921 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931606:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931612:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788985989.931644:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2b:0x0]: returning size 0 00000004:00200000:1.0:1788985989.931648:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788985989.931666:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931685:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547921 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931693:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547913 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931769:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547913 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931836:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547913 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931842:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985989.931847:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547913 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931854:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547913 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.931867:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316f00) 00010000:00010000:1.0:1788985989.931870:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985989.931874:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547913 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.932036:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547913 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.932052:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54791a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.932058:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54791a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.932073:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54791a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.932079:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985989.932081:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54791a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.932449:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54791a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.932460:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a45316500) 00010000:00010000:1.0:1788985989.932463:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985989.932466:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54791a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.932472:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54791a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.932505:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54790c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e4b expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.932520:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547921 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e4b expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985989.932527:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9b0a4823b000) 00010000:00010000:1.0:1788985989.932529:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788985989.932532:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788985989.932594:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:40449:x1875885971195648:12345-192.168.206.21@tcp:101:rm.0 Request processed in 1412us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985989.932610:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 524 00000100:00100000:0.0:1788985989.940778:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985989.940866:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971195776 00000100:00100000:2.0:1788985989.940875:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971195776 00000100:00100000:2.0:1788985989.940944:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 278 00000100:00100000:2.0:1788985989.940954:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971195776:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788985989.940971:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985989.940997:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001443067f/0xc20d828fcf547928 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e52 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788985989.941022:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x6aa1c285, atime: 0x6aa1c285, ctime: 0x6aa1c285, blocks: 0x1 00010000:00010000:2.0:1788985989.941041:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=1773s v=(0 0) 00010000:00010000:2.0:1788985989.941045:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788985989.941054:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001443067f/0xc20d828fcf547928 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e52 expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.941073:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001443067f/0xc20d828fcf547928 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e52 expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.941084:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1800, rc 0) 00000100:00100000:2.0:1788985989.941174:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971195776:12345-192.168.206.21@tcp:101:rm.0 Request processed in 220us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985989.941181:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 278 00000100:00100000:2.0:1788985989.951321:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985989.952664:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971196032 00000100:00100000:0.0:1788985989.952675:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971196032 00000100:00100000:0.0:1788985989.952737:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 525 00000100:00100000:0.0:1788985989.952747:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:40449:x1875885971196032:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1788985989.952797:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788985989.952822:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547921 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e4b expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.952844:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5478fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e44 expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.952854:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9b0a4823b000) 00010000:00010000:0.0:1788985989.952864:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788985989.953040:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54792f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.953055:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54792f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.953064:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54792f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.953078:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547936 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.953141:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.953148:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.953238:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54793d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.953246:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54793d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.953253:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54793d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788985989.957668:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].17, 64 off9280 00000004:00080000:0.0:1788985989.957689:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1773860598758ns, next at 1774860594528ns, rc = 0 00010000:00010000:0.0:1788985989.957782:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547944 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957799:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957811:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547944 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957820:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547944 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957825:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547944 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957846:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547944 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957872:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788985989.957910:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54793d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957917:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54793d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957923:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54793d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957929:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985989.957933:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54793d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957941:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54793d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957953:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:0.0:1788985989.957956:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788985989.957961:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54793d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957967:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54793d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957986:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54792f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.957992:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54792f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.958004:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54792f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.958009:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985989.958011:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54792f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.958017:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54792f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.958024:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316f00) 00010000:00010000:0.0:1788985989.958026:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985989.958029:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54792f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.958034:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54792f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788985989.958043:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c39b77ab reply state 00000000df9139be transno 4294967497 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985989.958052:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788985989.958149:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:40449:x1875885971196032:12345-192.168.206.21@tcp:36:rm.0 Request processed in 5400us (6834us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1788985989.958158:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 525 00010000:00010000:2.0:1788985989.958495:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788985989.958502:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547944 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.958508:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788985989.958512:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547944 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.958519:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547944 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.958528:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2b:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:2.0:1788985989.958530:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788985989.958533:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547944 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.958551:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547944 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985989.958568:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985989.958570:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788985989.958572:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985989.962669:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547936 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.962687:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547936 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.962711:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547936 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.962717:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985989.962721:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547936 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.962729:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547936 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.962743:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a4823be00) 00010000:00010000:0.0:1788985989.962746:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985989.962750:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547936 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985989.962756:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547936 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985990.083802:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985991.104298:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788985991.175551:0:6925:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1775078458871ns, next at 1776078456900ns, rc = 0 00000100:00100000:3.0:1788985991.175571:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788985991.175588:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993420928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788985991.175648:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985991.175701:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993420928 00000100:00100000:3.0:1788985991.175709:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993420928 00000100:00100000:3.0:1788985991.175758:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:3.0:1788985991.175766:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4515a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993420928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788985991.175797:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788985991.175840:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4515a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993420928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985991.175847:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00000100:00080000:3.0:1788985991.176043:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788985991.179388:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993420928:0@lo:13:osp-pre-0-0.0 00000001:00080000:3.0:1788985991.235484:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967497 is committed 00000004:00080000:3.0:1788985991.235496:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 42 committed 00000100:00100000:3.0:1788985991.235630:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993421056:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788985991.235694:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985991.235768:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993421056 00000100:00100000:3.0:1788985991.235776:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993421056 00000100:00100000:3.0:1788985991.235814:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788985991.235822:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993421056:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788985991.235848:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:17 count 1 00010000:00010000:3.0:1788985991.235871:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985991.235893:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001443067f/0xc20d828fcf547928 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e52 expref: 5 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985991.235902:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788985991.235905:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788985991.235910:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985991.235937:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001443067f/0xc20d828fcf547928 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e52 expref: 5 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985991.235950:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001443067f/0xc20d828fcf547928 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e52 expref: 5 pid: 8478 timeout: 1875 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985991.235962:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993421184:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788985991.236013:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a6060f000 going to sleep for 11 seconds 00000100:00100000:3.0:1788985991.241068:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993421184:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788985991.241115:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985991.248883:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985991.248949:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971196160 00000100:00100000:1.0:1788985991.248958:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971196160 00010000:00010000:1.0:1788985991.249011:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001443067f/0xc20d828fcf547928 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e52 expref: 6 pid: 8478 timeout: 1875 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985991.249053:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 327 00000100:00100000:1.0:1788985991.249063:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971196160:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788985991.249077:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788985991.249082:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001443067f/0xc20d828fcf547928 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e52 expref: 6 pid: 8478 timeout: 1875 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985991.249123:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001443067f/0xc20d828fcf547928 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e52 expref: 6 pid: 8478 timeout: 1875 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985991.249146:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001443067f/0xc20d828fcf547928 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e52 expref: 6 pid: 8478 timeout: 1875 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985991.249160:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788985991.249165:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788985991.249169:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985991.249179:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985991.249218:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788985991.249261:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971196160:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 199us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985991.249269:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 327 00000100:00080000:3.0:1788985991.250060:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788985991.250179:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985991.250190:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985991.250201:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985991.250210:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985991.250229:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788985991.251223:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993421056:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15398us (15527us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788985991.251233:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00010000:00010000:1.0:1788985991.251499:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788985991.251506:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985991.251516:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788985991.251520:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985991.251530:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985991.251547:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985991.251555:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a6abb836/0xc20d828fcf54794b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985991.251575:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985991.251577:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788985991.251578:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788985991.252537:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b094247c000/2, rc 0, transno 4294967330 00000100:00100000:3.0:1788985991.252546:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993421056:0@lo:6:osp-syn-0-0.0 00000020:00000080:2.0:1788985991.452995:0:69167:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde8c16820 20000000:00000080:2.0:1788985991.453015:0:69167:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f424400 uarg=0000000000000000 00010000:00010000:2.0:1788985991.453660:0:69167:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788985991.453691:0:69167:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316f00) 00010000:00010000:2.0:1788985991.453694:0:69167:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788985991.453704:0:69167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5478cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e36 expref: 5 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985991.453731:0:69167:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1788985991.453743:0:69167:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788985991.453755:0:69167:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985991.453767:0:69167:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5478b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5478aa expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985991.453775:0:69167:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985991.453806:0:69167:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5478b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5478aa expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985991.453818:0:69167:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5478b1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5478aa expref: 18 pid: 5846 timeout: 1875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985991.453831:0:69167:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436e9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69167:1875885993421312:0@lo:104: 00000100:00100000:2.0:1788985991.453882:0:69167:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985991.453938:0:69167:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788985991.454174:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993421312 00000100:00100000:0.0:1788985991.454181:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993421312 00000100:00100000:0.0:1788985991.454222:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788985991.454231:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:69167:x1875885993421312:12345-0@lo:104: 00010000:00010000:0.0:1788985991.454244:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5478b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454315:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985991.454321:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:69167:x1875885993421312:12345-0@lo:104: Request processed in 91us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985991.454340:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00010000:00010000:0.0:1788985991.454360:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985991.454366:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5478b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454374:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788985991.454378:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5478b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454386:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5478b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788985991.454392:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5478b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985991.454397:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788985991.454433:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5478b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454439:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788985991.454460:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5478b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454466:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5478aa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5478b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454479:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985991.454481:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985991.454482:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985991.454493:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993421440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788985991.454527:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985991.454557:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993421440 00000100:00100000:0.0:1788985991.454561:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993421440 00010000:00010000:0.0:1788985991.454577:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5478b1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5478aa expref: 19 pid: 5846 timeout: 1875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985991.454595:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788985991.454602:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993421440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985991.454611:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788985991.454616:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5478b1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5478aa expref: 19 pid: 5846 timeout: 1875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454625:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5478b1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5478aa expref: 19 pid: 5846 timeout: 1875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454638:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454644:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454656:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454662:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454668:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454674:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454686:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788985991.454689:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454696:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454705:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985991.454714:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788985991.454741:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993421440:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985991.454746:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:0.0:1788985991.454776:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993421440:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788985991.455829:0:69167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf5478b1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5478aa expref: 18 pid: 5846 timeout: 1875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985991.455844:0:69167:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436e9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69167:1875885993421312:0@lo:104: 00010000:00010000:3.0:1788985991.455862:0:69167:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985991.455871:0:69167:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985991.455877:0:69167:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985991.455883:0:69167:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf547952 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985992.128260:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985992.192395:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788985992.194124:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788985992.194145:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993421952:0@lo:400:kworker.0 00000100:00100000:2.0:1788985992.194206:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985992.194267:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993421952 00000100:00100000:2.0:1788985992.194285:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993421952 00000100:00100000:2.0:1788985992.194329:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:2.0:1788985992.194337:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993421952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985992.194385:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993421952:12345-0@lo:400:kworker.0 Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985992.194392:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00100000:2.0:1788985992.194443:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993421952:0@lo:400:kworker.0 00000100:00100000:3.0:1788985992.194632:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993421568:0@lo:400:kworker.0 00000100:00100000:3.0:1788985992.194666:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985992.194706:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993421696:0@lo:400:kworker.0 00000100:00100000:3.0:1788985992.194735:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985992.194754:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788985992.194761:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993421824:0@lo:400:kworker.0 00000100:00100000:3.0:1788985992.194782:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985992.194808:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993421696 00000100:00100000:3.0:1788985992.194812:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993421696 00000100:00100000:3.0:1788985992.194835:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993421824 00000100:00100000:3.0:1788985992.194838:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993421824 00000100:00100000:3.0:1788985992.194859:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1226 00000100:00100000:2.0:1788985992.194939:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993421568 00000100:00100000:2.0:1788985992.194943:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993421568 00000100:00100000:2.0:1788985992.194975:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:2.0:1788985992.194983:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993421568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985992.195020:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993421568:12345-0@lo:400:kworker.0 Request processed in 38us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985992.195026:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1788985992.195065:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993421696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985992.195130:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993421696:12345-0@lo:400:kworker.0 Request processed in 264us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985992.195137:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1226 00000100:00100000:3.0:1788985992.195150:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1788985992.195156:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993421824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985992.195179:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993421824:12345-0@lo:400:kworker.0 Request processed in 24us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985992.195185:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00080000:3.0:1788985992.195205:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788985992.195224:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993421568:0@lo:400:kworker.0 00000100:00100000:2.0:1788985992.196125:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993421824:0@lo:400:kworker.0 00000100:00100000:2.0:1788985992.196136:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993421696:0@lo:400:kworker.0 00000100:00100000:0.0:1788985992.196881:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993422080:0@lo:400:kworker.0 00000100:00100000:0.0:1788985992.196923:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985992.196964:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993422080 00000100:00100000:0.0:1788985992.196969:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993422080 00000100:00100000:0.0:1788985992.197009:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1788985992.197017:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993422080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788985992.197059:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993422080:12345-0@lo:400:kworker.0 Request processed in 42us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985992.197065:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1788985992.197117:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993422080:0@lo:400:kworker.0 00000100:00100000:0.0:1788985992.197135:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993422208:0@lo:400:kworker.0 00000100:00100000:0.0:1788985992.197171:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985992.197312:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993422208 00000100:00100000:3.0:1788985992.197317:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993422208 00000100:00100000:3.0:1788985992.197350:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:3.0:1788985992.197357:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993422208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788985992.197392:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993422208:12345-0@lo:400:kworker.0 Request processed in 36us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985992.197412:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00080000:3.0:1788985992.197433:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788985992.197436:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788985992.197454:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993422208:0@lo:400:kworker.0 00000100:00100000:1.0:1788985992.705342:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788985992.705375:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993422336:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985992.705461:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985992.705688:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993422336 00000100:00100000:0.0:1788985992.705699:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993422336 00000100:00100000:0.0:1788985992.705800:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 621 00000100:00100000:0.0:1788985992.705810:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993422336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788985992.705847:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788985992.705906:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993422336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985992.705913:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 621 00000100:00100000:1.0:1788985992.705995:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993422336:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788985993.154992:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788985993.408498:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788985993.408505:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788985993.408509:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788985993.408550:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985993.408560:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985993.408570:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788985993.408594:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993422464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788985993.408652:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985993.408700:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0942afe840 going to sleep for 11 seconds 00000100:00100000:1.0:1788985993.410587:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993422464 00000100:00100000:1.0:1788985993.410599:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993422464 00000100:00100000:1.0:1788985993.410647:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:1.0:1788985993.410656:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993422464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788985993.410670:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985993.410698:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547960 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547959 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985993.410722:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547960 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547959 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985993.410732:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547960 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547959 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985993.410740:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788985993.410817:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993422464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (2163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985993.410823:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1788985993.410918:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993422464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788985993.410937:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547960 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985993.410946:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547960 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788985993.410975:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788985993.410982:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547960 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985993.410990:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547960 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.184513:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985994.362264:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985994.362298:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985994.362329:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985994.362354:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971196416 00000100:00100000:3.0:1788985994.362363:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971196416 00000100:00100000:3.0:1788985994.362427:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1229 00000100:00100000:3.0:1788985994.362438:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971196416:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788985994.362503:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971196416:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985994.362514:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1229 00000100:00080000:3.0:1788985994.362534:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985994.362888:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971196288 00000100:00100000:1.0:1788985994.362893:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971196288 00000100:00100000:1.0:1788985994.363021:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1037 00000100:00100000:1.0:1788985994.363029:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971196288:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788985994.363063:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971196288:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985994.363080:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1037 00000100:00100000:2.0:1788985994.365155:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971196544 00000100:00100000:2.0:1788985994.365169:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971196544 00000100:00100000:2.0:1788985994.365234:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 844 00000100:00100000:2.0:1788985994.365245:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971196544:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788985994.365317:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971196544:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 74us (3018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985994.365325:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 844 00000100:00080000:3.0:1788985994.365418:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788985994.508499:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985994.508616:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971196672 00000100:00100000:1.0:1788985994.508626:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971196672 00000100:00100000:1.0:1788985994.508681:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 526 00000100:00100000:1.0:1788985994.508691:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40537:x1875885971196672:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788985994.508710:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985994.508730:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547967 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e59 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.508793:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54796e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.508807:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54796e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.508820:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54796e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788985994.508853:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:1.0:1788985994.508856:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788985994.508874:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54796e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.508898:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547967 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e59 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.508919:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54796e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e59 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.508945:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316200) 00010000:00010000:1.0:1788985994.508948:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788985994.508951:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788985994.509007:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40537:x1875885971196672:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 317us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985994.509014:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 526 00000100:00100000:2.0:1788985994.516406:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985994.518240:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971196928 00000100:00100000:3.0:1788985994.518252:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971196928 00000100:00100000:3.0:1788985994.518355:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 527 00000100:00100000:3.0:1788985994.518365:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40537:x1875885971196928:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788985994.518424:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788985994.518452:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54796e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e59 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985994.518468:0:5856:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf5478cd) 00010000:00010000:3.0:1788985994.518472:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316200) 00010000:00010000:3.0:1788985994.518482:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788985994.518504:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547975 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985994.518516:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985994.518525:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788985994.569211:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967498 is committed 00000004:00080000:2.0:1788985994.569226:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 43 committed 00000004:00010000:3.0:1788985994.569987:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a8cff004 reply state 000000005d4670eb transno 4294967498 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985994.570001:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788985994.570017:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00010000:00080000:3.0:1788985994.570221:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788985994.570245:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40537:x1875885971196928:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 51877us (53853us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788985994.570254:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 527 00010000:00010000:1.0:1788985994.572793:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547975 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.572811:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547975 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.572820:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547975 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.572827:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985994.572832:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547975 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.572841:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547975 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.572857:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745400) 00010000:00010000:1.0:1788985994.572860:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788985994.572865:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547975 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985994.572872:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547975 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985995.203941:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788985995.354381:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967330 is committed 00000020:00000080:0.0:1788985995.458689:0:69363:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9834ce10 20000000:00000080:0.0:1788985995.458704:0:69363:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a45646c00 uarg=0000000000000000 00010000:00010000:0.0:1788985995.459314:0:69363:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788985995.459329:0:69363:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788985995.459341:0:69363:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788985995.459358:0:69363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.459374:0:69363:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547960 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547959 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.459392:0:69363:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.459425:0:69363:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547960 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547959 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.459439:0:69363:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547960 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547959 expref: 18 pid: 5846 timeout: 1879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788985995.459464:0:69363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69363:1875885993422592:0@lo:104: 00000100:00100000:0.0:1788985995.459518:0:69363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788985995.459604:0:69363:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5abfeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788985995.460554:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993422592 00000100:00100000:3.0:1788985995.460561:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993422592 00000100:00100000:0.0:1788985995.460784:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1788985995.460793:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:69363:x1875885993422592:12345-0@lo:104: 00010000:00010000:0.0:1788985995.460805:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547960 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.460881:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788985995.460887:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:69363:x1875885993422592:12345-0@lo:104: Request processed in 96us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985995.460894:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788985995.460965:0:69363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69363:1875885993422592:0@lo:104: 00010000:00010000:2.0:1788985995.460984:0:69363:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.461561:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788985995.461568:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547960 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.461576:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788985995.461580:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547960 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.461589:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547960 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788985995.461597:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547960 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788985995.461603:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788985995.461676:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547960 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.461683:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788985995.461739:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1788985995.461759:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547960 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.461766:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf547959 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547960 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.461780:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985995.461781:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788985995.461783:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985995.462004:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993422720:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788985995.462047:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985995.462355:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993422720 00000100:00100000:1.0:1788985995.462361:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993422720 00010000:00010000:1.0:1788985995.462396:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547960 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547959 expref: 19 pid: 5846 timeout: 1879 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788985995.462465:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:1.0:1788985995.462473:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993422720:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788985995.462484:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788985995.462489:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547960 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547959 expref: 19 pid: 5846 timeout: 1879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985995.462499:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547960 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547959 expref: 19 pid: 5846 timeout: 1879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985995.462512:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf547960 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547959 expref: 19 pid: 5846 timeout: 1879 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985995.462526:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985995.462534:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985995.462547:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985995.462554:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985995.462560:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985995.462574:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985995.462579:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788985995.462583:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985995.462590:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985995.462610:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985995.462620:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788985995.462659:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993422720:12345-0@lo:103:ldlm_bl.0 Request processed in 187us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985995.462666:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:3.0:1788985995.462720:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993422720:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788985995.462769:0:69363:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.462778:0:69363:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985995.462784:0:69363:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54797c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985996.226530:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788985996.288304:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788985996.288334:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993422848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788985996.288432:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985996.288506:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993422848 00000100:00100000:3.0:1788985996.288521:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993422848 00000100:00100000:3.0:1788985996.289213:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 622 00000100:00100000:3.0:1788985996.289226:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993422848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788985996.289274:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788985996.289349:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993422848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985996.289360:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 622 00000100:00080000:3.0:1788985996.289407:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788985996.289447:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967330 gen 2 00000004:00080000:3.0:1788985996.289453:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b094247c000, transno 4294967330 00000100:00100000:3.0:1788985996.289475:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993422848:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1788985996.993189:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788985996.993199:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788985996.993206:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788985996.993282:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985996.993301:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985996.993314:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788985996.993346:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993422976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788985996.993445:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788985996.993506:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a59f526c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788985996.993665:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993422976 00000100:00100000:2.0:1788985996.993676:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993422976 00000100:00100000:2.0:1788985996.993735:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1788985996.993745:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993422976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788985996.993762:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985996.993777:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54798a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547983 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985996.993817:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54798a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547983 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985996.993829:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54798a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547983 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985996.993839:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788985996.993903:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993422976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985996.993910:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1788985996.994585:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993422976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788985996.994608:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54798a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985996.994618:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54798a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788985996.994644:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788985996.994651:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54798a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985996.994659:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54798a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985997.248535:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985997.318570:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993423488:0@lo:400:kworker.0 00000100:00100000:2.0:1788985997.318635:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985997.318687:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788985997.318693:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993423360:0@lo:400:kworker.0 00000100:00100000:2.0:1788985997.318715:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985997.318778:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993423104:0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.318808:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985997.318840:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993423616:0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.318873:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985997.318892:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788985997.318898:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993423232:0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.318918:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985997.318935:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993423744:0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.318953:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788985997.318980:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993423360 00000100:00100000:1.0:1788985997.318995:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993423360 00000100:00100000:1.0:1788985997.319042:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993423616 00000100:00100000:1.0:1788985997.319045:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993423616 00000100:00100000:1.0:1788985997.319063:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993423232 00000100:00100000:1.0:1788985997.319066:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993423232 00000100:00100000:1.0:1788985997.319079:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1230 00000100:00100000:1.0:1788985997.319109:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993423360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.319162:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993423360:12345-0@lo:400:kworker.0 Request processed in 76us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985997.319169:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1230 00000100:00100000:1.0:1788985997.319185:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1788985997.319191:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993423616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.319222:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993423616:12345-0@lo:400:kworker.0 Request processed in 31us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985997.319227:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1788985997.319238:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1788985997.319244:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993423232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.319272:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993423232:12345-0@lo:400:kworker.0 Request processed in 28us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985997.319278:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1788985997.319299:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993423488 00000100:00100000:1.0:1788985997.319303:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993423488 00000100:00100000:1.0:1788985997.319326:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993423744 00000100:00100000:1.0:1788985997.319329:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993423744 00000100:00100000:1.0:1788985997.319365:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1788985997.319381:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993423488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.319410:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993423488:12345-0@lo:400:kworker.0 Request processed in 40us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985997.319422:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:1.0:1788985997.319435:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:1.0:1788985997.319440:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993423744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.319467:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993423744:12345-0@lo:400:kworker.0 Request processed in 27us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788985997.319472:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00080000:1.0:1788985997.319487:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788985997.319491:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788985997.319522:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993423360:0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.319533:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436e9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993423488:0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.319567:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436e9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993423232:0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.319576:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993423744:0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.319583:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993423616:0@lo:400:kworker.0 00000100:00100000:2.0:1788985997.321069:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993423104 00000100:00100000:2.0:1788985997.321079:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993423104 00000100:00100000:2.0:1788985997.321142:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:2.0:1788985997.321151:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993423104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788985997.321218:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993423104:12345-0@lo:400:kworker.0 Request processed in 69us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985997.321225:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1788985997.321458:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993423104:0@lo:400:kworker.0 00000100:00100000:1.0:1788985997.824403:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788985997.824444:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993423872:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788985997.824546:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788985997.824708:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993423872 00000100:00100000:2.0:1788985997.824718:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993423872 00000100:00100000:2.0:1788985997.824792:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 623 00000100:00100000:2.0:1788985997.824804:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993423872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788985997.824859:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788985997.824937:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993423872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788985997.824945:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 623 00000100:00100000:1.0:1788985997.825238:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993423872:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788985998.272250:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788985998.531797:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985998.531900:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971197056 00000100:00100000:3.0:1788985998.531909:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971197056 00000100:00100000:3.0:1788985998.531975:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 528 00000100:00100000:3.0:1788985998.531984:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40613:x1875885971197056:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:3.0:1788985998.532008:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788985998.532028:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547991 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e60 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532085:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547998 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532119:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532132:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532145:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54799f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532152:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54799f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532159:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54799f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532482:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5479a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532492:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5479a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532498:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5479a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788985998.532520:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:3.0:1788985998.532523:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788985998.532556:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5479a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532568:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547998 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532576:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547998 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532583:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547998 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532589:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788985998.532594:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547998 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532601:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547998 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532612:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745b00) 00010000:00010000:3.0:1788985998.532615:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788985998.532619:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547998 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532625:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547998 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532638:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54799f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532645:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54799f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532655:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54799f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532660:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788985998.532663:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54799f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532668:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54799f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532675:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a55745d00) 00010000:00010000:3.0:1788985998.532677:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788985998.532680:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54799f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532685:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54799f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532712:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547991 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e60 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532727:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5479a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e60 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788985998.532734:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:3.0:1788985998.532737:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788985998.532739:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788985998.532796:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40613:x1875885971197056:12345-192.168.206.21@tcp:101:touch.0 Request processed in 813us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985998.532806:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 528 00000100:00080000:2.0:1788985998.533043:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788985998.540794:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985998.540825:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971197312 00000100:00100000:0.0:1788985998.540833:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971197312 00000100:00100000:0.0:1788985998.540889:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 529 00000100:00100000:0.0:1788985998.540899:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40613:x1875885971197312:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788985998.540918:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788985998.540936:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5479ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e67 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.541028:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5479b4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.541042:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5479b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.541053:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5479b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.541065:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5479bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.541072:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5479bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.541079:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5479bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788985998.541199:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00010000:00010000:0.0:1788985998.544418:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5479b4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544433:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5479b4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544440:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5479b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544447:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985998.544452:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5479b4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544476:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5479b4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544491:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:0.0:1788985998.544494:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985998.544499:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5479b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544505:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5479b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544517:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5479bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544523:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5479bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544530:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5479bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544535:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788985998.544538:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5479bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544544:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5479bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544550:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a4823b000) 00010000:00010000:0.0:1788985998.544552:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985998.544555:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5479bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544571:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5479bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544620:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5479ad lrc: 1/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e67 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544630:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:0.0:1788985998.544632:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788985998.544636:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5479ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e67 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788985998.544645:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efe00, rc 0) 00000100:00100000:0.0:1788985998.544704:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40613:x1875885971197312:12345-192.168.206.21@tcp:101:touch.0 Request processed in 3806us (3917us total) trans 0 rc 301/301 00000100:00100000:0.0:1788985998.544713:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 529 00000100:00100000:2.0:1788985998.552432:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788985998.552467:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971197440 00000100:00100000:2.0:1788985998.552476:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971197440 00000100:00100000:2.0:1788985998.552518:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 530 00000100:00100000:2.0:1788985998.552527:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40613:x1875885971197440:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788985998.552544:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788985998.552562:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf5479c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e6e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552617:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5479c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552630:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5479c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552640:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5479c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552652:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5479d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552659:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5479d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552666:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5479d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552684:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5479c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552689:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5479c9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552696:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5479c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552702:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985998.552706:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5479c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552713:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5479c9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552723:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:2.0:1788985998.552725:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985998.552729:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5479c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552735:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5479c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552746:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5479d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552751:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5479d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552758:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5479d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552763:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788985998.552765:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5479d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552771:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5479d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552777:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a45acae00) 00010000:00010000:2.0:1788985998.552779:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985998.552781:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5479d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552786:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5479d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552810:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf5479c2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e6e expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552818:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:2.0:1788985998.552820:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788985998.552824:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf5479c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e6e expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788985998.552831:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0a00, rc 0) 00000100:00100000:2.0:1788985998.552880:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40613:x1875885971197440:12345-192.168.206.21@tcp:101:touch.0 Request processed in 354us (455us total) trans 0 rc 301/301 00000100:00100000:2.0:1788985998.552890:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 530 00000100:00100000:0.0:1788985998.555986:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788985998.556376:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971197568 00000100:00100000:1.0:1788985998.556385:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971197568 00000100:00100000:1.0:1788985998.556469:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 531 00000100:00100000:1.0:1788985998.556479:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40613:x1875885971197568:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788985998.556505:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788985998.556523:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5479d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e75 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556584:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5479de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556597:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5479de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556609:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5479de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556623:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5479e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556630:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5479e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556637:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5479e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556655:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5479de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556661:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5479de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556668:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5479de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556674:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985998.556684:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5479de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556692:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5479de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556703:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:1.0:1788985998.556706:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985998.556709:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5479de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556716:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5479de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556729:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5479e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556735:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5479e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556740:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5479e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556745:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788985998.556747:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5479e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556753:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5479e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556760:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a45316900) 00010000:00010000:1.0:1788985998.556762:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985998.556770:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5479e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556777:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5479e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556807:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5479d7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e75 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556817:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:1.0:1788985998.556819:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788985998.556822:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5479d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e75 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788985998.556831:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00100000:1.0:1788985998.556894:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40613:x1875885971197568:12345-192.168.206.21@tcp:101:touch.0 Request processed in 416us (915us total) trans 0 rc 301/301 00000100:00100000:1.0:1788985998.556901:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 531 00010000:00010000:1.0:1788985999.297540:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788985999.480656:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985999.480695:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788985999.480719:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788985999.480772:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971197824 00000100:00100000:3.0:1788985999.480781:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971197824 00000100:00100000:3.0:1788985999.480830:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1233 00000100:00100000:3.0:1788985999.480853:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971197824:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788985999.480923:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971197824:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788985999.480930:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1233 00000100:00100000:0.0:1788985999.481501:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971197696 00000100:00100000:0.0:1788985999.481507:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971197696 00000100:00100000:0.0:1788985999.481559:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1040 00000100:00100000:0.0:1788985999.481570:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971197696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985999.481607:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971197696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 41us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985999.481614:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1040 00000100:00100000:0.0:1788985999.481654:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971197952 00000100:00100000:0.0:1788985999.481658:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971197952 00000100:00100000:0.0:1788985999.481692:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 847 00000100:00100000:0.0:1788985999.481700:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971197952:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788985999.481727:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971197952:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (1007us total) trans 0 rc 0/0 00000100:00100000:0.0:1788985999.481733:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 847 00000100:00080000:0.0:1788985999.481748:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788986000.200311:0:69607:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffea798b4d0 20000000:00000080:1.0:1788986000.200328:0:69607:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a79bda400 uarg=0000000000000000 00010000:00010000:1.0:1788986000.201684:0:69607:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788986000.201719:0:69607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:1.0:1788986000.201723:0:69607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986000.201733:0:69607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5479a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e60 expref: 5 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.201764:0:69607:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1788986000.201779:0:69607:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986000.201801:0:69607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.201813:0:69607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54798a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547983 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.201820:0:69607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.201853:0:69607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54798a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547983 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.201866:0:69607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54798a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547983 expref: 18 pid: 5849 timeout: 1884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986000.201879:0:69607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69607:1875885993424000:0@lo:104: 00000100:00100000:1.0:1788986000.201950:0:69607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986000.202008:0:69607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a59fecc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788986000.202417:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993424000 00000100:00100000:2.0:1788986000.202424:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993424000 00000100:00100000:2.0:1788986000.202472:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788986000.202481:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:69607:x1875885993424000:12345-0@lo:104: 00010000:00010000:2.0:1788986000.202493:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54798a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986000.202670:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986000.202677:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:69607:x1875885993424000:12345-0@lo:104: Request processed in 198us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986000.202685:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00010000:00010000:0.0:1788986000.202736:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986000.202743:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54798a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986000.202750:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986000.202754:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54798a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986000.202762:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54798a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986000.202770:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54798a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986000.202776:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986000.202810:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54798a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986000.202817:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986000.202853:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54798a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986000.202871:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf547983 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54798a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986000.202885:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986000.202887:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986000.202889:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986000.202897:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986000.202908:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993424128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986000.202940:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986000.203070:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993424128 00000100:00100000:1.0:1788986000.203075:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993424128 00010000:00010000:1.0:1788986000.203126:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54798a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547983 expref: 19 pid: 5849 timeout: 1884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986000.203147:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:1.0:1788986000.203153:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993424128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986000.203161:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986000.203166:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54798a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547983 expref: 19 pid: 5849 timeout: 1884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.203175:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54798a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547983 expref: 19 pid: 5849 timeout: 1884 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.203196:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.203203:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.203218:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.203237:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.203244:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.203249:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.203254:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986000.203257:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.203265:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.203272:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986000.203280:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986000.203312:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993424128:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986000.203326:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788986000.203463:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993424128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986000.203652:0:69607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54798a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547983 expref: 18 pid: 5849 timeout: 1884 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986000.203664:0:69607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69607:1875885993424000:0@lo:104: 00010000:00010000:3.0:1788986000.203677:0:69607:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986000.203685:0:69607:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986000.203692:0:69607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986000.203698:0:69607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf5479ec lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986000.324965:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986001.344288:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986001.412985:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993424256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986001.413049:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986001.413203:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993424256 00000100:00100000:2.0:1788986001.413211:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993424256 00000100:00100000:2.0:1788986001.413276:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 624 00000100:00100000:2.0:1788986001.413286:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993424256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986001.413317:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986001.413378:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993424256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986001.413384:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 624 00000100:00100000:1.0:1788986001.413512:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993424256:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986001.413572:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:2.0:1788986001.856263:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986001.856271:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986001.856277:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986001.856322:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986001.856334:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986001.856655:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986001.856682:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993424384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986001.856743:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986001.856798:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09427c4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788986001.857645:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993424384 00000100:00100000:3.0:1788986001.857655:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993424384 00000100:00100000:3.0:1788986001.857703:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1788986001.857711:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993424384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986001.857724:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986001.857738:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf5479fa lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5479f3 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986001.857760:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf5479fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5479f3 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986001.857770:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf5479fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5479f3 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986001.857778:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986001.857997:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993424384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 286us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986001.858004:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1788986001.858048:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436eb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993424384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986001.858062:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5479fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986001.858070:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5479fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986001.858117:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986001.858123:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5479fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986001.858131:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5479fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986002.368204:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986002.434975:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993424512:0@lo:400:kworker.0 00000100:00100000:0.0:1788986002.435042:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986002.435176:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993424512 00000100:00100000:2.0:1788986002.435184:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993424512 00000100:00100000:2.0:1788986002.435245:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1788986002.435254:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993424512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986002.435427:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993424896:0@lo:400:kworker.0 00000100:00100000:1.0:1788986002.435464:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986002.435507:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993424896 00000100:00100000:1.0:1788986002.435512:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993424896 00000100:00100000:2.0:1788986002.435516:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993424512:12345-0@lo:400:kworker.0 Request processed in 261us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986002.435525:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1788986002.435552:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:1.0:1788986002.435561:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993424896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986002.435611:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993424896:12345-0@lo:400:kworker.0 Request processed in 52us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986002.435618:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:3.0:1788986002.435852:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993424768:0@lo:400:kworker.0 00000100:00100000:3.0:1788986002.435884:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986002.435916:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788986002.435922:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993424640:0@lo:400:kworker.0 00000100:00100000:3.0:1788986002.435942:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986002.435958:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993425152:0@lo:400:kworker.0 00000100:00100000:3.0:1788986002.435978:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986002.436002:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993425152 00000100:00100000:3.0:1788986002.436006:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993425152 00000100:00100000:3.0:1788986002.436039:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1788986002.436046:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993425152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986002.436078:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993425152:12345-0@lo:400:kworker.0 Request processed in 32us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986002.436083:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00080000:3.0:1788986002.436122:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986002.436146:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993425152:0@lo:400:kworker.0 00000100:00100000:1.0:1788986002.436300:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993424768 00000100:00100000:1.0:1788986002.436306:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993424768 00000100:00080000:3.0:1788986002.436356:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986002.436358:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993424640 00000100:00100000:1.0:1788986002.436363:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993424640 00000100:00100000:1.0:1788986002.436391:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:1.0:1788986002.436398:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993424768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986002.436434:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993424768:12345-0@lo:400:kworker.0 Request processed in 37us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986002.436440:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:1.0:1788986002.436453:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1788986002.436460:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993424640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986002.436602:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993424768:0@lo:400:kworker.0 00000100:00100000:1.0:1788986002.441946:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993424640:12345-0@lo:400:kworker.0 Request processed in 5478us (5994us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986002.441966:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:1.0:1788986002.442039:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993424640:0@lo:400:kworker.0 00000100:00100000:2.0:1788986002.442215:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993424896:0@lo:400:kworker.0 00000100:00100000:2.0:1788986002.442230:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986002.442239:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993425024:0@lo:400:kworker.0 00000100:00100000:2.0:1788986002.442279:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986002.442380:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993425024 00000100:00100000:1.0:1788986002.442386:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993425024 00000100:00100000:1.0:1788986002.442471:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:1.0:1788986002.442480:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993425024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986002.442526:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993425024:12345-0@lo:400:kworker.0 Request processed in 47us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986002.442533:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:0.0:1788986002.443595:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993424512:0@lo:400:kworker.0 00000100:00080000:2.0:1788986002.449430:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986002.449489:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993425024:0@lo:400:kworker.0 00000100:00100000:1.0:1788986002.944640:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993425280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986002.944747:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986002.944861:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993425280 00000100:00100000:2.0:1788986002.944871:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993425280 00000100:00100000:2.0:1788986002.944945:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 625 00000100:00100000:2.0:1788986002.944956:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993425280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986002.945001:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986002.946044:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993425280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1081us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986002.946057:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 625 00000100:00100000:1.0:1788986002.946247:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993425280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986003.349689:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986003.350252:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971198080 00000100:00100000:1.0:1788986003.350267:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971198080 00000100:00100000:1.0:1788986003.350527:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 532 00000100:00100000:1.0:1788986003.350541:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40700:x1875885971198080:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986003.350569:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986003.350602:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547a01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e7c expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986003.350699:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547a08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986003.350718:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986003.350758:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986003.350804:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:1.0:1788986003.350809:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986003.350832:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547a08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986003.350863:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf547a01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e7c expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986003.350894:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547a08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e7c expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986003.350904:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:1.0:1788986003.350907:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986003.350912:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986003.350990:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40700:x1875885971198080:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 452us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986003.350998:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 532 00000100:00080000:2.0:1788986003.358043:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986003.365365:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986003.365625:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971198336 00000100:00100000:3.0:1788986003.365638:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971198336 00000100:00100000:3.0:1788986003.365714:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 533 00000100:00100000:3.0:1788986003.365726:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40700:x1875885971198336:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986003.365796:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986003.365834:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547a08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e7c expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986003.365857:0:5855:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf5479a6) 00010000:00010000:3.0:1788986003.365862:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:3.0:1788986003.365875:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986003.365904:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547a0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986003.365919:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986003.365931:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986003.366668:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002d45a5c5 reply state 00000000d301d35d transno 4294967499 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986003.366682:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986003.366692:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000100:00100000:3.0:1788986003.366856:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40700:x1875885971198336:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 1130us (1512us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788986003.366865:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 533 00010000:00010000:0.0:1788986003.397389:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986003.401958:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547a0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986003.401982:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547a0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986003.401992:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986003.402015:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986003.402022:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547a0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986003.402030:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547a0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986003.402050:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:1.0:1788986003.402054:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986003.402060:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547a0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986003.402068:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547a0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788986004.318217:0:69804:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc1caecc60 20000000:00000080:3.0:1788986004.318238:0:69804:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80b1e400 uarg=0000000000000000 00010000:00010000:3.0:1788986004.318528:0:69804:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986004.318545:0:69804:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986004.318562:0:69804:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986004.318584:0:69804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986004.318610:0:69804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf5479fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5479f3 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986004.318619:0:69804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986004.318667:0:69804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf5479fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5479f3 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986004.318685:0:69804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf5479fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5479f3 expref: 18 pid: 5849 timeout: 1888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986004.318702:0:69804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80717800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69804:1875885993425408:0@lo:104: 00000100:00100000:3.0:1788986004.319878:0:69804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986004.319997:0:69804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a484aaa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788986004.323701:0:7642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788986004.323739:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993425408 00000100:00100000:1.0:1788986004.323751:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993425408 00000100:00100000:1.0:1788986004.323824:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788986004.323837:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:69804:x1875885993425408:12345-0@lo:104: 00010000:00010000:1.0:1788986004.323860:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5479fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986004.324726:0:69804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80717800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:69804:1875885993425408:0@lo:104: 00010000:00010000:3.0:1788986004.324758:0:69804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986004.325184:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986004.325194:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b1d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:69804:x1875885993425408:12345-0@lo:104: Request processed in 1360us (5322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986004.325205:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00010000:00010000:2.0:1788986004.325374:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986004.325384:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5479fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.325393:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986004.325399:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5479fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.325409:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5479fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986004.325416:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5479fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986004.325422:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986004.325481:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5479fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.325489:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986004.325528:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5479fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.325536:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf5479f3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5479fa expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.325557:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986004.325560:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986004.325562:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986004.325636:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993425536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986004.325703:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986004.325812:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993425536 00000100:00100000:2.0:1788986004.325819:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993425536 00010000:00010000:2.0:1788986004.326462:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf5479fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5479f3 expref: 19 pid: 5849 timeout: 1888 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986004.326507:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788986004.326518:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993425536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986004.326533:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986004.326619:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf5479fa lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5479f3 expref: 19 pid: 5849 timeout: 1888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.326633:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf5479fa lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5479f3 expref: 19 pid: 5849 timeout: 1888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.326649:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf5479fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5479f3 expref: 19 pid: 5849 timeout: 1888 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.326668:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.326679:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.326699:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.326706:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.326713:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.326721:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.326727:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986004.326731:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.326739:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.326755:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986004.326766:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986004.326836:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993425536:12345-0@lo:103:ldlm_bl.0 Request processed in 320us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986004.326843:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00000100:00100000:2.0:1788986004.326895:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436eb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993425536:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986004.327211:0:69804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986004.327221:0:69804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986004.327228:0:69804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf547a16 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 69804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986004.422120:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986004.593463:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986004.593556:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986004.593595:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986004.593647:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971198720 00000100:00100000:0.0:1788986004.593659:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971198720 00000100:00100000:3.0:1788986004.593894:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971198464 00000100:00100000:3.0:1788986004.593900:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971198464 00000100:00100000:3.0:1788986004.593943:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1043 00000100:00100000:3.0:1788986004.593955:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971198464:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986004.594039:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971198464:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 86us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986004.594048:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1043 00000100:00100000:0.0:1788986004.594172:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 850 00000100:00100000:0.0:1788986004.594187:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971198720:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986004.594237:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971198720:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 56us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986004.594244:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 850 00000100:00080000:0.0:1788986004.594268:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986004.598932:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971198592 00000100:00100000:1.0:1788986004.598950:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971198592 00000100:00100000:0.0:1788986004.599685:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1237 00000100:00100000:0.0:1788986004.599701:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971198592:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986004.599786:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971198592:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 90us (6337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986004.599793:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1237 00000001:00080000:0.0:1788986005.077303:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967499 is committed 00010000:00010000:0.0:1788986005.441404:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788986005.889159:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986005.889167:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986005.889172:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986005.889216:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986005.889227:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986005.889238:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986005.889261:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993425664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986005.889322:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986005.889383:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5abfe900 going to sleep for 11 seconds 00000100:00100000:2.0:1788986005.889479:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993425664 00000100:00100000:2.0:1788986005.889486:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993425664 00000100:00100000:2.0:1788986005.889534:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1788986005.889543:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993425664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986005.889555:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986005.889568:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547a24 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547a1d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986005.889590:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547a24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547a1d expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986005.889605:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547a24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547a1d expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986005.889614:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788986005.889666:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993425664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986005.889672:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:0.0:1788986005.889838:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80717800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993425664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986005.889853:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547a24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986005.889862:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547a24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986005.889881:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986005.889886:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547a24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986005.889894:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547a24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986006.469329:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986006.528445:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993425792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986006.528515:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986006.528636:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993425792 00000100:00100000:2.0:1788986006.528644:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993425792 00000100:00100000:2.0:1788986006.528705:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:2.0:1788986006.528714:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993425792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986006.528745:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788986006.528804:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986006.543223:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993425792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 14501us (14699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986006.543237:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1788986006.543376:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993425792:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986007.488364:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986007.522302:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986007.522394:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971198848 00000100:00100000:3.0:1788986007.522403:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971198848 00000100:00100000:3.0:1788986007.522476:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 534 00000100:00100000:3.0:1788986007.522485:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40786:x1875885971198848:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986007.522592:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40786:x1875885971198848:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 108us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986007.522603:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 534 00000100:00080000:0.0:1788986007.523187:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986007.529022:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986007.529224:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971198976 00000100:00100000:0.0:1788986007.529233:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971198976 00000100:00100000:0.0:1788986007.529330:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 280 00000100:00100000:0.0:1788986007.529342:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40786:x1875885971198976:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986007.529702:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40786:x1875885971198976:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 362us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986007.529710:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 280 00000100:00080000:3.0:1788986007.530443:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986007.534469:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986007.534555:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971199104 00000100:00100000:0.0:1788986007.534563:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971199104 00000100:00100000:0.0:1788986007.534617:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 281 00000100:00100000:0.0:1788986007.534624:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1875885971199104:12345-192.168.206.21@tcp:8:lfs.0 00010000:00080000:0.0:1788986007.534654:0:6695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 1791 last 0 00000020:00000080:0.0:1788986007.534691:0:6695:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf547a2b 00002000:00100000:0.0:1788986007.534702:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b094195f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788986007.534724:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788986007.534957:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788986007.534983:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9b0941959800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788986007.535060:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971199104:12345-192.168.206.21@tcp:8:lfs.0 Request processed in 434us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986007.535067:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 281 00000100:00100000:2.0:1788986007.539610:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986007.541570:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971199232 00000100:00100000:0.0:1788986007.541593:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971199232 00000100:00100000:0.0:1788986007.541697:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 282 00000100:00100000:0.0:1788986007.541710:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40786:x1875885971199232:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986007.542084:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40786:x1875885971199232:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 377us (2482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986007.542121:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 282 00000100:00080000:3.0:1788986007.543558:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986007.545192:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986007.545571:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971199360 00000100:00100000:0.0:1788986007.545590:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971199360 00000100:00100000:0.0:1788986007.545652:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 535 00000100:00100000:0.0:1788986007.545664:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40786:x1875885971199360:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986007.546362:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40786:x1875885971199360:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 699us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986007.546371:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 535 00000100:00100000:1.0:1788986007.552838:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993426176:0@lo:400:kworker.0 00000100:00100000:1.0:1788986007.552905:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986007.553006:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993426304:0@lo:400:kworker.0 00000100:00100000:1.0:1788986007.553033:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986007.553207:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993426048:0@lo:400:kworker.0 00000100:00100000:3.0:1788986007.553236:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986007.553267:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993426560:0@lo:400:kworker.0 00000100:00100000:3.0:1788986007.553287:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986007.553305:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788986007.553310:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993425920:0@lo:400:kworker.0 00000100:00100000:3.0:1788986007.553358:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986007.553379:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993426432:0@lo:400:kworker.0 00000100:00100000:3.0:1788986007.553400:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986007.553428:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993425920 00000100:00100000:3.0:1788986007.553435:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993425920 00000100:00100000:3.0:1788986007.553474:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1788986007.553482:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993425920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986007.553525:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993425920:12345-0@lo:400:kworker.0 Request processed in 44us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986007.553532:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1788986007.553565:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993426176 00000100:00100000:3.0:1788986007.553569:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993426176 00000100:00100000:3.0:1788986007.553597:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993426048 00000100:00100000:3.0:1788986007.553600:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993426048 00000100:00100000:3.0:1788986007.553616:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993426432 00000100:00100000:3.0:1788986007.553619:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993426432 00000100:00100000:3.0:1788986007.553635:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:3.0:1788986007.553641:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993426176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986007.553673:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993426176:12345-0@lo:400:kworker.0 Request processed in 33us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986007.553680:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:3.0:1788986007.553691:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1788986007.553696:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993426048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986007.553720:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993426048:12345-0@lo:400:kworker.0 Request processed in 24us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986007.553726:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1788986007.553737:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1788986007.553744:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993426432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986007.553771:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993426432:12345-0@lo:400:kworker.0 Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986007.553776:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1788986007.553812:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993426304 00000100:00100000:3.0:1788986007.553815:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993426304 00000100:00100000:3.0:1788986007.553836:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993426560 00000100:00100000:3.0:1788986007.553839:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993426560 00000100:00100000:3.0:1788986007.553861:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1788986007.553873:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993426304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986007.553905:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993426304:12345-0@lo:400:kworker.0 Request processed in 38us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986007.553912:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:3.0:1788986007.553924:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:3.0:1788986007.553931:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993426560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986007.553953:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986007.553964:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993426560:12345-0@lo:400:kworker.0 Request processed in 33us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986007.553970:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:2.0:1788986007.553981:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971199488 00000100:00100000:2.0:1788986007.553986:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971199488 00000100:00080000:3.0:1788986007.553993:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986007.553998:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986007.554019:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 536 00000100:00100000:3.0:1788986007.554022:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993425920:0@lo:400:kworker.0 00000100:00100000:2.0:1788986007.554031:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40786:x1875885971199488:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986007.554039:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993426432:0@lo:400:kworker.0 00000100:00100000:3.0:1788986007.554049:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993426048:0@lo:400:kworker.0 00000100:00100000:3.0:1788986007.554058:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993426560:0@lo:400:kworker.0 00000100:00100000:1.0:1788986007.554189:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993426304:0@lo:400:kworker.0 00000100:00100000:1.0:1788986007.554213:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993426176:0@lo:400:kworker.0 00000100:00100000:2.0:1788986007.555468:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40786:x1875885971199488:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 1434us (1511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986007.555478:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 536 00000100:00100000:2.0:1788986007.562751:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986007.563413:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971199616 00000100:00100000:3.0:1788986007.563422:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971199616 00000100:00100000:3.0:1788986007.563524:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 283 00000100:00100000:3.0:1788986007.563535:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40786:x1875885971199616:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986007.563866:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40786:x1875885971199616:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 332us (1123us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986007.563873:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 283 00000100:00100000:1.0:1788986007.566513:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986007.566612:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971199744 00000100:00100000:0.0:1788986007.566621:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971199744 00000100:00100000:0.0:1788986007.566736:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 284 00000100:00100000:0.0:1788986007.566749:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40786:x1875885971199744:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986007.567152:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40786:x1875885971199744:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 407us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986007.567160:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 284 00000100:00100000:2.0:1788986007.570639:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986007.570716:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971199872 00000100:00100000:3.0:1788986007.570725:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971199872 00000100:00100000:3.0:1788986007.570774:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 537 00000100:00100000:3.0:1788986007.570791:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40786:x1875885971199872:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986007.571208:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40786:x1875885971199872:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 424us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986007.571215:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 537 00000100:00100000:1.0:1788986007.651852:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986007.652705:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971200000 00000100:00100000:0.0:1788986007.652716:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971200000 00000100:00100000:0.0:1788986007.652891:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 538 00000100:00100000:0.0:1788986007.652905:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40790:x1875885971200000:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1788986007.652925:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986007.652947:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547a32 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e83 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653005:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547a39 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653029:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547a39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653040:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547a39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653052:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547a40 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653058:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547a40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653063:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547a40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653353:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf547a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653361:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf547a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653367:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf547a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986007.653384:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:0.0:1788986007.653387:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986007.653403:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf547a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653413:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547a39 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653427:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547a39 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653433:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547a39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653438:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986007.653441:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547a39 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653448:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547a39 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653467:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b800) 00010000:00010000:0.0:1788986007.653470:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986007.653474:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547a39 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653479:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547a39 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653491:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547a40 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653496:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547a40 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653502:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547a40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653507:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986007.653515:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547a40 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653520:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547a40 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653528:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a4823b300) 00010000:00010000:0.0:1788986007.653530:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986007.653533:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547a40 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653538:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547a40 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653565:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf547a32 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e83 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653580:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf547a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e83 expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.653586:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986007.653588:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986007.653590:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efe00, rc 0) 00000100:00100000:0.0:1788986007.653707:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40790:x1875885971200000:12345-192.168.206.21@tcp:101:dd.0 Request processed in 807us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986007.653714:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 538 00000100:00100000:3.0:1788986007.658591:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986007.658661:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971200256 00000100:00100000:0.0:1788986007.658670:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971200256 00000100:00100000:0.0:1788986007.658733:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 539 00000100:00100000:0.0:1788986007.658745:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40790:x1875885971200256:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1788986007.658775:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986007.658805:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547a4e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e8a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.659066:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547a55 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.659083:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547a55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.659119:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547a55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.659135:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547a5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.659142:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547a5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.659149:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547a5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986007.660603:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x11:0x0], index 1: 0 00010000:00010000:0.0:1788986007.660893:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547a63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.660906:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.660915:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547a63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.660960:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547a55 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.660967:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547a55 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.660974:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547a55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.660980:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986007.660983:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547a55 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.660990:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547a55 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.661001:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986007.661004:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986007.661008:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547a55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.661013:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547a55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986007.661026:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002cf665d3 reply state 0000000064f80cf7 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547a5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986007.661034:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788986007.661065:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547a4e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e8a expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.661668:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547a63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e8a expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986007.661678:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986007.661680:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986007.661705:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee000, rc 0) 00000100:00100000:0.0:1788986007.661822:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:40790:x1875885971200256:12345-192.168.206.21@tcp:101:dd.0 Request processed in 3080us (3238us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788986007.661831:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 539 00010000:00010000:3.0:1788986007.666228:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547a5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986007.666244:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547a5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986007.666252:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547a5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986007.666266:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986007.666270:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547a5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986007.666278:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547a5c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986007.666293:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a4823bc00) 00010000:00010000:3.0:1788986007.666295:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986007.666301:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547a5c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986007.666306:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547a5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986007.674052:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986007.674361:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971200384 00000100:00100000:3.0:1788986007.674370:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971200384 00000100:00100000:3.0:1788986007.674431:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 285 00000100:00100000:3.0:1788986007.674441:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40790:x1875885971200384:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:3.0:1788986007.674457:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986007.674479:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf547a71 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e91 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788986007.674510:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788986007.674531:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=1791s v=(0 0) 00010000:00010000:3.0:1788986007.674535:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986007.674544:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf547a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e91 expref: 7 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986007.674560:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf547a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e91 expref: 7 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986007.674573:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986007.674618:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40790:x1875885971200384:12345-192.168.206.21@tcp:101:dd.0 Request processed in 179us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986007.674625:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 285 00000100:00100000:1.0:1788986007.691302:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986007.691454:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971200512 00000100:00100000:0.0:1788986007.691462:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971200512 00002000:00100000:0.0:1788986007.691523:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x11:0x0] (0->1048575) req@ffff9b09413ac000 x1875885971200512/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:683/0 lens 488/0 e 0 to 0 dl 1788986018 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788986007.691535:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b09413ac000 with x1875885971200512 ext(0->1048575) 00002000:00010000:0.0:1788986007.691541:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b09413ac000 00000100:00100000:0.0:1788986007.691572:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:0.0:1788986007.691583:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971200512:12345-192.168.206.21@tcp:4:dd.0 00000001:00100000:3.0:1788986007.752601:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:0.0:1788986007.758547:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971200512:12345-192.168.206.21@tcp:4:dd.0 Request processed in 66957us (67244us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1788986007.758561:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00002000:00100000:0.0:1788986007.758574:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x11:0x0] (0->1048575) req@ffff9b09413ac000 x1875885971200512/t4294967329(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:683/0 lens 488/448 e 0 to 0 dl 1788986018 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788986007.758585:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b09413ac000 with x1875885971200512 ext(0->1048575) 00002000:00010000:0.0:1788986007.758600:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b09413ac000 00000100:00100000:1.0:1788986007.763413:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986007.763487:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971200640 00000100:00100000:3.0:1788986007.763496:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971200640 00000100:00100000:3.0:1788986007.763547:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 540 00000100:00100000:3.0:1788986007.763557:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:40790:x1875885971200640:12345-192.168.206.21@tcp:44:dd.0 00000001:00080000:2.0:1788986007.801516:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967500 is committed 00000100:00100000:3.0:1788986007.801778:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40790:x1875885971200640:12345-192.168.206.21@tcp:44:dd.0 Request processed in 38217us (38369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986007.801800:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 540 00000100:00100000:1.0:1788986007.813235:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986007.813395:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971200768 00000100:00100000:2.0:1788986007.813405:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971200768 00000100:00100000:2.0:1788986007.813452:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 286 00000100:00100000:2.0:1788986007.813462:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971200768:12345-192.168.206.21@tcp:16:dd.0 00000001:00080000:3.0:1788986007.855344:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967329 is committed 00000100:00100000:0.0:1788986007.855502:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971200768:12345-192.168.206.21@tcp:16:dd.0 Request processed in 42035us (42271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986007.855513:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 286 00000100:00100000:2.0:1788986007.858846:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986007.859175:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971201024 00000100:00100000:1.0:1788986007.859184:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971201024 00000100:00100000:1.0:1788986007.859303:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:1.0:1788986007.859328:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40790:x1875885971201024:12345-192.168.206.21@tcp:35:dd.0 00000100:00100000:1.0:1788986007.859754:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:40790:x1875885971201024:12345-192.168.206.21@tcp:35:dd.0 Request processed in 438us (915us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788986007.859761:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 55 00000100:00100000:3.0:1788986008.064323:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986008.064347:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993426688:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986008.064417:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986008.064543:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993426688 00000100:00100000:0.0:1788986008.064551:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993426688 00000100:00100000:0.0:1788986008.064625:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 627 00000100:00100000:0.0:1788986008.064637:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993426688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986008.064658:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788986008.064723:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993426688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986008.064729:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 627 00000100:00100000:3.0:1788986008.065030:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993426688:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986008.512268:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986009.439747:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00010000:00010000:2.0:1788986009.537319:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986009.725392:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986009.725437:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986009.725473:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986009.725513:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986009.725522:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971201280 00000100:00100000:0.0:1788986009.725533:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971201280 00000100:00100000:1.0:1788986009.725544:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971201536 00000100:00100000:1.0:1788986009.725550:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971201536 00000100:00100000:1.0:1788986009.725600:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971201408 00000100:00100000:1.0:1788986009.725604:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971201408 00000100:00100000:0.0:1788986009.725616:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1241 00000100:00100000:0.0:1788986009.725630:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971201280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986009.725643:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 853 00000100:00100000:3.0:1788986009.725652:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 854 00000100:00100000:1.0:1788986009.725652:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971201536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986009.725672:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971201408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986009.725732:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971201280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 107us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986009.725739:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1241 00000100:00080000:0.0:1788986009.725769:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986009.725773:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986009.725775:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986009.725898:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971201152 00000100:00100000:2.0:1788986009.725903:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971201152 00000100:00100000:2.0:1788986009.725941:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1046 00000100:00100000:2.0:1788986009.725947:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971201152:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986009.736051:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971201536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 10388us (10601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986009.736066:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 853 00000100:00100000:3.0:1788986009.742968:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971201408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 17297us (17445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986009.742983:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 854 00000100:00100000:2.0:1788986009.745672:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971201152:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 19715us (20189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986009.745684:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1046 00010000:00010000:1.0:1788986010.560382:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788986010.837455:0:70051:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1794740362515ns, next at 1776078456900ns, rc = 0 00000004:00080000:2.0:1788986010.837589:0:70051:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1794740499000ns, next at 1700808508544ns, rc = 0 00000004:00080000:0.0:1788986010.852981:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 44 committed 00000004:00080000:0.0:1788986010.853006:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 44 committed 00010000:00010000:2.0:1788986011.586277:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986011.655575:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986011.655598:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993426816:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986011.655663:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986011.656740:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993426816 00000100:00100000:3.0:1788986011.656759:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993426816 00000100:00080000:0.0:1788986011.656922:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986011.657036:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1788986011.657046:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993426816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986011.657078:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986011.657158:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993426816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986011.657164:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 628 00000100:00100000:3.0:1788986011.657210:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993426816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986012.452246:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986012.452348:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971201664 00000100:00100000:0.0:1788986012.452360:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971201664 00000100:00100000:0.0:1788986012.452445:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 541 00000100:00100000:0.0:1788986012.452464:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40982:x1875885971201664:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986012.452557:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40982:x1875885971201664:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 96us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986012.452565:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 541 00000100:00080000:3.0:1788986012.452966:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986012.460947:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986012.462433:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971201792 00000100:00100000:3.0:1788986012.462445:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971201792 00000100:00100000:3.0:1788986012.462574:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 287 00000100:00100000:3.0:1788986012.462584:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40982:x1875885971201792:12345-192.168.206.21@tcp:19:lfs.0 00000100:00080000:2.0:1788986012.462644:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986012.462927:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40982:x1875885971201792:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 344us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986012.462934:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 287 00000100:00100000:0.0:1788986012.467782:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986012.470308:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971201920 00000100:00100000:1.0:1788986012.470319:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971201920 00000100:00100000:1.0:1788986012.470389:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 288 00000100:00100000:1.0:1788986012.470400:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40982:x1875885971201920:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986012.470779:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40982:x1875885971201920:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 379us (3002us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986012.470787:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 288 00000100:00080000:1.0:1788986012.470808:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986012.477947:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986012.480654:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971202048 00000100:00100000:3.0:1788986012.480665:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971202048 00000100:00100000:3.0:1788986012.480718:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 542 00000100:00100000:3.0:1788986012.480726:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40982:x1875885971202048:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986012.481125:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40982:x1875885971202048:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 398us (3185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986012.481133:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 542 00000100:00100000:2.0:1788986012.487886:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986012.488374:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971202176 00000100:00100000:3.0:1788986012.488383:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971202176 00000100:00100000:3.0:1788986012.488434:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 543 00000100:00100000:3.0:1788986012.488444:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40982:x1875885971202176:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986012.488543:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40982:x1875885971202176:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 100us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986012.488551:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 543 00000100:00100000:0.0:1788986012.491307:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986012.495007:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971202304 00000100:00100000:1.0:1788986012.495024:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971202304 00000100:00100000:1.0:1788986012.495081:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 289 00000100:00100000:1.0:1788986012.495106:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40982:x1875885971202304:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986012.495439:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:40982:x1875885971202304:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 349us (4148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986012.495446:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 289 00000100:00100000:0.0:1788986012.500718:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986012.501307:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971202432 00000100:00100000:1.0:1788986012.501316:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971202432 00000100:00100000:1.0:1788986012.501370:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 290 00000100:00100000:1.0:1788986012.501380:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40982:x1875885971202432:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986012.501770:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79725500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:40982:x1875885971202432:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 390us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986012.501777:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 290 00000100:00100000:2.0:1788986012.506242:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986012.508323:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971202560 00000100:00100000:0.0:1788986012.508334:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971202560 00000100:00100000:0.0:1788986012.508416:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 544 00000100:00100000:0.0:1788986012.508426:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40982:x1875885971202560:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986012.508907:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40982:x1875885971202560:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 481us (2670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986012.508915:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 544 00010000:00010000:1.0:1788986012.608675:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986012.612547:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986012.612645:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971202816 00000100:00100000:1.0:1788986012.612653:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971202816 00000100:00100000:1.0:1788986012.612709:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 545 00000100:00100000:1.0:1788986012.612719:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:40985:x1875885971202816:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788986012.612766:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986012.612790:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547a63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e8a expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.612809:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:1.0:1788986012.612819:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986012.612839:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547a78 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.612851:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547a78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.612877:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547a78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.612890:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547a7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.612897:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.612904:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.613237:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547a86 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.613246:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547a86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.613253:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547a86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986012.614043:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].17, 64 off9280 00000004:00080000:1.0:1788986012.614054:0:7899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1796516964447ns, next at 1797516961867ns, rc = 0 00010000:00010000:1.0:1788986012.614172:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547a8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614183:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614192:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547a8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614209:0:7899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547a8d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614217:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547a8d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614224:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547a8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614245:0:7899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986012.614265:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547a86 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614272:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547a86 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614279:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547a86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614285:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986012.614300:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547a86 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614308:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547a86 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614319:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff9b0a45316d00) 00010000:00010000:1.0:1788986012.614322:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986012.614325:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547a86 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614341:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547a86 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614359:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547a78 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614364:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547a78 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614370:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547a78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614375:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986012.614378:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547a78 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614384:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547a78 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614392:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:1.0:1788986012.614394:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986012.614397:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547a78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986012.614403:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547a78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986012.614412:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008171095f reply state 000000008f3cbd9a transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986012.614420:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986012.614504:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:40985:x1875885971202816:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1785us (1963us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788986012.614512:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 545 00010000:00010000:2.0:1788986012.614778:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986012.614786:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547a8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986012.614793:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986012.614796:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547a8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986012.614804:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547a8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986012.614813:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2d:0x0].0x0 (ffff9b0a45316d00) 00010000:00010000:2.0:1788986012.614816:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788986012.614819:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547a8d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986012.614824:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547a8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986012.614839:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986012.614841:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986012.614842:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986012.621424:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547a7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986012.621440:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547a7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986012.621457:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547a7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986012.621465:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986012.621469:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547a7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986012.621477:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547a7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986012.621493:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a45316b00) 00010000:00010000:3.0:1788986012.621496:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986012.621501:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547a7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986012.621507:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547a7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986012.672348:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993427328:0@lo:400:kworker.0 00000100:00100000:1.0:1788986012.672412:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986012.672465:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993427200:0@lo:400:kworker.0 00000100:00100000:1.0:1788986012.672496:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993427328 00000100:00100000:2.0:1788986012.672504:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986012.672504:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993427328 00000100:00100000:2.0:1788986012.672553:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993427200 00000100:00100000:1.0:1788986012.672558:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:2.0:1788986012.672560:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993427200 00000100:00100000:1.0:1788986012.672570:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993427328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986012.672603:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:2.0:1788986012.672612:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993427200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986012.672625:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993427328:12345-0@lo:400:kworker.0 Request processed in 58us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986012.672633:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00080000:1.0:1788986012.672657:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986012.672661:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993427200:12345-0@lo:400:kworker.0 Request processed in 49us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986012.672669:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:1.0:1788986012.672686:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993427328:0@lo:400:kworker.0 00000100:00100000:2.0:1788986012.672703:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993427200:0@lo:400:kworker.0 00000100:00100000:0.0:1788986012.672813:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993426944:0@lo:400:kworker.0 00000100:00100000:0.0:1788986012.672845:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986012.672881:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993427456:0@lo:400:kworker.0 00000100:00100000:0.0:1788986012.672902:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986012.672927:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788986012.672933:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993427072:0@lo:400:kworker.0 00000100:00100000:0.0:1788986012.672966:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986012.673008:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993427584:0@lo:400:kworker.0 00000100:00100000:2.0:1788986012.673033:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993426944 00000100:00100000:0.0:1788986012.673034:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986012.673040:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993426944 00000100:00100000:0.0:1788986012.673067:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993427456 00000100:00100000:0.0:1788986012.673072:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993427456 00000100:00100000:2.0:1788986012.673076:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1788986012.673108:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993426944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986012.673132:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993427072 00000100:00100000:0.0:1788986012.673137:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993427072 00000100:00100000:2.0:1788986012.673154:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993426944:12345-0@lo:400:kworker.0 Request processed in 69us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986012.673161:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:2.0:1788986012.673163:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1788986012.673172:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993427456:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788986012.673206:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986012.673211:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993427456:12345-0@lo:400:kworker.0 Request processed in 41us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986012.673219:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00100000:2.0:1788986012.673227:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:2.0:1788986012.673236:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993427072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986012.673253:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993426944:0@lo:400:kworker.0 00000100:00100000:0.0:1788986012.673269:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993427456:0@lo:400:kworker.0 00000100:00100000:2.0:1788986012.673275:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993427072:12345-0@lo:400:kworker.0 Request processed in 38us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986012.673284:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1788986012.673309:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993427072:0@lo:400:kworker.0 00000100:00100000:1.0:1788986012.673478:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993427584 00000100:00100000:1.0:1788986012.673482:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993427584 00000100:00100000:1.0:1788986012.673532:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1788986012.673539:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993427584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986012.673580:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993427584:12345-0@lo:400:kworker.0 Request processed in 41us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986012.673587:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:0.0:1788986012.673868:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993427584:0@lo:400:kworker.0 00000100:00080000:2.0:1788986012.675590:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986013.185305:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993427712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986013.185377:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986013.185478:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993427712 00000100:00100000:1.0:1788986013.185487:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993427712 00000100:00100000:1.0:1788986013.185539:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 629 00000100:00100000:1.0:1788986013.185548:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993427712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986013.185588:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788986013.185633:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993427712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986013.185646:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 629 00000100:00100000:3.0:1788986013.185773:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942742300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993427712:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986013.633259:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986014.663125:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986014.834976:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986014.835014:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986014.835036:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986014.835059:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986014.835085:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971203200 00000100:00100000:3.0:1788986014.835116:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971203200 00000100:00100000:3.0:1788986014.835164:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971203328 00000100:00100000:3.0:1788986014.835167:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971203328 00000100:00100000:3.0:1788986014.835186:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 857 00000100:00100000:3.0:1788986014.835194:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971203200:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986014.835254:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971203200:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 60us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986014.835260:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 857 00000100:00100000:3.0:1788986014.835275:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 858 00000100:00100000:3.0:1788986014.835294:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971203328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986014.835323:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971203328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986014.835331:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 858 00000100:00080000:3.0:1788986014.835359:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986014.835362:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986014.835382:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971202944 00000100:00100000:2.0:1788986014.835397:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971202944 00000100:00100000:2.0:1788986014.835471:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1048 00000100:00100000:2.0:1788986014.835483:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971202944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986014.835566:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971202944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 86us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986014.835574:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1048 00000100:00100000:1.0:1788986014.835735:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971203072 00000100:00100000:1.0:1788986014.835740:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971203072 00000100:00100000:1.0:1788986014.835794:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1245 00000100:00100000:1.0:1788986014.835801:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971203072:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986014.835841:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971203072:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986014.835848:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1245 00000100:00080000:0.0:1788986014.837252:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788986015.039526:0:70197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1798942432869ns, next at 1776078456900ns, rc = 0 00000004:00080000:2.0:1788986015.039642:0:70197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1798942552241ns, next at 1797516961867ns, rc = 0 00000001:00080000:3.0:1788986015.106825:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00080000:3.0:1788986015.106841:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 45 committed 00000100:00100000:0.0:1788986015.107411:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993427840:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788986015.107503:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986015.107591:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993427840 00000100:00100000:0.0:1788986015.107600:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993427840 00000100:00100000:0.0:1788986015.107670:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788986015.107689:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993427840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788986015.107723:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:17 count 1 00010000:00010000:0.0:1788986015.107770:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986015.107829:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf547a71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e91 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986015.107839:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x11:0x0].0x0 since=8s v=(0 0) 00010000:00010000:0.0:1788986015.107844:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986015.107849:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986015.107884:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf547a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e91 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986015.107900:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf547a71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e91 expref: 5 pid: 8478 timeout: 1899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986015.107913:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993427968:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986015.107984:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a44db33c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788986015.107998:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788986015.109834:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 46 committed 00000004:00080000:3.0:1788986015.109871:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 45 committed 00000100:00100000:0.0:1788986015.114636:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993427968:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788986015.114706:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986015.122266:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986015.123177:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971203456 00000100:00100000:2.0:1788986015.123198:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971203456 00010000:00010000:2.0:1788986015.123243:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf547a71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e91 expref: 6 pid: 8478 timeout: 1899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986015.123303:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 332 00000100:00100000:2.0:1788986015.123313:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971203456:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788986015.123327:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986015.123332:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf547a71 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e91 expref: 6 pid: 8478 timeout: 1899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986015.123346:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf547a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e91 expref: 6 pid: 8478 timeout: 1899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986015.123677:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf547a71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e91 expref: 6 pid: 8478 timeout: 1899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986015.123694:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788986015.123698:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788986015.123704:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986015.123714:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986015.123825:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986015.123852:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986015.123861:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986015.123877:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986015.123900:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788986015.124736:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993427840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17056us (17231us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788986015.124811:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00010000:00010000:2.0:1788986015.124909:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986015.124954:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971203456:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 1640us (2695us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986015.124961:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 332 00010000:00010000:3.0:1788986015.125213:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986015.125224:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986015.125235:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986015.125240:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986015.125252:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986015.125270:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986015.125288:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf547a94 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788986015.125309:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0942740000/2, rc 0, transno 4294967330 00010000:00010000:3.0:1788986015.125329:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986015.125333:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986015.125336:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986015.125340:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993427840:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788986015.682173:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986016.704300:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986016.768395:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993428096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986016.768467:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986016.768662:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993428096 00000100:00100000:3.0:1788986016.768675:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993428096 00000100:00100000:3.0:1788986016.768755:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 630 00000100:00100000:3.0:1788986016.768768:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993428096:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986016.768813:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1788986016.768814:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986016.768901:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993428096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986016.768910:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 630 00000100:00100000:0.0:1788986016.768956:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993428096:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986017.728458:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986017.792617:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993428224:0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.792720:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986017.792833:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993428736:0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.792865:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986017.792909:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986017.792916:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993428608:0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.792945:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986017.792973:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993428480:0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.792999:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986017.793018:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788986017.793023:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993428352:0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.793057:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986017.793074:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993428864:0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.793149:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986017.793183:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993428736 00000100:00100000:1.0:1788986017.793192:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993428736 00000100:00100000:1.0:1788986017.793253:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993428480 00000100:00100000:1.0:1788986017.793256:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993428480 00000100:00100000:1.0:1788986017.793294:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993428352 00000100:00100000:1.0:1788986017.793297:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993428352 00000100:00100000:1.0:1788986017.793314:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1788986017.793323:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993428736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.793382:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993428736:12345-0@lo:400:kworker.0 Request processed in 60us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986017.793388:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:1.0:1788986017.793407:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1788986017.793413:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993428480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.793446:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993428480:12345-0@lo:400:kworker.0 Request processed in 33us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986017.793451:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:1.0:1788986017.793464:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:1.0:1788986017.793470:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993428352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.793495:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993428352:12345-0@lo:400:kworker.0 Request processed in 26us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986017.793500:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:3.0:1788986017.794677:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993428608 00000100:00100000:3.0:1788986017.794687:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993428608 00000100:00100000:3.0:1788986017.794744:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993428864 00000100:00100000:3.0:1788986017.794748:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993428864 00000100:00100000:3.0:1788986017.794802:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1788986017.794813:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993428608:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788986017.795114:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986017.795124:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986017.795141:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993428608:12345-0@lo:400:kworker.0 Request processed in 330us (2193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986017.795150:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:3.0:1788986017.795171:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1788986017.795180:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993428864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.795188:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993428352:0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.795211:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993428480:0@lo:400:kworker.0 00000100:00100000:3.0:1788986017.795220:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993428864:12345-0@lo:400:kworker.0 Request processed in 42us (2070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986017.795232:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:1.0:1788986017.795275:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993428864:0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.795314:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993428608:0@lo:400:kworker.0 00000100:00100000:1.0:1788986017.795330:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993428736:0@lo:400:kworker.0 00000100:00100000:2.0:1788986017.800133:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993428224 00000100:00100000:2.0:1788986017.800155:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993428224 00000100:00100000:2.0:1788986017.800316:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1788986017.800329:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993428224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986017.800457:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993428224:12345-0@lo:400:kworker.0 Request processed in 131us (7738us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986017.800465:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1788986017.800533:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993428224:0@lo:400:kworker.0 00000001:00080000:3.0:1788986017.855886:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967330 is committed 00000100:00100000:0.0:1788986018.308526:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993428992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986018.308627:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986018.308718:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993428992 00000100:00100000:0.0:1788986018.308909:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993428992 00000100:00100000:0.0:1788986018.308972:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 631 00000100:00100000:0.0:1788986018.308982:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993428992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986018.309253:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986018.309337:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993428992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 356us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986018.309346:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 631 00000100:00100000:0.0:1788986018.309397:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967330 gen 2 00000004:00080000:0.0:1788986018.309403:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0942740000, transno 4294967330 00000100:00100000:0.0:1788986018.309424:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993428992:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986018.752234:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986019.777144:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986019.961131:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986019.961162:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986019.961243:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986019.961281:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986019.961332:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971203712 00000100:00100000:1.0:1788986019.961350:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971203712 00000100:00100000:1.0:1788986019.961412:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1249 00000100:00100000:1.0:1788986019.961422:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971203712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986019.961492:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971203712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 71us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986019.961500:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1249 00000100:00080000:1.0:1788986019.961521:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986019.961661:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971203584 00000100:00100000:2.0:1788986019.961665:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971203584 00000100:00100000:2.0:1788986019.961701:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1050 00000100:00100000:2.0:1788986019.961708:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971203584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986019.961747:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971203584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 39us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986019.961755:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1050 00000100:00100000:3.0:1788986019.965378:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971203968 00000100:00100000:3.0:1788986019.965461:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971203968 00000100:00080000:1.0:1788986019.965686:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986019.967947:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971203840 00000100:00100000:3.0:1788986019.967959:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971203840 00000100:00100000:3.0:1788986019.968021:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 861 00000100:00100000:3.0:1788986019.968031:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971203968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986019.968116:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942740000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971203968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 85us (6952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986019.968123:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 861 00000100:00100000:3.0:1788986019.968140:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 862 00000100:00100000:3.0:1788986019.968147:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971203840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986019.968171:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971203840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (6890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986019.968177:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 862 00000100:00080000:1.0:1788986019.968529:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986020.800688:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986021.826080:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986021.891265:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986021.891288:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993429120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986021.891351:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986021.891490:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993429120 00000100:00100000:1.0:1788986021.891497:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993429120 00000100:00100000:1.0:1788986021.891560:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 632 00000100:00100000:1.0:1788986021.891570:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993429120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986021.891601:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986021.891646:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993429120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986021.891654:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 632 00000100:00080000:2.0:1788986021.891715:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986021.891750:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993429120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986022.848230:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986022.912422:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993429376:0@lo:400:kworker.0 00000100:00100000:0.0:1788986022.912486:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986022.912537:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993429888:0@lo:400:kworker.0 00000100:00100000:0.0:1788986022.912559:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986022.912581:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986022.912587:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993429504:0@lo:400:kworker.0 00000100:00100000:0.0:1788986022.912605:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986022.912637:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993429376 00000100:00100000:0.0:1788986022.912645:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993429376 00000100:00100000:0.0:1788986022.912682:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993429504 00000100:00100000:0.0:1788986022.912686:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993429504 00000100:00100000:0.0:1788986022.912713:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1788986022.912721:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993429376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986022.912767:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993429376:12345-0@lo:400:kworker.0 Request processed in 47us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986022.912774:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:0.0:1788986022.912791:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1788986022.912811:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993429504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986022.912840:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993429504:12345-0@lo:400:kworker.0 Request processed in 30us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986022.912846:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1251 00000100:00100000:0.0:1788986022.912879:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993429504:0@lo:400:kworker.0 00000100:00100000:0.0:1788986022.912890:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993429376:0@lo:400:kworker.0 00000100:00080000:2.0:1788986022.912970:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986022.912983:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993429888 00000100:00100000:2.0:1788986022.912988:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993429888 00000100:00100000:2.0:1788986022.913044:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1788986022.913052:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993429888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986022.913116:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993429888:12345-0@lo:400:kworker.0 Request processed in 66us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986022.913127:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1788986022.913147:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993429248:0@lo:400:kworker.0 00000100:00100000:2.0:1788986022.913181:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986022.913207:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993429760:0@lo:400:kworker.0 00000100:00100000:2.0:1788986022.913229:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986022.913260:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986022.913266:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993429632:0@lo:400:kworker.0 00000100:00100000:2.0:1788986022.913287:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986022.913312:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993429248 00000100:00100000:2.0:1788986022.913316:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993429248 00000100:00100000:2.0:1788986022.913340:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1788986022.913347:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993429248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986022.913380:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993429248:12345-0@lo:400:kworker.0 Request processed in 34us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986022.913386:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:2.0:1788986022.913410:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993429760 00000100:00100000:2.0:1788986022.913414:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993429760 00000100:00100000:2.0:1788986022.913435:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1788986022.913441:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993429760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986022.913466:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993429760:12345-0@lo:400:kworker.0 Request processed in 26us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986022.913475:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1788986022.913490:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993429632 00000100:00100000:2.0:1788986022.913493:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993429632 00000100:00100000:2.0:1788986022.913511:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1788986022.913516:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993429632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986022.913542:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993429632:12345-0@lo:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986022.913548:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:2.0:1788986022.913577:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993429888:0@lo:400:kworker.0 00000100:00100000:2.0:1788986022.913600:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993429632:0@lo:400:kworker.0 00000100:00100000:2.0:1788986022.913607:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993429248:0@lo:400:kworker.0 00000100:00100000:2.0:1788986022.913615:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993429760:0@lo:400:kworker.0 00000100:00080000:3.0:1788986022.914383:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986022.914388:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986023.424297:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986023.424495:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993430016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986023.424789:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986023.429136:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993430016 00000100:00100000:0.0:1788986023.429150:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993430016 00000100:00100000:0.0:1788986023.429276:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:0.0:1788986023.429288:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993430016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986023.429333:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986023.429420:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993430016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (4631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986023.429427:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1788986023.429590:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993430016:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986023.875812:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986024.896239:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986025.072193:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986025.072243:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986025.072279:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986025.072310:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986025.072323:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971204224 00000100:00100000:1.0:1788986025.072332:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971204352 00000100:00100000:0.0:1788986025.072333:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971204224 00000100:00100000:1.0:1788986025.072334:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971204352 00000100:00100000:3.0:1788986025.072373:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971204480 00000100:00100000:3.0:1788986025.072377:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971204480 00000100:00100000:1.0:1788986025.072486:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 865 00000100:00100000:1.0:1788986025.072497:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971204352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986025.072563:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971204352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986025.072571:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 865 00000100:00100000:0.0:1788986025.072914:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1253 00000100:00100000:0.0:1788986025.072923:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971204224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986025.072958:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971204224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986025.072964:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1253 00000100:00100000:2.0:1788986025.073561:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971204096 00000100:00100000:2.0:1788986025.073568:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971204096 00000100:00100000:2.0:1788986025.073609:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1052 00000100:00100000:2.0:1788986025.073618:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971204096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986025.073671:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971204096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 54us (1487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986025.073678:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1052 00000100:00100000:3.0:1788986025.080924:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 866 00000100:00100000:3.0:1788986025.080939:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971204480:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986025.081032:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971204480:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 97us (8720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986025.081041:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 866 00000100:00080000:1.0:1788986025.085856:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986025.085868:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986025.085871:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986025.920437:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986026.944247:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986027.008405:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993430144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986027.008475:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986027.008627:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993430144 00000100:00100000:0.0:1788986027.008646:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993430144 00000100:00100000:0.0:1788986027.008725:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 634 00000100:00100000:0.0:1788986027.008735:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993430144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986027.008784:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788986027.008875:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986027.009402:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993430144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 666us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986027.009410:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 634 00000100:00100000:1.0:1788986027.009514:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993430144:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986027.968338:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986028.033966:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993430528:0@lo:400:kworker.0 00000100:00100000:1.0:1788986028.033967:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993430656:0@lo:400:kworker.0 00000100:00100000:3.0:1788986028.034028:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993430272:0@lo:400:kworker.0 00000100:00100000:0.0:1788986028.034322:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993430400:0@lo:400:kworker.0 00000100:00100000:1.0:1788986028.036857:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986028.036945:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993430656 00000100:00100000:1.0:1788986028.036953:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993430656 00000100:00100000:1.0:1788986028.037000:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1788986028.037010:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993430656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986028.037065:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993430656:12345-0@lo:400:kworker.0 Request processed in 57us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986028.037072:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:2.0:1788986028.039829:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986028.039890:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993430528 00000100:00100000:2.0:1788986028.039897:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993430528 00000100:00100000:2.0:1788986028.039945:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1788986028.039954:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993430528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986028.040006:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993430528:12345-0@lo:400:kworker.0 Request processed in 54us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986028.040012:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00080000:2.0:1788986028.040034:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986028.040042:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993430656:0@lo:400:kworker.0 00000100:00100000:2.0:1788986028.040050:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993430528:0@lo:400:kworker.0 00000100:00100000:3.0:1788986028.040280:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986028.040326:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993430784:0@lo:400:kworker.0 00000100:00100000:3.0:1788986028.040363:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986028.041110:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993430784 00000100:00100000:1.0:1788986028.041116:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993430784 00000100:00100000:1.0:1788986028.041169:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:1.0:1788986028.041177:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993430784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986028.041239:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993430784:12345-0@lo:400:kworker.0 Request processed in 62us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986028.041245:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00100000:2.0:1788986028.041438:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993430272 00000100:00100000:2.0:1788986028.041444:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993430272 00000100:00100000:2.0:1788986028.041480:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1788986028.041488:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993430272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986028.041524:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993430272:12345-0@lo:400:kworker.0 Request processed in 38us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986028.041530:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00080000:3.0:1788986028.041592:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986028.041617:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993430272:0@lo:400:kworker.0 00000100:00100000:3.0:1788986028.041630:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993430784:0@lo:400:kworker.0 00000100:00100000:0.0:1788986028.041887:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986028.041954:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993430912:0@lo:400:kworker.0 00000100:00100000:0.0:1788986028.041981:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986028.042066:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993430912 00000100:00100000:2.0:1788986028.042070:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993430912 00000100:00080000:0.0:1788986028.042188:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986028.042226:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1788986028.042234:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993430912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986028.042280:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993430912:12345-0@lo:400:kworker.0 Request processed in 48us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986028.042286:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:0.0:1788986028.042333:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993430912:0@lo:400:kworker.0 00000100:00100000:3.0:1788986028.042383:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993430400 00000100:00100000:3.0:1788986028.042387:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993430400 00000100:00100000:3.0:1788986028.042421:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1788986028.042427:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993430400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986028.042480:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993430400:12345-0@lo:400:kworker.0 Request processed in 53us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986028.042486:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1788986028.042511:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993430400:0@lo:400:kworker.0 00000100:00100000:3.0:1788986028.546121:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986028.546142:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993431040:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986028.546220:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986028.546376:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993431040 00000100:00100000:0.0:1788986028.546384:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993431040 00000100:00100000:0.0:1788986028.546437:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:0.0:1788986028.546446:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993431040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986028.546478:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986028.546546:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993431040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986028.546552:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:1.0:1788986028.546646:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993431040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986028.733506:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986028.733670:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971204608 00000100:00100000:2.0:1788986028.733690:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971204608 00000100:00100000:2.0:1788986028.733764:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 546 00000100:00100000:2.0:1788986028.733775:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41164:x1875885971204608:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986028.733866:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41164:x1875885971204608:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 92us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986028.733874:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 546 00000100:00080000:0.0:1788986028.734020:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986028.735976:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986028.736056:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971204736 00000100:00100000:1.0:1788986028.736064:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971204736 00000100:00100000:1.0:1788986028.736153:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 292 00000100:00100000:1.0:1788986028.736162:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41164:x1875885971204736:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986028.736567:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41164:x1875885971204736:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 405us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986028.736575:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 292 00000100:00080000:0.0:1788986028.736764:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986028.742609:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986028.742802:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971204864 00000100:00100000:1.0:1788986028.742812:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971204864 00000100:00100000:1.0:1788986028.742877:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 293 00000100:00100000:1.0:1788986028.742887:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41164:x1875885971204864:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986028.743247:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41164:x1875885971204864:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 360us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986028.743255:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 293 00000100:00080000:0.0:1788986028.743321:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986028.746459:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986028.747115:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971204992 00000100:00100000:2.0:1788986028.747125:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971204992 00000100:00100000:2.0:1788986028.747181:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 547 00000100:00100000:2.0:1788986028.747191:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41164:x1875885971204992:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986028.749871:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41164:x1875885971204992:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 2671us (3409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986028.749884:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 547 00000100:00100000:2.0:1788986028.758672:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986028.760590:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971205120 00000100:00100000:0.0:1788986028.760602:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971205120 00000100:00100000:0.0:1788986028.760678:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 548 00000100:00100000:0.0:1788986028.760688:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41164:x1875885971205120:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986028.760779:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41164:x1875885971205120:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 92us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986028.760786:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 548 00000100:00100000:3.0:1788986028.770654:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986028.770692:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971205248 00000100:00100000:3.0:1788986028.770702:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971205248 00000100:00100000:3.0:1788986028.770748:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 294 00000100:00100000:3.0:1788986028.770758:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41164:x1875885971205248:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986028.771118:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41164:x1875885971205248:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 330us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986028.771127:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 294 00000100:00100000:1.0:1788986028.779267:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986028.779338:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971205376 00000100:00100000:2.0:1788986028.779348:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971205376 00000100:00100000:2.0:1788986028.779404:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 295 00000100:00100000:2.0:1788986028.779414:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41164:x1875885971205376:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986028.779886:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41164:x1875885971205376:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 472us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986028.779895:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 295 00000100:00100000:3.0:1788986028.783622:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986028.783708:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971205504 00000100:00100000:1.0:1788986028.783729:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971205504 00000100:00100000:1.0:1788986028.783785:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 549 00000100:00100000:1.0:1788986028.783795:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41164:x1875885971205504:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986028.784329:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41164:x1875885971205504:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 534us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986028.784338:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 549 00010000:00010000:3.0:1788986028.997307:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986030.016270:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986030.194285:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986030.194326:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986030.194364:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986030.194395:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986030.194465:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971205632 00000100:00100000:0.0:1788986030.194475:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971205632 00000100:00100000:0.0:1788986030.194546:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1054 00000100:00100000:0.0:1788986030.194557:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971205632:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986030.194619:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971205632:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986030.194627:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1054 00000100:00100000:1.0:1788986030.194834:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971206016 00000100:00100000:1.0:1788986030.194839:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971206016 00000100:00100000:1.0:1788986030.194890:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971205888 00000100:00100000:1.0:1788986030.194894:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971205888 00000100:00100000:1.0:1788986030.194920:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 869 00000100:00100000:1.0:1788986030.194929:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971206016:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986030.194959:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971206016:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986030.194965:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 869 00000100:00100000:1.0:1788986030.194981:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 870 00000100:00100000:1.0:1788986030.194988:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971205888:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986030.195013:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971205888:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986030.195019:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 870 00000100:00100000:3.0:1788986030.195150:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971205760 00000100:00100000:3.0:1788986030.195155:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971205760 00000100:00100000:3.0:1788986030.195205:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1257 00000100:00100000:3.0:1788986030.195213:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971205760:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986030.195244:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971205760:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986030.195250:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1257 00000100:00080000:0.0:1788986030.195683:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986030.195689:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986030.195691:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788986031.042571:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788986031.443019:0:70420:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc3892e1e0 20000000:00000080:0.0:1788986031.443036:0:70420:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511e3c00 uarg=0000000000000000 00010000:00010000:0.0:1788986031.444917:0:70420:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788986031.445652:0:70420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986031.445658:0:70420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986031.445669:0:70420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf547a47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e83 expref: 5 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986031.445821:0:70420:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1788986031.445846:0:70420:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986031.445862:0:70420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986031.445885:0:70420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547a24 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547a1d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986031.445892:0:70420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986031.445927:0:70420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547a24 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547a1d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986031.446033:0:70420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547a24 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547a1d expref: 18 pid: 5846 timeout: 1915 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986031.446049:0:70420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70420:1875885993431168:0@lo:104: 00000100:00100000:0.0:1788986031.446131:0:70420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986031.446206:0:70420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f5509c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986031.446220:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993431168 00000100:00100000:1.0:1788986031.446236:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993431168 00000100:00100000:1.0:1788986031.446319:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788986031.446331:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:70420:x1875885993431168:12345-0@lo:104: 00010000:00010000:1.0:1788986031.446352:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547a24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986031.446467:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986031.446474:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:70420:x1875885993431168:12345-0@lo:104: Request processed in 146us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986031.446483:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00010000:00010000:2.0:1788986031.446510:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986031.446519:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547a24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446528:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986031.446533:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547a24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446541:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547a24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986031.446548:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547a24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986031.446554:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986031.446594:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547a24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446600:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986031.446626:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547a24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446633:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf547a1d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547a24 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446648:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986031.446650:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986031.446651:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986031.446659:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986031.446670:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993431296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986031.446706:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986031.446741:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993431296 00000100:00100000:2.0:1788986031.446748:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993431296 00010000:00010000:2.0:1788986031.446772:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547a24 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547a1d expref: 19 pid: 5846 timeout: 1915 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986031.446810:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788986031.446818:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993431296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986031.446829:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986031.446834:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547a24 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547a1d expref: 19 pid: 5846 timeout: 1915 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446843:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547a24 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547a1d expref: 19 pid: 5846 timeout: 1915 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446854:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446861:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446873:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446890:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446896:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446902:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446906:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986031.446910:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446916:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446923:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986031.446931:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986031.446962:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993431296:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986031.446969:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788986031.447006:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993431296:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986031.447855:0:70420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547a24 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547a1d expref: 18 pid: 5846 timeout: 1915 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986031.447868:0:70420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70420:1875885993431168:0@lo:104: 00010000:00010000:0.0:1788986031.447885:0:70420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986031.447893:0:70420:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986031.447900:0:70420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986031.447907:0:70420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf547a9b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986032.064273:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986032.134569:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993431424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986032.134636:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986032.134706:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993431424 00000100:00100000:0.0:1788986032.134713:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993431424 00000100:00100000:0.0:1788986032.134773:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:0.0:1788986032.134783:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993431424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986032.134813:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986032.134855:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993431424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986032.134862:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00080000:0.0:1788986032.134881:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986032.134913:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993431424:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986033.088381:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986033.152978:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993431552:0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153039:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986033.153085:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993432064:0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153132:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986033.153156:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788986033.153162:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993431680:0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153196:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986033.153215:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993432192:0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153237:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986033.153266:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993431808:0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153288:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986033.153306:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986033.153312:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993431936:0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153331:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986033.153359:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993431552 00000100:00100000:2.0:1788986033.153365:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993431552 00000100:00100000:2.0:1788986033.153406:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1788986033.153414:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993431552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153473:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993431552:12345-0@lo:400:kworker.0 Request processed in 59us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986033.153480:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1788986033.153508:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993432064 00000100:00100000:2.0:1788986033.153512:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993432064 00000100:00100000:2.0:1788986033.153540:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993431680 00000100:00100000:2.0:1788986033.153543:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993431680 00000100:00100000:2.0:1788986033.153556:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993431808 00000100:00100000:2.0:1788986033.153558:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993431808 00000100:00100000:2.0:1788986033.153572:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1788986033.153578:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993432064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153606:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993432064:12345-0@lo:400:kworker.0 Request processed in 28us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986033.153612:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1788986033.153622:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1788986033.153628:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993431680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153651:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993431680:12345-0@lo:400:kworker.0 Request processed in 23us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986033.153656:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1788986033.153667:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1788986033.153673:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993431808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153703:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993431808:12345-0@lo:400:kworker.0 Request processed in 30us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986033.153708:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:2.0:1788986033.153728:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993432192 00000100:00100000:2.0:1788986033.153731:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993432192 00000100:00100000:2.0:1788986033.153754:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993431936 00000100:00100000:2.0:1788986033.153756:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993431936 00000100:00100000:2.0:1788986033.153772:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1788986033.153777:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993432192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153803:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993432192:12345-0@lo:400:kworker.0 Request processed in 26us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986033.153809:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1788986033.153819:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1788986033.153824:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993431936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153847:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993431936:12345-0@lo:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986033.153853:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00080000:2.0:1788986033.153874:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986033.153878:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986033.153924:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993431936:0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153934:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993431808:0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153960:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436e8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993431680:0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153968:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993432192:0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153975:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993431552:0@lo:400:kworker.0 00000100:00100000:2.0:1788986033.153985:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993432064:0@lo:400:kworker.0 10000000:01000000:2.0:1788986033.421206:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986033.421213:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986033.421217:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986033.421257:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986033.421269:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986033.421279:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986033.421301:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993432320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986033.421371:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986033.421421:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a50309780 going to sleep for 11 seconds 00000100:00100000:0.0:1788986033.422897:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993432320 00000100:00100000:0.0:1788986033.422908:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993432320 00000100:00100000:0.0:1788986033.422958:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1788986033.422967:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993432320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986033.422980:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986033.422996:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf547aa9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547aa2 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986033.423021:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf547aa9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547aa2 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986033.423031:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf547aa9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547aa2 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986033.423053:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef000, rc 0) 00000100:00100000:0.0:1788986033.423126:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993432320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (1755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986033.423133:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1788986033.423197:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c93100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993432320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986033.423213:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547aa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986033.423222:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547aa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986033.423242:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986033.423246:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547aa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986033.423254:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547aa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986033.664284:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993432448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986033.664347:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986033.664465:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993432448 00000100:00100000:1.0:1788986033.664473:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993432448 00000100:00100000:1.0:1788986033.664527:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:1.0:1788986033.664537:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993432448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986033.664570:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986033.664619:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c90380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993432448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986033.664627:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:2.0:1788986033.664710:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993432448:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986034.114893:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986034.177699:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986034.177776:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971206144 00000100:00100000:3.0:1788986034.177784:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971206144 00000100:00100000:3.0:1788986034.177851:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 550 00000100:00100000:3.0:1788986034.177862:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41250:x1875885971206144:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986034.177882:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986034.177904:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547ab0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e98 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986034.177983:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547ab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986034.177996:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986034.178014:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986034.178048:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:3.0:1788986034.178052:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986034.178070:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986034.178119:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547ab0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e98 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788986034.178291:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986034.178352:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e98 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986034.178362:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:3.0:1788986034.178364:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986034.178368:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2c00, rc 0) 00000100:00100000:3.0:1788986034.178422:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41250:x1875885971206144:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 562us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986034.178429:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 550 00000100:00100000:0.0:1788986034.187159:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986034.187246:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971206400 00000100:00100000:2.0:1788986034.187256:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971206400 00000100:00100000:2.0:1788986034.187311:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 551 00000100:00100000:2.0:1788986034.187321:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41250:x1875885971206400:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986034.187368:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986034.187393:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547ab7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e98 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.187413:0:7899:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf547a47) 00010000:00010000:2.0:1788986034.187417:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:2.0:1788986034.187426:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986034.187449:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547abe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.187461:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.187470:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986034.256342:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000025cb8f59 reply state 000000008136bbf1 transno 4294967503 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986034.256361:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986034.256376:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000100:00100000:3.0:1788986034.256488:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41250:x1875885971206400:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 69164us (69333us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788986034.256505:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 551 00000001:00080000:3.0:1788986034.256574:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00010000:00010000:0.0:1788986034.257402:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547abe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986034.257414:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547abe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986034.257421:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547abe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986034.257441:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986034.257446:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547abe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986034.257453:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547abe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986034.257467:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:0.0:1788986034.257470:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788986034.257473:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547abe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986034.257479:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547abe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788986034.943950:0:70617:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd1dfe7400 20000000:00000080:1.0:1788986034.943966:0:70617:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a60c96c00 uarg=0000000000000000 00010000:00010000:1.0:1788986034.944701:0:70617:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788986034.944718:0:70617:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788986034.944731:0:70617:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986034.944747:0:70617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986034.944764:0:70617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf547aa9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547aa2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986034.944778:0:70617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986034.944813:0:70617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf547aa9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547aa2 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986034.944833:0:70617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf547aa9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547aa2 expref: 18 pid: 5846 timeout: 1918 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986034.944847:0:70617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70617:1875885993432576:0@lo:104: 00000100:00100000:1.0:1788986034.944906:0:70617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986034.944956:0:70617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42bcab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788986034.946315:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993432576 00000100:00100000:2.0:1788986034.946325:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993432576 00000100:00100000:2.0:1788986034.946375:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1788986034.946383:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:70617:x1875885993432576:12345-0@lo:104: 00010000:00010000:2.0:1788986034.946397:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547aa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946465:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986034.946471:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:70617:x1875885993432576:12345-0@lo:104: Request processed in 90us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986034.946477:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00010000:00010000:2.0:1788986034.946495:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986034.946500:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547aa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946507:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986034.946511:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547aa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946518:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547aa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986034.946524:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547aa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986034.946529:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986034.946558:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547aa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946563:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986034.946579:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547aa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946584:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf547aa2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547aa9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946600:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986034.946602:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986034.946603:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986034.946613:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993432704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986034.946641:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986034.946681:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993432704 00000100:00100000:2.0:1788986034.946686:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993432704 00010000:00010000:2.0:1788986034.946701:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf547aa9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547aa2 expref: 19 pid: 5846 timeout: 1918 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986034.946719:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788986034.946725:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993432704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986034.946734:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986034.946737:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf547aa9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547aa2 expref: 19 pid: 5846 timeout: 1918 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946746:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf547aa9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547aa2 expref: 19 pid: 5846 timeout: 1918 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946759:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946766:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946778:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946784:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946791:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946797:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946801:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986034.946805:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946811:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946819:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986034.946838:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986034.946863:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993432704:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986034.946869:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788986034.946898:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993432704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986034.946977:0:70617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf547aa9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547aa2 expref: 18 pid: 5846 timeout: 1918 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986034.946986:0:70617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70617:1875885993432576:0@lo:104: 00010000:00010000:1.0:1788986034.946999:0:70617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986034.947007:0:70617:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986034.947012:0:70617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986034.947017:0:70617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547ac5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986035.149735:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986035.314193:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986035.314288:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971206528 00000100:00100000:2.0:1788986035.314298:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971206528 00000100:00100000:2.0:1788986035.314354:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1057 00000100:00100000:2.0:1788986035.314364:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971206528:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986035.314440:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971206528:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986035.314447:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1057 00000100:00100000:2.0:1788986035.317369:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986035.317822:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971206656 00000100:00100000:3.0:1788986035.317831:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971206656 00000100:00100000:3.0:1788986035.317891:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1261 00000100:00100000:3.0:1788986035.317900:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971206656:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986035.317977:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971206656:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986035.317984:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1261 00000100:00100000:1.0:1788986035.318158:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986035.318690:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971206912 00000100:00100000:3.0:1788986035.318695:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971206912 00000100:00100000:3.0:1788986035.318782:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 873 00000100:00100000:3.0:1788986035.318790:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971206912:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986035.318828:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971206912:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986035.318835:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 873 00000100:00100000:1.0:1788986035.318837:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986035.318849:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971206784 00000100:00100000:3.0:1788986035.318853:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971206784 00000100:00100000:3.0:1788986035.318891:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 874 00000100:00100000:3.0:1788986035.318898:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971206784:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986035.318936:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971206784:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (98us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986035.318942:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 874 00000100:00080000:2.0:1788986035.319276:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986035.319279:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788986036.160309:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788986036.743492:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986036.743502:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986036.743508:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986036.743570:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986036.743585:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986036.743598:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986036.743637:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993432832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986036.743722:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986036.743790:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09427c4840 going to sleep for 11 seconds 00000100:00100000:0.0:1788986036.743838:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993432832 00000100:00100000:0.0:1788986036.743846:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993432832 00000100:00100000:0.0:1788986036.743908:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1788986036.743918:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993432832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986036.743933:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986036.743947:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547ad3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547acc expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986036.743974:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547ad3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547acc expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986036.743987:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547ad3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547acc expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986036.743997:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986036.744041:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993432832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986036.744048:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1788986036.744118:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993432832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986036.744134:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547ad3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986036.744144:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547ad3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986036.744176:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986036.744182:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547ad3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986036.744201:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547ad3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986037.184954:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986037.249475:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986037.249496:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993432960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986037.249560:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986037.250043:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993432960 00000100:00100000:0.0:1788986037.250053:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993432960 00000100:00100000:0.0:1788986037.250217:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:0.0:1788986037.250228:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993432960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986037.250261:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986037.250313:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993432960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986037.250320:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00080000:2.0:1788986037.250646:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986037.250699:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993432960:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986038.208277:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986038.249221:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986038.249326:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971207040 00000100:00100000:3.0:1788986038.249344:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971207040 00000100:00100000:3.0:1788986038.249422:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 552 00000100:00100000:3.0:1788986038.249432:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41327:x1875885971207040:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:3.0:1788986038.249451:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986038.249474:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547ada lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0e9f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249533:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547ae1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249547:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249560:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249585:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547ae8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249592:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249599:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788986038.249851:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986038.249892:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547aef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249901:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249913:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986038.249935:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:3.0:1788986038.249938:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986038.249955:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249967:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547ae1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249973:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547ae1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249980:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249985:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986038.249989:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547ae1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.249996:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547ae1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.250006:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:3.0:1788986038.250009:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986038.250014:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547ae1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.250033:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547ae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.250053:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547ae8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.250059:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547ae8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.250065:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.250071:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986038.250074:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547ae8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.250080:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547ae8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.250137:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a55745600) 00010000:00010000:3.0:1788986038.250141:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986038.250144:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547ae8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.250160:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547ae8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.250189:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547ada lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e9f expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.250204:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e9f expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.250215:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:3.0:1788986038.250217:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986038.250220:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2c00, rc 0) 00000100:00100000:3.0:1788986038.250270:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41327:x1875885971207040:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 839us (1056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986038.250277:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 552 00000100:00100000:3.0:1788986038.258082:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986038.261782:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971207296 00000100:00100000:2.0:1788986038.261795:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971207296 00000100:00100000:2.0:1788986038.261980:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 553 00000100:00100000:2.0:1788986038.261991:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41327:x1875885971207296:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986038.262010:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986038.262032:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547af6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ea6 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.262307:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547afd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.263431:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547afd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.263447:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547afd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.263466:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547b04 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.263473:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547b04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.263480:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547b04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986038.264214:0:6925:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6925:1875885993433088:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788986038.264292:0:6925:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986038.264355:0:6925:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09427c49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986038.264971:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993433088 00000100:00100000:1.0:1788986038.264988:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993433088 00000100:00100000:1.0:1788986038.265038:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1788986038.265049:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:6925:x1875885993433088:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788986038.265108:0:8478:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:2.0:1788986038.266271:0:7899:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x12:0x0], index 0: 0 00010000:00010000:2.0:1788986038.268635:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547b0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.268658:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.268670:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547b0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.268710:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547afd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.268718:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547afd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.268725:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547afd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.268730:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986038.268734:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547afd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.268741:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547afd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.268753:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:2.0:1788986038.268756:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986038.268760:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547afd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.268767:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547afd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986038.268779:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007d047c61 reply state 000000009269ad76 transno 4294967504 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547b04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986038.268788:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986038.271569:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547af6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ea6 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.271598:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547b0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ea6 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.271607:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:2.0:1788986038.271610:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986038.271613:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1a00, rc 0) 00000100:00100000:2.0:1788986038.271690:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:41327:x1875885971207296:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 9700us (13615us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788986038.271699:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 553 00000100:00100000:2.0:1788986038.272313:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993433216:0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.272376:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986038.272416:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993433728:0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.272440:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986038.272462:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986038.272467:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993433600:0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.272489:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986038.272515:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993433344:0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.272538:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986038.272568:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986038.272575:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993433472:0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.272596:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986038.272635:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993433216 00000100:00100000:2.0:1788986038.272642:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993433216 00000100:00100000:2.0:1788986038.272677:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1788986038.272685:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993433216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.272728:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993433216:12345-0@lo:400:kworker.0 Request processed in 44us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986038.272734:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1788986038.272762:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993433728 00000100:00100000:2.0:1788986038.272765:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993433728 00000100:00100000:2.0:1788986038.272798:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:2.0:1788986038.272817:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993433728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.272854:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993433728:12345-0@lo:400:kworker.0 Request processed in 39us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986038.272860:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:2.0:1788986038.272877:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993433600 00000100:00100000:2.0:1788986038.272881:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993433600 00000100:00100000:2.0:1788986038.272902:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993433344 00000100:00100000:2.0:1788986038.272905:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993433344 00000100:00100000:2.0:1788986038.272918:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993433472 00000100:00100000:2.0:1788986038.272920:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993433472 00000100:00100000:2.0:1788986038.272933:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1788986038.272938:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993433600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.272966:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993433600:12345-0@lo:400:kworker.0 Request processed in 28us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986038.272971:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:2.0:1788986038.272983:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1788986038.272988:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993433344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.273014:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993433344:12345-0@lo:400:kworker.0 Request processed in 25us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986038.273018:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:2.0:1788986038.273028:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1788986038.273034:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993433472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.273080:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993433472:12345-0@lo:400:kworker.0 Request processed in 45us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986038.273106:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1788986038.273142:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993433600:0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.273166:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993433216:0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.273177:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993433728:0@lo:400:kworker.0 00000100:00080000:2.0:1788986038.273200:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986038.273204:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986038.273223:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993433472:0@lo:400:kworker.0 00000100:00100000:2.0:1788986038.273232:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993433344:0@lo:400:kworker.0 00010000:00010000:2.0:1788986038.281566:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547b04 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.281581:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547b04 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.281589:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547b04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.281595:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986038.281599:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547b04 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.281607:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547b04 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.281696:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a45aca700) 00010000:00010000:2.0:1788986038.281701:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986038.281706:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547b04 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.281713:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547b04 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986038.283978:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986038.284050:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971207552 00000100:00100000:2.0:1788986038.284059:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971207552 00000100:00100000:2.0:1788986038.284136:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 554 00000100:00100000:2.0:1788986038.284146:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:41327:x1875885971207552:12345-192.168.206.21@tcp:36:touch.60003 00010000:00010000:2.0:1788986038.284208:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986038.284231:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547b0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ea6 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.284248:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:2.0:1788986038.284258:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986038.284293:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547b19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.284306:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.284329:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986038.284433:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000900a77cb reply state 00000000a3320268 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986038.284447:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986038.284531:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941f79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:41327:x1875885971207552:12345-192.168.206.21@tcp:36:touch.60003 Request processed in 385us (560us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1788986038.284538:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 554 00010000:00010000:3.0:1788986038.287377:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547b19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.287392:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547b19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.287400:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547b19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.287405:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986038.287410:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547b19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.287418:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547b19 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.287432:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:3.0:1788986038.287435:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986038.287439:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547b19 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.287449:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547b19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986038.289694:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986038.289867:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971207680 00000100:00100000:2.0:1788986038.289876:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971207680 00000100:00100000:2.0:1788986038.289928:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 555 00000100:00100000:2.0:1788986038.289939:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:41327:x1875885971207680:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986038.289962:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986038.289986:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547b20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ead expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.290041:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547b20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ead expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.290067:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547b20 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ead expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.290086:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:2.0:1788986038.290123:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788986038.290127:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986038.290195:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:41327:x1875885971207680:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 258us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986038.290498:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 555 00000100:00100000:0.0:1788986038.297160:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986038.297392:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971207808 00000100:00100000:3.0:1788986038.297401:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971207808 00000100:00100000:3.0:1788986038.297459:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 297 00000100:00100000:3.0:1788986038.297469:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971207808:12345-192.168.206.21@tcp:2:touch.60003 00000100:00080000:0.0:1788986038.297610:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986038.306117:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971207808:12345-192.168.206.21@tcp:2:touch.60003 Request processed in 8643us (8972us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788986038.306128:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 297 00000100:00100000:1.0:1788986038.312191:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:6925:x1875885993433088:12345-0@lo:5:osp-pre-0-0.0 Request processed in 47138us (47893us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788986038.312204:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788986038.313652:0:6925:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6925:1875885993433088:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788986038.313669:0:6925:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x12:0x0]-[0x240000400:0x41:0x0] 00000100:00100000:0.0:1788986038.314635:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986038.314812:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971208064 00000100:00100000:1.0:1788986038.314820:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971208064 00000100:00100000:1.0:1788986038.314874:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:1.0:1788986038.314884:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:41327:x1875885971208064:12345-192.168.206.21@tcp:35:touch.60003 00000100:00100000:0.0:1788986038.315502:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:41327:x1875885971208064:12345-192.168.206.21@tcp:35:touch.60003 Request processed in 617us (869us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788986038.315510:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 56 00000100:00100000:2.0:1788986038.428491:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986038.428626:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971208192 00000100:00100000:0.0:1788986038.428638:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971208192 00000100:00100000:0.0:1788986038.428709:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 556 00000100:00100000:0.0:1788986038.428721:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:41331:x1875885971208192:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:0.0:1788986038.429344:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986038.429388:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf547b27 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0eb4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429475:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547b2e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429493:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547b2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429507:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547b2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429522:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547b35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429529:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429536:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429655:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547b3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429665:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429672:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986038.429722:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2e:0x0]: returning size 0 00000004:00200000:0.0:1788986038.429727:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986038.429768:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429789:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547b3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429798:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547b2e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429804:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547b2e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429811:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547b2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429817:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986038.429822:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547b2e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429830:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547b2e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429843:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:0.0:1788986038.429847:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986038.429852:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547b2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429860:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547b2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429875:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547b35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429880:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547b35 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429892:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429897:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986038.429901:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547b35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429907:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547b35 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429916:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a4823ba00) 00010000:00010000:0.0:1788986038.429918:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986038.429921:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547b35 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429926:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547b35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429962:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf547b27 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0eb4 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429977:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547b3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0eb4 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986038.429984:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:0.0:1788986038.429986:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986038.429989:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee800, rc 0) 00000100:00100000:0.0:1788986038.430074:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:41331:x1875885971208192:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 1355us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986038.430137:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 556 00000100:00100000:1.0:1788986038.436033:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986038.436144:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971208320 00000100:00100000:2.0:1788986038.436167:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971208320 00000100:00100000:2.0:1788986038.436245:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 298 00000100:00100000:2.0:1788986038.436256:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971208320:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:2.0:1788986038.436278:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986038.436304:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d22b1620/0xc20d828fcf547b43 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ebb expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788986038.436338:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x6aa1c2b5, atime: 0x6aa1c2b5, ctime: 0x6aa1c2b5, blocks: 0x1 00010000:00010000:2.0:1788986038.436363:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=1822s v=(0 0) 00010000:00010000:2.0:1788986038.436367:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986038.436378:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d22b1620/0xc20d828fcf547b43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ebb expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.436401:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d22b1620/0xc20d828fcf547b43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ebb expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.436415:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1a00, rc 0) 00000100:00100000:2.0:1788986038.436487:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971208320:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 233us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986038.436495:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 298 00000100:00100000:1.0:1788986038.442463:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986038.443035:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971208576 00000100:00100000:3.0:1788986038.443048:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971208576 00000100:00100000:3.0:1788986038.443175:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 557 00000100:00100000:3.0:1788986038.443187:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:41331:x1875885971208576:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:3.0:1788986038.443259:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986038.443296:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547b3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0eb4 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.443321:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547b20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ead expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.443332:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:3.0:1788986038.443346:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986038.443373:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547b4a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.443390:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547b4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.443400:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547b4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.443415:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547b51 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.443422:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.443428:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.443548:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547b58 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.443556:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547b58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.443562:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547b58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788986038.444410:0:15241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].18, 64 off9344 00000004:00080000:3.0:1788986038.444422:0:15241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1822347332120ns, next at 1823347329039ns, rc = 0 00010000:00010000:3.0:1788986038.444497:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547b5f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444516:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547b5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444527:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547b5f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444536:0:15241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547b5f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444543:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547b5f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444550:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547b5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444577:0:15241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986038.444605:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547b58 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444612:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547b58 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444618:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547b58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444625:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986038.444630:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547b58 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444639:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547b58 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444655:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:3.0:1788986038.444658:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986038.444663:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547b58 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444669:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547b58 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444691:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547b4a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444697:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547b4a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444703:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547b4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444708:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986038.444711:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547b4a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444718:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547b4a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444725:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:3.0:1788986038.444728:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986038.444731:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547b4a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986038.444737:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547b4a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986038.444751:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e93fb4cc reply state 00000000b8466543 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986038.444774:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986038.444887:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:41331:x1875885971208576:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 1699us (2435us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788986038.444895:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 557 00010000:00010000:1.0:1788986038.445179:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986038.445187:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547b5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986038.445194:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986038.445197:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547b5f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986038.445205:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547b5f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986038.445215:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2e:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:1.0:1788986038.445218:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788986038.445221:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547b5f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986038.445227:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf547b5f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986038.445258:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986038.445260:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986038.445262:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986038.447133:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547b51 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.447160:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547b51 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.447168:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547b51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.447175:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986038.447181:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547b51 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.447187:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547b51 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.447204:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a55745700) 00010000:00010000:2.0:1788986038.447207:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986038.447212:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547b51 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986038.447218:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf547b51 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986038.785821:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993433856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986038.785917:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986038.786144:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993433856 00000100:00100000:3.0:1788986038.786165:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993433856 00000100:00100000:3.0:1788986038.786233:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1788986038.786245:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993433856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986038.786289:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986038.786364:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993433856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986038.786372:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1788986038.786430:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993433856:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986039.235346:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986039.381027:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000001:00080000:3.0:1788986039.381057:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:3.0:1788986039.381061:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 46 committed 00000100:00100000:0.0:1788986039.381310:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986039.381335:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993433984:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788986039.381419:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986039.381742:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993433984 00000100:00100000:3.0:1788986039.381751:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993433984 00000100:00100000:3.0:1788986039.381818:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788986039.381828:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993433984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788986039.381861:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:18 count 1 00010000:00010000:3.0:1788986039.381892:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.381923:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d22b1620/0xc20d828fcf547b43 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ebb expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.381933:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788986039.381938:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986039.381944:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.381976:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d22b1620/0xc20d828fcf547b43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ebb expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.381993:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d22b1620/0xc20d828fcf547b43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ebb expref: 6 pid: 6697 timeout: 1923 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986039.382007:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993434112:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788986039.382086:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a4822a900 going to sleep for 11 seconds 00000100:00080000:0.0:1788986039.382185:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986039.393965:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986039.394011:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971208704 00000100:00100000:3.0:1788986039.394024:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971208704 00010000:00010000:3.0:1788986039.394080:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d22b1620/0xc20d828fcf547b43 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ebb expref: 7 pid: 6697 timeout: 1923 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986039.394119:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993434112:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788986039.394160:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986039.394630:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 335 00000100:00100000:3.0:1788986039.394896:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971208704:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986039.394919:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986039.394929:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d22b1620/0xc20d828fcf547b43 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ebb expref: 7 pid: 6697 timeout: 1923 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.394945:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d22b1620/0xc20d828fcf547b43 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ebb expref: 7 pid: 6697 timeout: 1923 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.394973:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d22b1620/0xc20d828fcf547b43 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ebb expref: 7 pid: 6697 timeout: 1923 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.394995:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986039.395001:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986039.395007:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.395018:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.395056:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986039.395156:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c93100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971208704:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 506us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986039.395165:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 335 00010000:00010000:1.0:1788986039.395213:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986039.395226:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986039.395238:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986039.395247:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986039.399060:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788986039.399886:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3320:x1875885993433984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18051us (18460us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788986039.399898:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000004:00080000:1.0:1788986039.399991:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a767ffb80/2, rc 0, transno 4294967333 00000100:00100000:1.0:1788986039.400004:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993433984:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788986039.400028:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986039.400041:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.400056:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986039.400062:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.400075:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.400219:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.400230:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000491d9776/0xc20d828fcf547b66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986039.400257:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986039.400259:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986039.400262:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986040.256260:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986040.434832:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986040.434886:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986040.434921:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986040.434957:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986040.435016:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971208832 00000100:00100000:2.0:1788986040.435213:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971209216 00000100:00100000:2.0:1788986040.435221:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971209216 00000100:00100000:2.0:1788986040.435290:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971209088 00000100:00100000:2.0:1788986040.435294:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971209088 00000100:00100000:2.0:1788986040.435323:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 876 00000100:00100000:2.0:1788986040.435336:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971209216:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986040.435427:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971209216:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 94us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986040.435435:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 876 00000100:00100000:2.0:1788986040.435633:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 877 00000100:00100000:2.0:1788986040.435640:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971209088:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986040.435665:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971209088:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986040.435671:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 877 00000100:00080000:2.0:1788986040.435689:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986040.435694:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986040.435888:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971208832 00000100:00100000:1.0:1788986040.435921:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1060 00000100:00100000:1.0:1788986040.435927:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971208832:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986040.435963:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971208832:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986040.435969:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1060 00000100:00100000:3.0:1788986040.437517:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971208960 00000100:00100000:3.0:1788986040.437531:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971208960 00000100:00100000:3.0:1788986040.437678:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1265 00000100:00100000:3.0:1788986040.437690:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971208960:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986040.437769:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971208960:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 82us (2951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986040.437776:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1265 00000100:00080000:0.0:1788986040.438366:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:0.0:1788986040.846628:0:70861:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec89a2e70 20000000:00000080:0.0:1788986040.846653:0:70861:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511e1400 uarg=0000000000000000 00010000:00010000:0.0:1788986040.851297:0:70861:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788986040.851352:0:70861:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:0.0:1788986040.851356:0:70861:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986040.851371:0:70861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547aef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0e9f expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.851401:0:70861:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1788986040.851420:0:70861:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986040.851437:0:70861:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.851452:0:70861:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547ad3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547acc expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.851461:0:70861:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.851522:0:70861:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547ad3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547acc expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.851539:0:70861:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547ad3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547acc expref: 18 pid: 5849 timeout: 1924 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986040.851556:0:70861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70861:1875885993434240:0@lo:104: 00000100:00100000:0.0:1788986040.852906:0:70861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986040.853052:0:70861:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09427c4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788986040.856167:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993434240 00000100:00100000:1.0:1788986040.856190:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993434240 00000100:00100000:1.0:1788986040.856276:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788986040.856289:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:70861:x1875885993434240:12345-0@lo:104: 00010000:00010000:1.0:1788986040.856313:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547ad3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986040.856457:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986040.856464:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:70861:x1875885993434240:12345-0@lo:104: Request processed in 179us (3566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986040.856472:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788986040.856630:0:70861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:70861:1875885993434240:0@lo:104: 00010000:00010000:0.0:1788986040.856833:0:70861:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986040.856839:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986040.856848:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547ad3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986040.856856:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986040.856861:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547ad3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986040.856870:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547ad3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986040.856879:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547ad3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986040.856885:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986040.856941:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547ad3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986040.856947:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986040.856978:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547ad3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986040.856985:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee000/0xc20d828fcf547acc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547ad3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986040.857005:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986040.857007:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986040.857009:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986040.857017:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986040.857032:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993434368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986040.857083:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986040.857152:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993434368 00000100:00100000:0.0:1788986040.857157:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993434368 00010000:00010000:0.0:1788986040.857183:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547ad3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547acc expref: 19 pid: 5849 timeout: 1924 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986040.857218:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788986040.857227:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993434368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986040.857240:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986040.857245:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547ad3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547acc expref: 19 pid: 5849 timeout: 1924 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.857256:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547ad3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547acc expref: 19 pid: 5849 timeout: 1924 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.857269:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547ad3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547acc expref: 19 pid: 5849 timeout: 1924 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.857295:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.857304:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.857320:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.857327:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.857335:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.857342:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.857347:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986040.857351:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.857359:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.857372:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986040.857381:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986040.857414:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993434368:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (330us total) trans 0 rc 0/0 00010000:00010000:2.0:1788986040.857425:0:70861:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986040.857426:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00010000:00010000:2.0:1788986040.857433:0:70861:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986040.857440:0:70861:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf547b6d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 70861 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986040.857577:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993434368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986041.281959:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986042.312191:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788986042.368182:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986042.368190:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986042.368195:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986042.368241:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986042.368253:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986042.368263:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986042.368290:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993434496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986042.368356:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986042.368406:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09427c4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788986042.368475:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993434496 00000100:00100000:1.0:1788986042.368483:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993434496 00000100:00100000:1.0:1788986042.368535:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1788986042.368544:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993434496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986042.368557:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986042.368569:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547b7b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547b74 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986042.368590:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547b7b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547b74 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986042.368626:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547b7b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547b74 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986042.368635:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788986042.368682:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993434496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986042.368689:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1788986042.368882:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993434496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986042.368896:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547b7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986042.368905:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547b7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986042.368923:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986042.368929:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547b7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986042.368936:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547b7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986042.369186:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986042.369198:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993434624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986042.369232:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986042.369307:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993434624 00000100:00100000:0.0:1788986042.369311:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993434624 00000100:00100000:0.0:1788986042.369357:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1788986042.369364:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875885993434624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986042.369391:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986042.369432:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3318:x1875885993434624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986042.369438:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:0.0:1788986042.369475:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993434624:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986042.369527:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986043.329260:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986043.392452:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993434880:0@lo:400:kworker.0 00000100:00100000:3.0:1788986043.392549:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986043.392604:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993435392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986043.392630:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986043.392652:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788986043.392657:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993434752:0@lo:400:kworker.0 00000100:00100000:3.0:1788986043.392683:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986043.392715:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993435008:0@lo:400:kworker.0 00000100:00100000:3.0:1788986043.392717:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993435264:0@lo:400:kworker.0 00000100:00100000:3.0:1788986043.392739:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986043.392763:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986043.392782:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986043.392787:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993435136:0@lo:400:kworker.0 00000100:00100000:0.0:1788986043.392809:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986043.392836:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993434880 00000100:00100000:0.0:1788986043.392842:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993434880 00000100:00100000:2.0:1788986043.392872:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993435264 00000100:00100000:2.0:1788986043.392879:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993435264 00000100:00100000:0.0:1788986043.392885:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993435008 00000100:00100000:0.0:1788986043.392891:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993435008 00000100:00100000:2.0:1788986043.392925:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1266 00000100:00100000:2.0:1788986043.392935:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993434880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986043.392982:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993435392 00000100:00100000:1.0:1788986043.392987:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993435392 00000100:00100000:2.0:1788986043.393001:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993434880:12345-0@lo:400:kworker.0 Request processed in 67us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986043.393009:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1266 00000100:00100000:1.0:1788986043.393021:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993435136 00000100:00100000:1.0:1788986043.393025:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993435136 00000100:00100000:2.0:1788986043.393031:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:2.0:1788986043.393040:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993435264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986043.393050:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:1.0:1788986043.393060:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993435392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986043.393075:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993435264:12345-0@lo:400:kworker.0 Request processed in 36us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986043.393082:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:1.0:1788986043.393139:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993435392:12345-0@lo:400:kworker.0 Request processed in 81us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986043.393146:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:1.0:1788986043.393151:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:2.0:1788986043.393158:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993435008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986043.393173:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:1.0:1788986043.393181:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3318:x1875885993435136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986043.400233:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993434752 00000100:00100000:0.0:1788986043.400248:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993434752 00000100:00100000:0.0:1788986043.400306:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1788986043.400316:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993434752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986043.400395:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993434752:12345-0@lo:400:kworker.0 Request processed in 81us (7710us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986043.400402:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:2.0:1788986043.401554:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993435008:12345-0@lo:400:kworker.0 Request processed in 8395us (8785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986043.401566:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00080000:2.0:1788986043.401594:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986043.401600:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986043.401785:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993435008:0@lo:400:kworker.0 00000100:00100000:2.0:1788986043.402286:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993434752:0@lo:400:kworker.0 00000100:00100000:2.0:1788986043.402300:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993435264:0@lo:400:kworker.0 00000100:00100000:2.0:1788986043.402312:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993434880:0@lo:400:kworker.0 00000100:00100000:2.0:1788986043.402322:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993435392:0@lo:400:kworker.0 00000100:00100000:1.0:1788986043.404563:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3318:x1875885993435136:12345-0@lo:400:kworker.0 Request processed in 11375us (11745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986043.404576:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:0.0:1788986043.404783:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993435136:0@lo:400:kworker.0 00000001:00080000:0.0:1788986043.510153:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967333 is committed 00000001:00080000:0.0:1788986043.510228:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967331 is committed 00000100:00100000:0.0:1788986043.833496:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986043.833619:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971209344 00000100:00100000:1.0:1788986043.833628:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971209344 00000100:00100000:1.0:1788986043.833699:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 558 00000100:00100000:1.0:1788986043.833709:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41424:x1875885971209344:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986043.833726:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986043.833759:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547b82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ec2 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986043.833820:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547b89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986043.833832:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986043.833844:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986043.833890:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:1.0:1788986043.833894:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986043.833914:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547b89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986043.833936:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547b82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ec2 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986043.833956:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547b89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ec2 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986043.833965:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316700) 00010000:00010000:1.0:1788986043.833967:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986043.833971:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00080000:0.0:1788986043.834154:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986043.834286:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41424:x1875885971209344:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 578us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986043.834294:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 558 00000100:00100000:1.0:1788986043.839469:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986043.839688:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971209600 00000100:00100000:0.0:1788986043.839697:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971209600 00000100:00100000:0.0:1788986043.839781:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 559 00000100:00100000:0.0:1788986043.839792:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41424:x1875885971209600:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788986043.839842:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986043.839878:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547b89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ec2 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986043.839902:0:5856:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf547aef) 00010000:00010000:0.0:1788986043.839906:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45316700) 00010000:00010000:0.0:1788986043.839917:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986043.839941:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547b90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986043.839953:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986043.839963:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986043.873308:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d26f8bde reply state 00000000e7fe8e36 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986043.873325:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986043.873340:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000100:00100000:1.0:1788986043.873451:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41424:x1875885971209600:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 33657us (33987us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1788986043.873460:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 559 00000001:00080000:3.0:1788986043.874136:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00010000:00010000:0.0:1788986043.874289:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547b90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986043.874300:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547b90 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986043.874307:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547b90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986043.874313:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986043.874317:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547b90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986043.874324:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547b90 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986043.874339:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:0.0:1788986043.874342:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788986043.874362:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547b90 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986043.874368:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547b90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986043.904339:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986043.904362:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993435520:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986043.904427:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986043.904627:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993435520 00000100:00100000:3.0:1788986043.904635:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993435520 00000100:00100000:3.0:1788986043.904682:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 641 00000100:00100000:3.0:1788986043.904692:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993435520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986043.904723:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986043.904779:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993435520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986043.904786:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 641 00000100:00100000:1.0:1788986043.905050:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993435520:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986044.353150:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788986044.670501:0:71057:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcc404af30 20000000:00000080:0.0:1788986044.670518:0:71057:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0943779800 uarg=0000000000000000 00010000:00010000:0.0:1788986044.671075:0:71057:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986044.671160:0:71057:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986044.671288:0:71057:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986044.671306:0:71057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986044.671323:0:71057:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547b7b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547b74 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986044.671332:0:71057:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986044.671367:0:71057:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547b7b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547b74 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986044.671382:0:71057:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547b7b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547b74 expref: 18 pid: 5849 timeout: 1928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986044.671396:0:71057:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71057:1875885993435648:0@lo:104: 00000100:00100000:0.0:1788986044.671452:0:71057:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986044.671553:0:71057:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a457dc300 going to sleep for 11 seconds 00000100:00100000:3.0:1788986044.671601:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993435648 00000100:00100000:3.0:1788986044.671608:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993435648 00000100:00100000:3.0:1788986044.671693:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788986044.671705:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:71057:x1875885993435648:12345-0@lo:104: 00010000:00010000:3.0:1788986044.671717:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547b7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986044.671897:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986044.671904:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:71057:x1875885993435648:12345-0@lo:104: Request processed in 202us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986044.671911:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00010000:00010000:2.0:1788986044.671979:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986044.671986:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547b7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.671994:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986044.671997:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547b7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672006:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547b7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986044.672013:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547b7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986044.672019:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986044.672056:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547b7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672063:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986044.672082:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547b7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672124:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf547b74 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547b7b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672137:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986044.672139:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986044.672141:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986044.672149:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986044.672160:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993435776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986044.672190:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986044.672229:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993435776 00000100:00100000:2.0:1788986044.672233:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993435776 00010000:00010000:2.0:1788986044.672252:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547b7b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547b74 expref: 19 pid: 5849 timeout: 1928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986044.672275:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788986044.672282:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993435776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986044.672292:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986044.672297:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547b7b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547b74 expref: 19 pid: 5849 timeout: 1928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672306:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547b7b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547b74 expref: 19 pid: 5849 timeout: 1928 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672321:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672328:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672341:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672347:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672353:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672361:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672366:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986044.672370:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672377:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672385:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986044.672394:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986044.672425:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993435776:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986044.672432:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788986044.672464:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993435776:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986044.672913:0:71057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547b7b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547b74 expref: 18 pid: 5849 timeout: 1928 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986044.672942:0:71057:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71057:1875885993435648:0@lo:104: 00010000:00010000:0.0:1788986044.672954:0:71057:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986044.672962:0:71057:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986044.672967:0:71057:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986044.672973:0:71057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547b97 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986045.377296:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986045.552543:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986045.552590:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986045.552661:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986045.552694:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986045.552732:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971209856 00000100:00100000:1.0:1788986045.552741:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971209856 00000100:00100000:1.0:1788986045.552795:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1269 00000100:00100000:1.0:1788986045.552805:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971209856:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986045.552870:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971209856:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 66us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986045.552877:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1269 00000100:00100000:1.0:1788986045.552899:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971209984 00000100:00100000:1.0:1788986045.552903:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971209984 00000100:00100000:1.0:1788986045.552941:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971210112 00000100:00100000:1.0:1788986045.552944:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971210112 00000100:00100000:1.0:1788986045.552962:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 880 00000100:00100000:1.0:1788986045.552968:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971209984:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986045.552995:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971209984:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986045.553002:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 880 00000100:00100000:1.0:1788986045.553014:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 881 00000100:00100000:1.0:1788986045.553021:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971210112:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986045.553044:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79725c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971210112:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986045.553049:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 881 00000100:00080000:1.0:1788986045.553064:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986045.553067:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986045.553070:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986045.553300:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971209728 00000100:00100000:2.0:1788986045.553305:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971209728 00000100:00100000:2.0:1788986045.553333:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1063 00000100:00100000:2.0:1788986045.553340:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971209728:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986045.553369:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971209728:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986045.553376:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1063 00010000:00010000:1.0:1788986046.402807:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788986046.656966:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986046.656975:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986046.656980:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986046.657026:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986046.657039:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986046.657049:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986046.657072:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79725500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993435904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986046.657189:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986046.657235:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a511f33c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788986046.657428:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993435904 00000100:00100000:0.0:1788986046.657436:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993435904 00000100:00100000:0.0:1788986046.657542:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1788986046.657552:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993435904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986046.657564:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986046.657585:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547ba5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547b9e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986046.657606:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547ba5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547b9e expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986046.657617:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547ba5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547b9e expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986046.657625:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efe00, rc 0) 00000100:00100000:0.0:1788986046.657677:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993435904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986046.657685:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:1.0:1788986046.657949:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79725500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993435904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986046.657965:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547ba5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986046.657974:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547ba5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986046.657991:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986046.657996:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547ba5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986046.658003:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547ba5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986047.424276:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986047.474365:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986047.474460:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971210240 00000100:00100000:0.0:1788986047.474471:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971210240 00000100:00100000:0.0:1788986047.474552:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 560 00000100:00100000:0.0:1788986047.474563:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41500:x1875885971210240:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788986047.474583:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986047.474643:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547bac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ec9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986047.474720:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547bb3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986047.474733:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986047.474745:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788986047.475755:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986047.485617:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547bba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.485645:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.485658:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486010:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf547bc1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486019:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf547bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486027:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf547bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986047.486056:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:2.0:1788986047.486060:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986047.486123:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf547bc1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486137:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547bb3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486144:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547bb3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486151:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486157:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986047.486161:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547bb3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486169:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547bb3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486179:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:2.0:1788986047.486183:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986047.486187:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547bb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486192:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547bb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486204:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486209:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547bba lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486214:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547bba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486218:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986047.486220:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547bba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486226:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547bba lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486232:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986047.486235:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986047.486237:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547bba lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486246:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547bba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486279:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547bac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ec9 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486295:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf547bc1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ec9 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986047.486302:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986047.486304:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986047.486307:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0a00, rc 0) 00000100:00100000:2.0:1788986047.486382:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79725500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41500:x1875885971210240:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 11820us (12024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986047.486390:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 560 00000100:00100000:1.0:1788986047.488255:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993436032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986047.488314:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986047.488615:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993436032 00000100:00100000:3.0:1788986047.488624:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993436032 00000100:00100000:3.0:1788986047.488691:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1788986047.488702:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993436032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986047.488731:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986047.488778:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993436032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986047.488785:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 642 00000100:00100000:3.0:1788986047.488817:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967333 gen 2 00000004:00080000:3.0:1788986047.488830:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a767ffb80, transno 4294967333 00000100:00100000:3.0:1788986047.488847:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993436032:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986047.489122:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986048.449238:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986048.515938:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993436160:0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.516004:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986048.516049:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993436672:0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.516074:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986048.516132:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986048.516138:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993436544:0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.516164:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986048.516190:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993436288:0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.516210:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986048.516224:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993436800:0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.516240:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986048.517624:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986048.517640:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993436416:0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.517684:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986048.517725:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993436160 00000100:00100000:1.0:1788986048.517733:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993436160 00000100:00100000:1.0:1788986048.518043:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1788986048.518053:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993436160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.518128:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993436160:12345-0@lo:400:kworker.0 Request processed in 77us (2123us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986048.518135:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1788986048.518164:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993436672 00000100:00100000:1.0:1788986048.518168:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993436672 00000100:00100000:1.0:1788986048.518198:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993436288 00000100:00100000:1.0:1788986048.518201:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993436288 00000100:00100000:1.0:1788986048.518216:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993436416 00000100:00100000:1.0:1788986048.518219:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993436416 00000100:00100000:1.0:1788986048.518231:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1788986048.518237:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993436672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.519707:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993436672:12345-0@lo:400:kworker.0 Request processed in 1466us (3627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986048.519726:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:1.0:1788986048.519868:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1788986048.519879:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993436288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.519926:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993436288:12345-0@lo:400:kworker.0 Request processed in 50us (3714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986048.519932:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1788986048.519946:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1788986048.519953:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993436416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.519981:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993436416:12345-0@lo:400:kworker.0 Request processed in 29us (2296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986048.519986:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1788986048.520008:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993436544 00000100:00100000:1.0:1788986048.520014:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993436544 00000100:00100000:1.0:1788986048.520040:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993436800 00000100:00100000:1.0:1788986048.520043:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993436800 00000100:00100000:1.0:1788986048.520066:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:1.0:1788986048.520072:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993436544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.520130:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993436544:12345-0@lo:400:kworker.0 Request processed in 58us (3964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986048.520136:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:1.0:1788986048.520146:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:1.0:1788986048.520151:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993436800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.520175:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942741f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993436800:12345-0@lo:400:kworker.0 Request processed in 24us (3934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986048.520181:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00080000:1.0:1788986048.520218:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986048.520222:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986048.521984:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993436416:0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.522000:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993436288:0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.522010:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993436800:0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.523009:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993436544:0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.523022:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993436160:0@lo:400:kworker.0 00000100:00100000:1.0:1788986048.523032:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993436672:0@lo:400:kworker.0 00000100:00100000:1.0:1788986049.024386:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993436928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986049.024447:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986049.024509:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993436928 00000100:00100000:1.0:1788986049.024516:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993436928 00000100:00100000:1.0:1788986049.024556:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1788986049.024564:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993436928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986049.024592:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986049.024634:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993436928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986049.024639:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 643 00000100:00100000:1.0:1788986049.024681:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993436928:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788986049.115657:0:71302:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdae8d8a50 20000000:00000080:0.0:1788986049.115673:0:71302:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80826c00 uarg=0000000000000000 00010000:00010000:0.0:1788986049.116404:0:71302:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788986049.116438:0:71302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:0.0:1788986049.116442:0:71302:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986049.116453:0:71302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf547bc1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ec9 expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.116475:0:71302:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1788986049.116499:0:71302:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986049.116512:0:71302:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.116526:0:71302:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547ba5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547b9e expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.116535:0:71302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.116646:0:71302:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547ba5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547b9e expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.116660:0:71302:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547ba5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547b9e expref: 18 pid: 5849 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986049.116673:0:71302:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71302:1875885993437056:0@lo:104: 00000100:00100000:0.0:1788986049.116728:0:71302:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986049.116823:0:71302:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a511f8e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788986049.116867:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993437056 00000100:00100000:2.0:1788986049.116874:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993437056 00000100:00100000:2.0:1788986049.116950:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788986049.116968:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:71302:x1875885993437056:12345-0@lo:104: 00010000:00010000:2.0:1788986049.116981:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547ba5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986049.117049:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986049.117055:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:71302:x1875885993437056:12345-0@lo:104: Request processed in 98us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986049.117062:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00010000:00010000:3.0:1788986049.117127:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986049.117134:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547ba5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986049.117141:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986049.117145:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547ba5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986049.117153:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547ba5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986049.117159:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547ba5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986049.117164:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986049.117192:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547ba5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986049.117203:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986049.117222:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547ba5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986049.117229:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547b9e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547ba5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986049.117244:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986049.117245:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986049.117247:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986049.117257:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993437184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986049.117287:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986049.117373:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993437184 00000100:00100000:0.0:1788986049.117377:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993437184 00010000:00010000:0.0:1788986049.117397:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547ba5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547b9e expref: 19 pid: 5849 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986049.117421:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788986049.117428:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993437184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986049.117436:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986049.117441:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547ba5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547b9e expref: 19 pid: 5849 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117450:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547ba5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547b9e expref: 19 pid: 5849 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117472:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117480:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117494:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117501:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117509:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117516:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117521:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986049.117525:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117533:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117542:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117550:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986049.117593:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993437184:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986049.117608:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00000100:00100000:0.0:1788986049.117643:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993437184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986049.117672:0:71302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf547ba5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547b9e expref: 18 pid: 5849 timeout: 1933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986049.117682:0:71302:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71302:1875885993437056:0@lo:104: 00010000:00010000:0.0:1788986049.117692:0:71302:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117701:0:71302:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117707:0:71302:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986049.117713:0:71302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf547bc8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71302 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986049.472359:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986050.496377:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986050.677352:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986050.678291:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986050.678381:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986050.678414:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971210496 00000100:00100000:2.0:1788986050.678423:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971210496 00000100:00100000:2.0:1788986050.678494:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1273 00000100:00100000:2.0:1788986050.678505:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971210496:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986050.678574:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971210496:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 71us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986050.678581:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1273 00000100:00080000:2.0:1788986050.678602:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986050.679245:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971210624 00000100:00100000:3.0:1788986050.679251:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971210624 00000100:00100000:3.0:1788986050.679302:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 884 00000100:00100000:3.0:1788986050.679311:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971210624:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986050.679350:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971210624:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 42us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986050.679357:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 884 00000100:00080000:2.0:1788986050.679868:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986050.681362:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971210368 00000100:00100000:0.0:1788986050.681373:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971210368 00000100:00100000:0.0:1788986050.681430:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1066 00000100:00100000:0.0:1788986050.681440:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971210368:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986050.681502:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971210368:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 64us (4162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986050.681510:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1066 00000100:00100000:1.0:1788986050.698203:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986050.698299:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971210752 00000100:00100000:3.0:1788986050.698309:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971210752 00000100:00100000:3.0:1788986050.698377:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 300 00000100:00100000:3.0:1788986050.698388:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971210752:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788986050.698416:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf547a2b 00000100:00080000:3.0:1788986050.698426:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9b0941959800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788986050.698459:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967330 00000100:00080000:1.0:1788986050.699456:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986050.701227:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971210752:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 2833us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986050.701240:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 300 00010000:00010000:3.0:1788986050.701280:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788986050.947444:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986050.947450:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986050.947461:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986050.947498:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986050.947510:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986050.947520:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986050.947541:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993437312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986050.947602:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986050.947650:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a50ab0d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788986050.947708:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993437312 00000100:00100000:3.0:1788986050.947715:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993437312 00000100:00100000:3.0:1788986050.947760:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1788986050.947769:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993437312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986050.947782:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986050.947795:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf547bd6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547bcf expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986050.947817:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf547bd6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547bcf expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986050.947827:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf547bd6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547bcf expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986050.947835:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2600, rc 0) 00000100:00100000:3.0:1788986050.947883:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993437312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986050.947890:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1788986050.947928:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993437312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986050.947941:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547bd6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986050.947950:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547bd6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986050.947967:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986050.947971:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547bd6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986050.947979:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547bd6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986051.521800:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986051.717416:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986051.717451:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971210880 00000100:00100000:2.0:1788986051.717460:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971210880 00000100:00100000:2.0:1788986051.717507:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 561 00000100:00100000:2.0:1788986051.717517:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41591:x1875885971210880:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:2.0:1788986051.717536:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986051.717587:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547bdd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ed0 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986051.717673:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547be4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986051.717687:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986051.717701:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986051.717737:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:2.0:1788986051.717740:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986051.717770:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547be4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986051.717793:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547bdd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ed0 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986051.717814:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547be4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ed0 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986051.717820:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986051.717823:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986051.717826:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1a00, rc 0) 00000100:00100000:2.0:1788986051.717873:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41591:x1875885971210880:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 358us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986051.717880:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 561 00000100:00100000:0.0:1788986051.724756:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986051.728147:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971211136 00000100:00100000:2.0:1788986051.728160:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971211136 00000100:00100000:2.0:1788986051.728218:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 562 00000100:00100000:2.0:1788986051.728228:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41591:x1875885971211136:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986051.728276:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986051.728302:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547be4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ed0 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986051.728317:0:5855:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf547bc1) 00010000:00010000:2.0:1788986051.728321:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986051.728331:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986051.728353:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547beb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986051.728365:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986051.728374:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986051.728651:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009c8a977d reply state 00000000195332fc transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986051.728660:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986051.728668:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000100:00100000:2.0:1788986051.728741:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41591:x1875885971211136:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 514us (3991us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788986051.728748:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 562 00010000:00010000:1.0:1788986051.732036:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986051.732051:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547beb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986051.732058:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547beb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986051.732064:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986051.732068:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547beb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986051.732086:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547beb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986051.732121:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:1.0:1788986051.732124:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986051.732136:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547beb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986051.732142:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547beb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788986052.448339:0:71497:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff80e352f0 20000000:00000080:3.0:1788986052.448356:0:71497:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a809ad400 uarg=0000000000000000 00010000:00010000:3.0:1788986052.448594:0:71497:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986052.448610:0:71497:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986052.448626:0:71497:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986052.448643:0:71497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986052.448660:0:71497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf547bd6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547bcf expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986052.448667:0:71497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986052.448702:0:71497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf547bd6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547bcf expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986052.448716:0:71497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf547bd6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547bcf expref: 18 pid: 5848 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986052.448728:0:71497:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71497:1875885993437440:0@lo:104: 00000100:00100000:3.0:1788986052.448788:0:71497:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986052.448843:0:71497:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76356540 going to sleep for 11 seconds 00000100:00100000:0.0:1788986052.450905:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993437440 00000100:00100000:0.0:1788986052.450928:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993437440 00000100:00100000:0.0:1788986052.450978:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:0.0:1788986052.450987:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:71497:x1875885993437440:12345-0@lo:104: 00010000:00010000:0.0:1788986052.451001:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547bd6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986052.451109:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986052.451115:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:71497:x1875885993437440:12345-0@lo:104: Request processed in 130us (2328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986052.451121:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00010000:00010000:2.0:1788986052.451190:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986052.451196:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547bd6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451204:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986052.451208:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547bd6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451217:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547bd6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986052.451224:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547bd6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986052.451230:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986052.451261:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547bd6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451267:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986052.451286:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547bd6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451293:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf547bcf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547bd6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451309:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986052.451310:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986052.451312:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986052.451323:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993437568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986052.451361:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986052.451449:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993437568 00000100:00100000:2.0:1788986052.451453:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993437568 00010000:00010000:2.0:1788986052.451473:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf547bd6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547bcf expref: 19 pid: 5848 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986052.451493:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788986052.451499:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993437568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986052.451508:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986052.451513:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf547bd6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547bcf expref: 19 pid: 5848 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451522:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf547bd6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547bcf expref: 19 pid: 5848 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451538:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451546:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451559:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451566:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451573:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451579:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451584:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986052.451588:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451595:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451602:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986052.451611:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986052.451639:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993437568:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986052.451649:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788986052.451707:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993437568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986052.452060:0:71497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf547bd6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547bcf expref: 18 pid: 5848 timeout: 1936 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986052.452084:0:71497:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094139e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:71497:1875885993437440:0@lo:104: 00010000:00010000:3.0:1788986052.452119:0:71497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986052.452128:0:71497:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986052.452135:0:71497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986052.452141:0:71497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547bf2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 71497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986052.544662:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986052.609511:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993437696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986052.609642:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986052.609848:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993437696 00000100:00100000:0.0:1788986052.609856:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993437696 00000100:00080000:2.0:1788986052.609935:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986052.609971:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1788986052.609982:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993437696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986052.610014:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986052.610069:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993437696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986052.610086:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000100:00100000:2.0:1788986052.610432:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993437696:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986053.568298:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986053.632766:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993438208:0@lo:400:kworker.0 00000100:00100000:3.0:1788986053.632831:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986053.632880:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788986053.632886:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094139c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993437824:0@lo:400:kworker.0 00000100:00100000:0.0:1788986053.633402:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993438080:0@lo:400:kworker.0 00000100:00100000:2.0:1788986053.633605:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993438208 00000100:00100000:2.0:1788986053.633613:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993438208 00000100:00100000:2.0:1788986053.633656:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:2.0:1788986053.633664:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993438208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986053.633737:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986053.633767:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788986053.633773:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a808cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993437952:0@lo:400:kworker.0 00000100:00100000:0.0:1788986053.633795:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986053.633812:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993438464:0@lo:400:kworker.0 00000100:00100000:0.0:1788986053.633832:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986053.633862:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993438080 00000100:00100000:0.0:1788986053.633866:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993438080 00000100:00100000:0.0:1788986053.633908:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993437952 00000100:00100000:0.0:1788986053.633911:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993437952 00000100:00100000:0.0:1788986053.633930:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1788986053.633936:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993438080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986053.633970:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993438080:12345-0@lo:400:kworker.0 Request processed in 35us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986053.633976:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:0.0:1788986053.633991:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1788986053.633997:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993437952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986053.634022:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993437952:12345-0@lo:400:kworker.0 Request processed in 26us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986053.634026:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:0.0:1788986053.634047:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993438464 00000100:00100000:0.0:1788986053.634050:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993438464 00000100:00100000:0.0:1788986053.634084:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:0.0:1788986053.634109:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993438464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986053.634140:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993438464:12345-0@lo:400:kworker.0 Request processed in 50us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986053.634146:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00080000:0.0:1788986053.634162:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986053.634166:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986053.634198:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a808cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993437952:0@lo:400:kworker.0 00000100:00100000:0.0:1788986053.634209:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993438464:0@lo:400:kworker.0 00000100:00100000:0.0:1788986053.634217:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993438080:0@lo:400:kworker.0 00000100:00100000:3.0:1788986053.634458:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986053.634587:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993438336:0@lo:400:kworker.0 00000100:00100000:3.0:1788986053.634773:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986053.634924:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993437824 00000100:00100000:0.0:1788986053.634929:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993437824 00000100:00100000:0.0:1788986053.634973:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:0.0:1788986053.634980:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993437824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986053.635006:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993438336 00000100:00100000:3.0:1788986053.635011:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993438336 00000100:00100000:0.0:1788986053.635018:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993437824:12345-0@lo:400:kworker.0 Request processed in 39us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986053.635024:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:3.0:1788986053.635041:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:3.0:1788986053.635047:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993438336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986053.636455:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993438336:12345-0@lo:400:kworker.0 Request processed in 1400us (1675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986053.636467:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1788986053.638843:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436ea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993438208:12345-0@lo:400:kworker.0 Request processed in 5172us (6004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986053.638856:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:2.0:1788986053.638934:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094139c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993437824:0@lo:400:kworker.0 00000100:00100000:2.0:1788986053.638950:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993438336:0@lo:400:kworker.0 00000100:00100000:2.0:1788986053.638960:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993438208:0@lo:400:kworker.0 00000100:00080000:2.0:1788986053.638999:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1788986053.694648:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788986053.694658:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b094195f800/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788986053.694680:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b094195f800/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0001 00000020:00000080:1.0:1788986053.694720:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0941959800 for lustre-OST0001 10000000:01000000:3.0:1788986053.699869:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986053.699876:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986053.699880:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986053.699921:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986053.699933:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986053.699944:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986053.699968:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09436eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993438592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986053.700028:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986053.700204:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986053.700290:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993438592 00000100:00100000:1.0:1788986053.700299:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993438592 00000100:00100000:1.0:1788986053.700379:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:1.0:1788986053.700388:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993438592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986053.700400:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986053.700412:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030600/0xc20d828fcf547c00 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547bf9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986053.700433:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030600/0xc20d828fcf547c00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547bf9 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986053.700443:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf547c00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547bf9 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986053.700451:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986053.700496:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993438592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986053.700502:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:3.0:1788986053.700573:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09436eb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993438592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986053.700587:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547c00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986053.700596:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547c00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986053.700612:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986053.700618:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547c00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986053.700626:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547c00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986054.146512:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986054.146561:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993438720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986054.146651:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986054.146718:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993438720 00000100:00100000:2.0:1788986054.146731:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993438720 00000100:00100000:2.0:1788986054.146813:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 645 00000100:00100000:2.0:1788986054.146824:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993438720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986054.146869:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986054.146938:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993438720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986054.146946:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 645 00000100:00100000:1.0:1788986054.147167:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993438720:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788986054.228985:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967509 is committed 00010000:00010000:1.0:1788986054.597338:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986055.156786:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986055.157416:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971211264 00000100:00100000:0.0:1788986055.157426:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971211264 00000100:00100000:0.0:1788986055.159205:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 563 00000100:00100000:0.0:1788986055.159220:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41675:x1875885971211264:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00080000:1.0:1788986055.164149:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986055.230410:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41675:x1875885971211264:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 71184us (73624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986055.230424:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 563 00000100:00100000:2.0:1788986055.233702:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986055.233811:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971211392 00000100:00100000:0.0:1788986055.233820:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971211392 00000100:00100000:0.0:1788986055.233934:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 301 00000100:00100000:0.0:1788986055.233944:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41675:x1875885971211392:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986055.234493:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41675:x1875885971211392:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 548us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986055.234501:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 301 00000100:00100000:2.0:1788986055.237140:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986055.237218:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971211520 00000100:00100000:3.0:1788986055.237226:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971211520 00000100:00100000:3.0:1788986055.237275:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 302 00000100:00100000:3.0:1788986055.237282:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1875885971211520:12345-192.168.206.21@tcp:8:lfs.60003 00010000:00080000:3.0:1788986055.237310:0:8478:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 1839 last 0 00000020:00000080:3.0:1788986055.237338:0:8478:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf547c07 00002000:00100000:3.0:1788986055.237349:0:8478:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b0a7f56d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788986055.237359:0:8478:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788986055.237571:0:8478:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788986055.237728:0:8478:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f56c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788986055.237788:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971211520:12345-192.168.206.21@tcp:8:lfs.60003 Request processed in 504us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986055.237795:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 302 00000100:00080000:1.0:1788986055.238230:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986055.239760:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986055.240265:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971211648 00000100:00100000:3.0:1788986055.240279:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971211648 00000100:00100000:3.0:1788986055.240357:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 303 00000100:00080000:1.0:1788986055.240366:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986055.240375:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41675:x1875885971211648:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986055.242500:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41675:x1875885971211648:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 2121us (2733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986055.242517:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 303 00000100:00100000:2.0:1788986055.246166:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986055.246269:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971211776 00000100:00100000:0.0:1788986055.246286:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971211776 00000100:00100000:1.0:1788986055.246432:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 564 00000100:00100000:1.0:1788986055.246449:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41675:x1875885971211776:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986055.248787:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41675:x1875885971211776:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 1456us (1741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986055.248807:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 564 00000100:00100000:2.0:1788986055.252457:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986055.254052:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971211904 00000100:00100000:0.0:1788986055.254074:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971211904 00000100:00100000:0.0:1788986055.254199:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 565 00000100:00100000:0.0:1788986055.254210:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41675:x1875885971211904:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986055.336896:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41675:x1875885971211904:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 82678us (84437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986055.336911:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 565 00000100:00100000:3.0:1788986055.339991:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986055.340075:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971212032 00000100:00100000:0.0:1788986055.340125:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971212032 00000100:00100000:0.0:1788986055.340171:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 304 00000100:00100000:0.0:1788986055.340181:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41675:x1875885971212032:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986055.340919:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436eb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41675:x1875885971212032:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 736us (934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986055.340936:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 304 00000100:00100000:0.0:1788986055.345362:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986055.345450:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971212160 00000100:00100000:3.0:1788986055.345459:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971212160 00000100:00100000:3.0:1788986055.345654:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 305 00000100:00100000:3.0:1788986055.345666:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41675:x1875885971212160:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986055.346226:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41675:x1875885971212160:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 561us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986055.346235:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 305 00000100:00100000:2.0:1788986055.348428:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986055.348514:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971212288 00000100:00100000:0.0:1788986055.348522:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971212288 00000100:00100000:0.0:1788986055.348715:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 566 00000100:00100000:0.0:1788986055.348725:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41675:x1875885971212288:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986055.349682:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41675:x1875885971212288:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 954us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986055.349691:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 566 00000100:00100000:1.0:1788986055.403834:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986055.404071:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971212416 00000100:00100000:2.0:1788986055.404080:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971212416 00000100:00100000:2.0:1788986055.404158:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 567 00000100:00100000:2.0:1788986055.404167:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41679:x1875885971212416:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:2.0:1788986055.404184:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986055.404203:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf547c0e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ed7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986055.404267:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547c15 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986055.404278:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547c15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986055.404289:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547c15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986055.404301:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547c1c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986055.404307:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986055.404313:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.405711:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547c23 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.405725:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.405734:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986055.405761:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:3.0:1788986055.405765:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986055.405784:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547c23 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.405796:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547c15 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.405803:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547c15 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.405813:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547c15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.405819:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986055.405823:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547c15 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.405829:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547c15 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.405840:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:3.0:1788986055.405842:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986055.405846:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547c15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.405852:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547c15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.406019:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547c1c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.406027:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547c1c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.406033:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547c1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.406037:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986055.406041:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547c1c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.406051:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547c1c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.406070:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a45aca000) 00010000:00010000:3.0:1788986055.406073:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986055.406075:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547c1c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.406080:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547c1c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.406156:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf547c0e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ed7 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.406171:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547c23 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ed7 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986055.406177:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:3.0:1788986055.406179:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986055.406181:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986055.406244:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41679:x1875885971212416:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 2077us (2417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986055.406252:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 567 00000100:00100000:3.0:1788986055.411052:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986055.411181:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971212672 00000100:00100000:0.0:1788986055.411191:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971212672 00000100:00100000:0.0:1788986055.411246:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 568 00000100:00100000:0.0:1788986055.411362:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41679:x1875885971212672:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:0.0:1788986055.411382:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986055.411403:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547c2a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ede expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.411925:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547c31 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.412006:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547c31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.412032:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547c31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.412117:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547c38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.412126:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547c38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.412133:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547c38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986055.413201:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x12:0x0], index 1: 0 00010000:00010000:0.0:1788986055.413514:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547c3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986055.419454:0:7935:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1875885993438848:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788986055.419512:0:7935:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986055.419573:0:7935:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a81da9e40 going to sleep for 11 seconds 00010000:00010000:0.0:1788986055.420148:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.420166:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547c3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.420231:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547c31 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.420239:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547c31 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.420247:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547c31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986055.420973:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993438848 00000100:00100000:2.0:1788986055.420982:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993438848 00000100:00100000:2.0:1788986055.421053:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1788986055.421073:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7935:x1875885993438848:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1788986055.421104:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788986055.421140:0:6698:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1788986055.422006:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986055.422020:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547c31 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.422031:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547c31 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.422044:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:0.0:1788986055.422047:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986055.422052:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547c31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.422068:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547c31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986055.422082:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001e50d0a8 reply state 0000000077482cb8 transno 4294967510 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547c38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986055.422105:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788986055.422147:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf547c2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ede expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.422162:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547c3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ede expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.422169:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:0.0:1788986055.422171:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986055.422173:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eec00, rc 0) 00000100:00100000:0.0:1788986055.422242:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:41679:x1875885971212672:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 10987us (11198us total) trans 4294967510 rc 0/0 00000100:00100000:0.0:1788986055.422250:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 568 00010000:00010000:0.0:1788986055.427974:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547c38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.427988:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547c38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.427996:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547c38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.428001:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986055.428005:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547c38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.428012:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547c38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.428024:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a4823be00) 00010000:00010000:0.0:1788986055.428028:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986055.428031:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547c38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.428037:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf547c38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986055.431391:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986055.431459:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971212800 00000100:00100000:0.0:1788986055.431468:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971212800 00000100:00100000:0.0:1788986055.431515:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 307 00000100:00100000:0.0:1788986055.431525:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41679:x1875885971212800:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:0.0:1788986055.431545:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986055.431565:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ccf01f0/0xc20d828fcf547c4d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ee5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986055.431600:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788986055.431622:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=1839s v=(0 0) 00010000:00010000:0.0:1788986055.431627:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986055.431638:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ccf01f0/0xc20d828fcf547c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ee5 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.431655:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003ccf01f0/0xc20d828fcf547c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ee5 expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986055.431667:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efc00, rc 0) 00000100:00100000:0.0:1788986055.431715:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09436e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41679:x1875885971212800:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 192us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986055.431722:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 307 00000100:00100000:3.0:1788986055.454229:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7935:x1875885993438848:12345-0@lo:5:osp-pre-1-0.0 Request processed in 33151us (34708us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788986055.454241:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788986055.458772:0:7935:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7935:1875885993438848:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788986055.458792:0:7935:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x12:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:1.0:1788986055.464086:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986055.464282:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971212928 00000100:00100000:2.0:1788986055.464292:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971212928 00002000:00100000:2.0:1788986055.464340:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x12:0x0] (0->1048575) req@ffff9b0a761c3480 x1875885971212928/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:731/0 lens 488/0 e 0 to 0 dl 1788986066 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1788986055.464351:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a761c3480 with x1875885971212928 ext(0->1048575) 00002000:00010000:2.0:1788986055.464356:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a761c3480 00000100:00100000:2.0:1788986055.464414:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:2.0:1788986055.464422:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971212928:12345-192.168.206.21@tcp:4:dd.60003 00000001:00080000:1.0:1788986055.530130:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967331 is committed 00000001:00100000:1.0:1788986055.530144:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:3.0:1788986055.558162:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971212928:12345-192.168.206.21@tcp:4:dd.60003 Request processed in 93731us (94074us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788986055.558176:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00002000:00100000:3.0:1788986055.558188:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x12:0x0] (0->1048575) req@ffff9b0a761c3480 x1875885971212928/t4294967332(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:731/0 lens 488/448 e 0 to 0 dl 1788986066 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1788986055.558198:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a761c3480 with x1875885971212928 ext(0->1048575) 00002000:00010000:3.0:1788986055.558204:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a761c3480 00000001:00080000:2.0:1788986055.558408:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967332 is committed 00000100:00100000:1.0:1788986055.561164:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986055.561284:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971213056 00000100:00100000:0.0:1788986055.561293:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971213056 00000100:00100000:0.0:1788986055.561344:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 569 00000100:00100000:0.0:1788986055.561354:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:41679:x1875885971213056:12345-192.168.206.21@tcp:44:dd.60003 00000001:00080000:1.0:1788986055.586622:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967510 is committed 00000100:00100000:3.0:1788986055.586839:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41679:x1875885971213056:12345-192.168.206.21@tcp:44:dd.60003 Request processed in 25481us (25676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986055.586850:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 569 00000100:00100000:3.0:1788986055.589041:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986055.589190:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971213184 00000100:00100000:1.0:1788986055.589207:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971213184 00000100:00100000:1.0:1788986055.589262:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 308 00000100:00100000:1.0:1788986055.589272:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971213184:12345-192.168.206.21@tcp:16:dd.60003 00000100:00100000:1.0:1788986055.589373:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971213184:12345-192.168.206.21@tcp:16:dd.60003 Request processed in 102us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986055.589380:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 308 00000100:00100000:2.0:1788986055.591545:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986055.591662:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971213440 00000100:00100000:0.0:1788986055.591671:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971213440 00000100:00100000:0.0:1788986055.591722:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 57 00000100:00100000:0.0:1788986055.591733:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41679:x1875885971213440:12345-192.168.206.21@tcp:35:dd.60003 00000100:00100000:0.0:1788986055.592219:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:41679:x1875885971213440:12345-192.168.206.21@tcp:35:dd.60003 Request processed in 487us (679us total) trans 4294967511 rc 0/0 00000100:00100000:0.0:1788986055.592226:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 57 00010000:00010000:2.0:1788986055.617809:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986055.794337:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986055.794378:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986055.794464:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986055.794498:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986055.794551:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971213696 00000100:00100000:1.0:1788986055.794560:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971213696 00000100:00100000:1.0:1788986055.794610:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1277 00000100:00100000:1.0:1788986055.794619:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971213696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986055.794688:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971213696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 70us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986055.794695:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1277 00000100:00100000:3.0:1788986055.796234:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971213568 00000100:00100000:3.0:1788986055.796244:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971213568 00000100:00100000:3.0:1788986055.796296:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1070 00000100:00100000:3.0:1788986055.796305:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971213568:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986055.796360:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971213568:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 56us (2031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986055.796367:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1070 00000100:00100000:0.0:1788986055.798071:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971213824 00000100:00100000:0.0:1788986055.798082:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971213824 00000100:00100000:0.0:1788986055.798150:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971213952 00000100:00100000:0.0:1788986055.798154:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971213952 00000100:00100000:0.0:1788986055.798185:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 887 00000100:00100000:0.0:1788986055.798194:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971213824:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986055.798259:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971213824:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 66us (3881us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986055.798266:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 887 00000100:00100000:0.0:1788986055.798282:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 888 00000100:00100000:0.0:1788986055.798288:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971213952:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986055.798311:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971213952:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (3813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986055.798316:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 888 00010000:00010000:1.0:1788986056.644149:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986056.988468:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967511 is committed 00010000:00010000:0.0:1788986057.664528:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986057.728746:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993438976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986057.728844:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986057.731270:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993438976 00000100:00100000:1.0:1788986057.731286:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993438976 00000100:00080000:2.0:1788986057.731345:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986057.731378:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 646 00000100:00100000:1.0:1788986057.731390:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993438976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986057.731427:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986057.731513:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993438976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986057.731519:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 646 00000100:00100000:2.0:1788986057.731660:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993438976:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788986058.416621:0:71745:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1842319528440ns, next at 1823347329039ns, rc = 0 00000004:00080000:0.0:1788986058.416843:0:71745:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1842319753128ns, next at 1797516961867ns, rc = 0 00000004:00080000:3.0:1788986058.422341:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 47 committed 00000004:00080000:3.0:1788986058.422371:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 47 committed 00010000:00010000:1.0:1788986058.688590:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986058.753736:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993439232:0@lo:400:kworker.0 00000100:00100000:2.0:1788986058.753826:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986058.753897:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993439744:0@lo:400:kworker.0 00000100:00100000:1.0:1788986058.753991:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993439488:0@lo:400:kworker.0 00000100:00100000:3.0:1788986058.754122:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993439104:0@lo:400:kworker.0 00000100:00100000:0.0:1788986058.754197:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993439232 00000100:00100000:0.0:1788986058.754208:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993439232 00000100:00100000:0.0:1788986058.754265:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:0.0:1788986058.754275:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993439232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986058.755291:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986058.755378:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993439488 00000100:00100000:1.0:1788986058.755400:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993439488 00000100:00100000:1.0:1788986058.755446:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1788986058.755455:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993439488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986058.755636:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993439488:12345-0@lo:400:kworker.0 Request processed in 181us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986058.755644:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:1.0:1788986058.755702:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993439488:0@lo:400:kworker.0 00000100:00100000:3.0:1788986058.755939:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986058.755969:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993439616:0@lo:400:kworker.0 00000100:00100000:3.0:1788986058.756013:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986058.756153:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993439616 00000100:00100000:3.0:1788986058.756158:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993439616 00000100:00100000:3.0:1788986058.756200:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1788986058.756207:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993439616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986058.756248:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993439616:12345-0@lo:400:kworker.0 Request processed in 42us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986058.756254:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00100000:3.0:1788986058.756283:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993439616:0@lo:400:kworker.0 00000100:00100000:3.0:1788986058.756452:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993439360:0@lo:400:kworker.0 00000100:00100000:3.0:1788986058.756481:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788986058.756523:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986058.757457:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993439104 00000100:00100000:1.0:1788986058.757467:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993439104 00000100:00100000:1.0:1788986058.757527:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1788986058.757537:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993439104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986058.757611:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993439104:12345-0@lo:400:kworker.0 Request processed in 76us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986058.757619:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1788986058.757654:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993439360 00000100:00100000:1.0:1788986058.757658:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993439360 00000100:00100000:1.0:1788986058.757694:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1788986058.757701:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993439360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986058.757740:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993439360:12345-0@lo:400:kworker.0 Request processed in 40us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986058.757746:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00080000:1.0:1788986058.757766:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986058.758014:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993439360:0@lo:400:kworker.0 00000100:00100000:1.0:1788986058.758212:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993439104:0@lo:400:kworker.0 00000100:00100000:0.0:1788986058.758501:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993439232:12345-0@lo:400:kworker.0 Request processed in 4225us (4673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986058.758520:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1788986058.758765:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986058.758876:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993439232:0@lo:400:kworker.0 00000100:00100000:0.0:1788986058.761580:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993439744 00000100:00100000:0.0:1788986058.761600:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993439744 00000100:00100000:0.0:1788986058.761710:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:0.0:1788986058.761725:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993439744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986058.761850:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993439744:12345-0@lo:400:kworker.0 Request processed in 131us (3085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986058.761868:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00080000:1.0:1788986058.762281:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986058.762384:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967331 gen 2 00000100:00100000:2.0:1788986058.762407:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993439744:0@lo:400:kworker.0 00000100:00100000:2.0:1788986059.264343:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993439872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986059.264431:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986059.264620:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993439872 00000100:00100000:1.0:1788986059.264641:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993439872 00000100:00100000:1.0:1788986059.264707:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 647 00000100:00100000:1.0:1788986059.264717:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993439872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986059.264760:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788986059.264825:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993439872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986059.264832:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 647 00000100:00100000:0.0:1788986059.264918:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094242ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993439872:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986059.712440:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986060.015421:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986060.015607:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971214080 00000100:00100000:1.0:1788986060.015619:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971214080 00000100:00100000:1.0:1788986060.015738:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 570 00000100:00100000:1.0:1788986060.015752:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41872:x1875885971214080:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986060.015892:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41872:x1875885971214080:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 143us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986060.015900:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 570 00000100:00080000:3.0:1788986060.020492:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986060.029623:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986060.029714:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971214208 00000100:00100000:2.0:1788986060.029727:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971214208 00000100:00100000:2.0:1788986060.029821:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 309 00000100:00100000:2.0:1788986060.029833:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41872:x1875885971214208:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986060.030426:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41872:x1875885971214208:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 592us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986060.030436:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 309 00000100:00080000:3.0:1788986060.030678:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986060.032912:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986060.033010:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971214336 00000100:00100000:0.0:1788986060.033021:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971214336 00000100:00100000:0.0:1788986060.033137:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 310 00000100:00100000:0.0:1788986060.033151:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41872:x1875885971214336:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986060.033600:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41872:x1875885971214336:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 451us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986060.033609:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 310 00000100:00080000:3.0:1788986060.033836:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986060.046077:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986060.049759:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971214464 00000100:00100000:1.0:1788986060.049780:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971214464 00000100:00100000:1.0:1788986060.049897:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 571 00000100:00100000:1.0:1788986060.049909:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41872:x1875885971214464:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986060.050690:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41872:x1875885971214464:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 780us (4624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986060.050699:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 571 00000100:00100000:2.0:1788986060.056623:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986060.056755:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971214592 00000100:00100000:3.0:1788986060.056768:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971214592 00000100:00100000:3.0:1788986060.056843:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 572 00000100:00100000:3.0:1788986060.056856:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41872:x1875885971214592:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986060.057420:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41872:x1875885971214592:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 565us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986060.057429:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 572 00000100:00100000:2.0:1788986060.059623:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986060.075387:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971214720 00000100:00100000:1.0:1788986060.075407:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971214720 00000100:00100000:1.0:1788986060.076800:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 311 00000100:00100000:1.0:1788986060.076832:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41872:x1875885971214720:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986060.077434:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:41872:x1875885971214720:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 615us (17821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986060.082275:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 311 00000100:00100000:0.0:1788986060.087547:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986060.087631:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971214848 00000100:00100000:1.0:1788986060.087644:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971214848 00000100:00100000:1.0:1788986060.087703:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 312 00000100:00100000:1.0:1788986060.087715:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41872:x1875885971214848:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986060.088935:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:41872:x1875885971214848:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 1214us (1396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986060.088949:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 312 00000100:00100000:1.0:1788986060.092715:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986060.093012:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971214976 00000100:00100000:0.0:1788986060.093052:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971214976 00000100:00100000:0.0:1788986060.093148:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 573 00000100:00100000:0.0:1788986060.093161:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41872:x1875885971214976:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986060.098846:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41872:x1875885971214976:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 5668us (6125us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986060.098869:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 573 00000100:00100000:3.0:1788986060.177937:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986060.178137:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971215232 00000100:00100000:1.0:1788986060.178149:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971215232 00000100:00100000:3.0:1788986060.180780:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 574 00000100:00100000:3.0:1788986060.180814:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:41876:x1875885971215232:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:3.0:1788986060.180889:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986060.180927:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547c3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ede expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.180952:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:3.0:1788986060.180966:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986060.180995:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547c54 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.181011:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547c54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.181022:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547c54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.181054:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547c5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.181063:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547c5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.181070:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547c5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.181540:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547c62 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.181551:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547c62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.181560:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547c62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788986060.186876:0:15241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].18, 64 off9344 00000004:00080000:3.0:1788986060.186894:0:15241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1844089804276ns, next at 1845089800307ns, rc = 0 00010000:00010000:3.0:1788986060.187049:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547c69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187072:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187114:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547c69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187127:0:15241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547c69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187134:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547c69 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187142:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547c69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187173:0:15241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986060.187205:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547c62 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187212:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547c62 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187219:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547c62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187227:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986060.187232:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547c62 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187241:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547c62 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187255:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:3.0:1788986060.187257:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986060.187263:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547c62 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187269:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547c62 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187295:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547c54 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986060.187609:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986060.187617:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547c69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986060.187624:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986060.187627:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547c69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986060.187635:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547c69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986060.187644:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2f:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:1.0:1788986060.187647:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788986060.187650:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547c69 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986060.187656:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547c69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986060.187690:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986060.187692:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986060.187693:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986060.187834:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547c54 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187841:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547c54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187846:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986060.187850:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547c54 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187855:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547c54 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187868:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:3.0:1788986060.187871:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986060.187874:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547c54 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986060.187880:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547c54 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986060.187893:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000052126297 reply state 00000000441aa95e transno 4294967512 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547c5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986060.187903:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986060.188028:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:41876:x1875885971215232:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 7225us (10098us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788986060.188051:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 574 00010000:00010000:1.0:1788986060.190066:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547c5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986060.190086:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547c5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986060.190113:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547c5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986060.190121:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986060.190126:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547c5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986060.190135:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547c5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986060.190153:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0xa8fa037c (ffff9b0a55745e00) 00010000:00010000:1.0:1788986060.190156:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986060.190162:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547c5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986060.190169:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547c5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2a:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986060.736645:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986060.912121:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986060.912153:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986060.912186:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986060.912220:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986060.912223:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971215488 00000100:00100000:0.0:1788986060.912234:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971215488 00000100:00100000:0.0:1788986060.912286:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1281 00000100:00100000:0.0:1788986060.912296:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971215488:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986060.912378:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971215488:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986060.912386:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1281 00000100:00100000:1.0:1788986060.914600:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971215360 00000100:00100000:1.0:1788986060.914611:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971215360 00000100:00100000:1.0:1788986060.914656:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1072 00000100:00100000:1.0:1788986060.914665:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971215360:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986060.914741:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971215360:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 76us (2553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986060.914748:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1072 00000100:00100000:2.0:1788986060.918384:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971215744 00000100:00100000:2.0:1788986060.918396:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971215744 00000100:00100000:2.0:1788986060.918453:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971215616 00000100:00100000:2.0:1788986060.918456:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971215616 00000100:00100000:2.0:1788986060.918485:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 891 00000100:00100000:2.0:1788986060.918494:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971215744:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986060.918556:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971215744:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 64us (6403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986060.918564:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 891 00000100:00100000:2.0:1788986060.918582:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 892 00000100:00100000:2.0:1788986060.918588:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971215616:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986060.918612:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971215616:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (6392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986060.918618:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 892 00010000:00010000:1.0:1788986061.760778:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788986062.294468:0:71890:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1846197376111ns, next at 1823347329039ns, rc = 0 00000004:00080000:0.0:1788986062.294578:0:71890:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1846197488368ns, next at 1845089800307ns, rc = 0 00000004:00080000:0.0:1788986062.324977:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 49 committed 00000004:00080000:0.0:1788986062.324997:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 48 committed 00000001:00080000:0.0:1788986062.325011:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967512 is committed 00000004:00080000:0.0:1788986062.325015:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 48 committed 00000100:00100000:0.0:1788986062.325166:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993440000:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788986062.325223:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986062.325300:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993440000 00000100:00100000:0.0:1788986062.325306:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993440000 00000100:00100000:0.0:1788986062.325357:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788986062.325365:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993440000:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788986062.325392:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:18 count 1 00010000:00010000:0.0:1788986062.325418:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986062.325438:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003ccf01f0/0xc20d828fcf547c4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ee5 expref: 5 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986062.325447:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x12:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1788986062.325451:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986062.325456:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986062.325676:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003ccf01f0/0xc20d828fcf547c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ee5 expref: 5 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986062.325692:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003ccf01f0/0xc20d828fcf547c4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ee5 expref: 5 pid: 6697 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986062.325704:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993440128:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986062.325805:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a75d74d80 going to sleep for 11 seconds 00000100:00080000:0.0:1788986062.325817:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986062.332392:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986062.332875:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993440128:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788986062.332910:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986062.333078:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971215872 00000100:00100000:3.0:1788986062.333085:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971215872 00010000:00010000:3.0:1788986062.333157:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003ccf01f0/0xc20d828fcf547c4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ee5 expref: 6 pid: 6697 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986062.333193:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 340 00000100:00100000:3.0:1788986062.333203:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971215872:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986062.333217:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986062.333223:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003ccf01f0/0xc20d828fcf547c4d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ee5 expref: 6 pid: 6697 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986062.333235:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003ccf01f0/0xc20d828fcf547c4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ee5 expref: 6 pid: 6697 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986062.333257:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ccf01f0/0xc20d828fcf547c4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ee5 expref: 6 pid: 6697 timeout: 1946 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986062.333284:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986062.333288:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986062.333293:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986062.333302:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986062.333332:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986062.333378:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971215872:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 176us (993us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986062.333385:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 340 00010000:00010000:1.0:1788986062.333684:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986062.333694:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986062.333704:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986062.333711:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986062.333725:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788986062.334254:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993440000:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8889us (9029us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1788986062.334262:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00010000:0.0:1788986062.335189:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986062.335199:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986062.335208:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986062.335213:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986062.335222:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986062.335240:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986062.335247:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf547c70 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986062.335279:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986062.335281:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986062.335283:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788986062.335292:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788986062.335328:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7fb33100/2, rc 0, transno 4294967333 00000100:00100000:0.0:1788986062.335387:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993440000:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788986062.784333:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986062.848328:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986062.848348:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993440256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986062.848551:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986062.849296:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993440256 00000100:00100000:1.0:1788986062.849305:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993440256 00000100:00100000:1.0:1788986062.849413:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 648 00000100:00100000:1.0:1788986062.849423:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993440256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986062.849459:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986062.849531:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993440256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986062.849552:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 648 00000100:00100000:3.0:1788986062.849757:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993440256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986062.849844:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986063.808313:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986063.872419:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986063.872473:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986063.872506:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993440512:0@lo:400:kworker.0 00000100:00100000:2.0:1788986063.872565:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986063.872702:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993440512 00000100:00100000:3.0:1788986063.872711:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993440512 00000100:00100000:3.0:1788986063.872761:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:3.0:1788986063.872770:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993440512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986063.872820:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993440512:12345-0@lo:400:kworker.0 Request processed in 50us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986063.872826:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1788986063.872915:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993440512:0@lo:400:kworker.0 00000100:00100000:1.0:1788986063.873492:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993440384:0@lo:400:kworker.0 00000100:00100000:1.0:1788986063.873533:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986063.873653:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993440384 00000100:00100000:2.0:1788986063.873659:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993440384 00000100:00100000:2.0:1788986063.873697:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1788986063.873704:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993440384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986063.873744:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993440384:12345-0@lo:400:kworker.0 Request processed in 40us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986063.873750:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:1.0:1788986063.873827:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993440384:0@lo:400:kworker.0 00000100:00100000:2.0:1788986063.878691:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993440896:0@lo:400:kworker.0 00000100:00100000:2.0:1788986063.878752:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986063.878789:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986063.878795:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993441024:0@lo:400:kworker.0 00000100:00100000:2.0:1788986063.878816:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986063.878892:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993440896 00000100:00100000:3.0:1788986063.878900:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993440896 00000100:00100000:3.0:1788986063.878955:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:3.0:1788986063.878965:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993440896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986063.879034:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993440896:12345-0@lo:400:kworker.0 Request processed in 62us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986063.879041:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00080000:2.0:1788986063.879447:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986063.879491:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993440896:0@lo:400:kworker.0 00000100:00100000:1.0:1788986063.879774:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993440640:0@lo:400:kworker.0 00000100:00100000:1.0:1788986063.879808:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986063.879855:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993441024 00000100:00100000:1.0:1788986063.879859:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993441024 00000100:00100000:1.0:1788986063.879893:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1788986063.879900:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993441024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986063.879939:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993441024:12345-0@lo:400:kworker.0 Request processed in 40us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986063.879945:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:1.0:1788986063.879977:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993441024:0@lo:400:kworker.0 00000100:00100000:0.0:1788986063.880214:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a767fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993440768:0@lo:400:kworker.0 00000100:00100000:0.0:1788986063.880247:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986063.880406:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993440640 00000100:00100000:2.0:1788986063.880410:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993440640 00000100:00100000:2.0:1788986063.880456:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:2.0:1788986063.880462:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993440640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986063.880518:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993440640:12345-0@lo:400:kworker.0 Request processed in 56us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986063.880524:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1788986063.880780:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993440768 00000100:00100000:3.0:1788986063.880785:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993440768 00000100:00100000:3.0:1788986063.880818:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:3.0:1788986063.880825:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993440768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986063.880867:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993440768:12345-0@lo:400:kworker.0 Request processed in 42us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986063.880873:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00100000:3.0:1788986063.880903:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993440768:0@lo:400:kworker.0 00000100:00100000:1.0:1788986063.881054:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a767ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993440640:0@lo:400:kworker.0 00000100:00080000:0.0:1788986063.881286:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986064.385630:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986064.385660:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993441152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986064.385731:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986064.386416:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993441152 00000100:00100000:1.0:1788986064.386423:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993441152 00000100:00080000:0.0:1788986064.386482:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986064.386494:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 649 00000100:00100000:1.0:1788986064.386504:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993441152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986064.386535:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788986064.386596:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993441152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986064.386602:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 649 00000100:00100000:0.0:1788986064.386695:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993441152:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986064.833365:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788986064.959295:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967333 is committed 00010000:00010000:0.0:1788986065.860396:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986066.034177:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986066.034237:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986066.034275:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986066.034303:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986066.034468:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971216000 00000100:00100000:2.0:1788986066.034482:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971216000 00000100:00100000:2.0:1788986066.034548:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1074 00000100:00100000:2.0:1788986066.034560:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971216000:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986066.034646:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971216000:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 88us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986066.034667:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1074 00000100:00100000:3.0:1788986066.034925:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971216256 00000100:00100000:3.0:1788986066.034930:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971216256 00000100:00100000:3.0:1788986066.034992:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971216384 00000100:00100000:3.0:1788986066.034995:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971216384 00000100:00100000:3.0:1788986066.035036:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 895 00000100:00100000:3.0:1788986066.035045:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971216256:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986066.035124:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971216256:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 45us (851us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986066.035132:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 895 00000100:00100000:3.0:1788986066.035148:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 896 00000100:00100000:3.0:1788986066.035155:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971216384:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986066.035180:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971216384:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986066.035187:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 896 00000100:00100000:0.0:1788986066.035581:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971216128 00000100:00100000:0.0:1788986066.035588:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971216128 00000100:00100000:0.0:1788986066.035633:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1285 00000100:00100000:0.0:1788986066.035641:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971216128:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:2.0:1788986066.035677:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986066.035684:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986066.035686:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971216128:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 45us (1409us total) trans 0 rc 0/0 00000100:00080000:2.0:1788986066.035687:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986066.035697:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1285 00010000:00010000:0.0:1788986066.892733:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986067.906543:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986067.968745:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993441280:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986067.968860:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986067.969077:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993441280 00000100:00100000:2.0:1788986067.969344:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993441280 00000100:00100000:0.0:1788986067.969598:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:0.0:1788986067.969611:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993441280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986067.969688:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986067.969765:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993441280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986067.969773:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00080000:2.0:1788986067.969822:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986067.969872:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993441280:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986068.929646:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986068.992832:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993441536:0@lo:400:kworker.0 00000100:00100000:0.0:1788986068.993581:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993441408:0@lo:400:kworker.0 00000100:00100000:0.0:1788986068.993641:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986068.993702:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993441920:0@lo:400:kworker.0 00000100:00100000:3.0:1788986068.993834:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993441664:0@lo:400:kworker.0 00000100:00100000:3.0:1788986068.993873:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993441792:0@lo:400:kworker.0 00000100:00100000:3.0:1788986068.993901:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986068.993992:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986068.994800:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993441408 00000100:00100000:1.0:1788986068.994812:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993441408 00000100:00100000:1.0:1788986068.994884:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1788986068.994895:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993441408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986068.995130:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993441920 00000100:00100000:2.0:1788986068.995137:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993441920 00000100:00100000:2.0:1788986068.995189:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:2.0:1788986068.995199:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993441920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986068.999721:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993441408:12345-0@lo:400:kworker.0 Request processed in 4813us (6066us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986068.999809:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:1.0:1788986069.000029:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993441408:0@lo:400:kworker.0 00000100:00080000:1.0:1788986069.000138:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986069.000429:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993441792 00000100:00100000:1.0:1788986069.000438:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993441792 00000100:00100000:1.0:1788986069.001048:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1788986069.001059:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993441792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986069.001144:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993441792:12345-0@lo:400:kworker.0 Request processed in 88us (7242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986069.001151:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00080000:1.0:1788986069.001173:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986069.001210:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986069.001251:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993442048:0@lo:400:kworker.0 00000100:00100000:1.0:1788986069.001286:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986069.001343:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993441536 00000100:00100000:1.0:1788986069.001348:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993441536 00000100:00100000:1.0:1788986069.001383:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1788986069.001391:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993441536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986069.001428:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993441536:12345-0@lo:400:kworker.0 Request processed in 38us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986069.001434:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:3.0:1788986069.003670:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993441792:0@lo:400:kworker.0 00000100:00100000:3.0:1788986069.003806:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993442048 00000100:00100000:3.0:1788986069.003814:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993442048 00000100:00100000:3.0:1788986069.003900:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:3.0:1788986069.003911:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993442048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986069.004080:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993441920:12345-0@lo:400:kworker.0 Request processed in 5715us (7182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986069.004107:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1788986069.004240:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993441920:0@lo:400:kworker.0 00000100:00100000:1.0:1788986069.004285:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993441536:0@lo:400:kworker.0 00000100:00100000:1.0:1788986069.004332:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986069.005033:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967333 gen 2 00000004:00080000:2.0:1788986069.005040:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7fb33100, transno 4294967333 00000100:00100000:2.0:1788986069.005055:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993442048:0@lo:400:kworker.0 00000100:00100000:3.0:1788986069.005568:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993442048:12345-0@lo:400:kworker.0 Request processed in 1005us (3627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986069.005579:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00080000:3.0:1788986069.005611:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986069.007049:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993441664 00000100:00100000:0.0:1788986069.007063:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993441664 00000100:00100000:0.0:1788986069.007157:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:0.0:1788986069.007169:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993441664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986069.007265:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993441664:12345-0@lo:400:kworker.0 Request processed in 99us (2932us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986069.007272:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00080000:2.0:1788986069.007560:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986069.007675:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993441664:0@lo:400:kworker.0 00000100:00100000:3.0:1788986069.504373:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993442176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986069.504471:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986069.504648:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993442176 00000100:00100000:1.0:1788986069.504659:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993442176 00000100:00100000:1.0:1788986069.504725:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1788986069.504736:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993442176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986069.504779:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986069.504840:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993442176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986069.504848:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1788986069.504898:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993442176:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986069.952524:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986070.976916:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986071.154435:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986071.154653:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971216512 00000100:00100000:1.0:1788986071.154667:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971216512 00000100:00100000:1.0:1788986071.154733:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1076 00000100:00100000:1.0:1788986071.154753:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971216512:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986071.154868:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971216512:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 125us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986071.154877:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1076 00000100:00100000:1.0:1788986071.171627:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986071.171689:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986071.172349:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986071.174345:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971216640 00000100:00100000:2.0:1788986071.174365:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971216640 00000100:00100000:2.0:1788986071.174497:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1289 00000100:00100000:2.0:1788986071.174511:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971216640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986071.174626:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971216640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 118us (3013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986071.174634:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1289 00000100:00080000:1.0:1788986071.178370:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986071.178805:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971216896 00000100:00100000:0.0:1788986071.178820:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971216896 00000100:00100000:0.0:1788986071.178919:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971216768 00000100:00100000:0.0:1788986071.178923:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971216768 00000100:00100000:0.0:1788986071.178979:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 899 00000100:00100000:0.0:1788986071.178992:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971216896:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986071.179121:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971216896:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 131us (7430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986071.179150:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 899 00000100:00100000:0.0:1788986071.179184:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 900 00000100:00100000:0.0:1788986071.179192:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971216768:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986071.179224:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971216768:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (6878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986071.179231:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 900 00000100:00080000:1.0:1788986071.179781:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986071.179788:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788986072.000371:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986073.024697:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986073.088497:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986073.088541:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993442304:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986073.088766:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986073.088941:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993442304 00000100:00100000:3.0:1788986073.088952:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993442304 00000100:00100000:3.0:1788986073.089047:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:3.0:1788986073.089059:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993442304:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986073.089132:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986073.089190:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993442304:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986073.089198:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00080000:1.0:1788986073.089375:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986073.089423:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993442304:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986074.048460:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986074.113521:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993442560:0@lo:400:kworker.0 00000100:00100000:3.0:1788986074.113620:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986074.113707:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993443072:0@lo:400:kworker.0 00000100:00100000:3.0:1788986074.113738:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986074.113767:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788986074.113774:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993442432:0@lo:400:kworker.0 00000100:00100000:3.0:1788986074.113806:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986074.113846:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993442944:0@lo:400:kworker.0 00000100:00100000:3.0:1788986074.113871:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986074.113908:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993442432 00000100:00100000:3.0:1788986074.113917:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993442432 00000100:00100000:3.0:1788986074.113983:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:3.0:1788986074.113994:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993442432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986074.114054:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993442432:12345-0@lo:400:kworker.0 Request processed in 62us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986074.114062:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:3.0:1788986074.114129:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993442560 00000100:00100000:3.0:1788986074.114134:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993442560 00000100:00100000:3.0:1788986074.114159:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993442944 00000100:00100000:3.0:1788986074.114162:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993442944 00000100:00100000:3.0:1788986074.114198:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1788986074.114204:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993442560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986074.114237:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993442560:12345-0@lo:400:kworker.0 Request processed in 33us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986074.114243:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1788986074.114255:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:3.0:1788986074.114260:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993442944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986074.114287:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993442944:12345-0@lo:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986074.114292:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00080000:3.0:1788986074.114316:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986074.114346:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993442432:0@lo:400:kworker.0 00000100:00100000:3.0:1788986074.114359:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993442944:0@lo:400:kworker.0 00000100:00100000:3.0:1788986074.114368:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993442560:0@lo:400:kworker.0 00000100:00100000:0.0:1788986074.114777:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993443072 00000100:00100000:0.0:1788986074.114783:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993443072 00000100:00100000:0.0:1788986074.114849:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1788986074.114858:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993443072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986074.114909:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993443072:12345-0@lo:400:kworker.0 Request processed in 54us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986074.114916:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1788986074.114945:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993442816:0@lo:400:kworker.0 00000100:00100000:0.0:1788986074.114988:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986074.115016:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986074.115024:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993442688:0@lo:400:kworker.0 00000100:00100000:0.0:1788986074.115049:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986074.115076:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993442816 00000100:00100000:0.0:1788986074.115081:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993442816 00000100:00100000:0.0:1788986074.115138:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:0.0:1788986074.115145:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a767fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993442816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986074.115196:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a767fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993442816:12345-0@lo:400:kworker.0 Request processed in 52us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986074.115202:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:0.0:1788986074.115253:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993442816:0@lo:400:kworker.0 00000100:00100000:0.0:1788986074.115287:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993443072:0@lo:400:kworker.0 00000100:00100000:1.0:1788986074.115366:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993442688 00000100:00100000:1.0:1788986074.115371:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993442688 00000100:00100000:1.0:1788986074.115422:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1292 00000100:00100000:1.0:1788986074.115430:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a808cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993442688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986074.115471:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a808cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993442688:12345-0@lo:400:kworker.0 Request processed in 42us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986074.115476:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1292 00000100:00100000:0.0:1788986074.116000:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993442688:0@lo:400:kworker.0 00000100:00080000:3.0:1788986074.116170:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986074.116176:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986074.624361:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993443200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986074.624455:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986074.624602:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993443200 00000100:00100000:3.0:1788986074.624612:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993443200 00000100:00100000:3.0:1788986074.624890:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 653 00000100:00100000:3.0:1788986074.624902:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993443200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986074.624950:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986074.630591:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993443200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5677us (6121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986074.630614:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 653 00000100:00100000:0.0:1788986074.633388:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993443200:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986075.075073:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986076.098127:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986076.273056:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986076.273173:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986076.273213:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986076.273258:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986076.273292:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971217152 00000100:00100000:1.0:1788986076.273304:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971217152 00000100:00100000:1.0:1788986076.273382:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1293 00000100:00100000:1.0:1788986076.273394:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971217152:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986076.273485:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971217152:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 93us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986076.273489:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971217280 00000100:00100000:1.0:1788986076.273493:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1293 00000100:00100000:0.0:1788986076.273493:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971217280 00000100:00080000:1.0:1788986076.273517:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986076.273521:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986076.273527:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971217408 00000100:00100000:0.0:1788986076.273530:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971217408 00000100:00100000:1.0:1788986076.273557:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 903 00000100:00100000:1.0:1788986076.273565:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971217280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986076.273594:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971217280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986076.273601:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 903 00000100:00080000:1.0:1788986076.273630:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986076.273637:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 904 00000100:00100000:0.0:1788986076.273644:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971217408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986076.273675:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971217408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986076.273682:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 904 00000100:00100000:3.0:1788986076.273720:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971217024 00000100:00100000:3.0:1788986076.273725:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971217024 00000100:00100000:3.0:1788986076.273763:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1078 00000100:00100000:3.0:1788986076.273772:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971217024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986076.273799:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971217024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986076.273806:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1078 00010000:00010000:1.0:1788986077.120908:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986078.146285:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986078.213175:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986078.213208:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993443328:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986078.213313:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986078.213611:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993443328 00000100:00100000:2.0:1788986078.213622:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993443328 00000100:00100000:2.0:1788986078.213989:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1788986078.214002:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993443328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986078.214047:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986078.214156:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993443328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986078.214164:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00080000:1.0:1788986078.214238:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986078.214299:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993443328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986079.168293:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986079.232390:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993443712:0@lo:400:kworker.0 00000100:00100000:1.0:1788986079.232455:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986079.232570:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993443584:0@lo:400:kworker.0 00000100:00100000:3.0:1788986079.232599:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986079.232623:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986079.232629:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993443456:0@lo:400:kworker.0 00000100:00100000:3.0:1788986079.232653:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986079.232699:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993443456 00000100:00100000:3.0:1788986079.232706:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993443456 00000100:00100000:3.0:1788986079.232745:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:3.0:1788986079.232752:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993443456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986079.232793:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993443456:12345-0@lo:400:kworker.0 Request processed in 41us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986079.232800:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:3.0:1788986079.232843:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993443712 00000100:00100000:3.0:1788986079.232847:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993443712 00000100:00100000:3.0:1788986079.232878:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993443584 00000100:00100000:3.0:1788986079.232881:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993443584 00000100:00100000:3.0:1788986079.232901:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1788986079.232907:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993443712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986079.233060:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993443456:0@lo:400:kworker.0 00000100:00080000:2.0:1788986079.233086:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986079.233201:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1788986079.233210:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993443584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986079.233253:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993443584:12345-0@lo:400:kworker.0 Request processed in 45us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986079.233259:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1295 00000100:00100000:2.0:1788986079.233291:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993443584:0@lo:400:kworker.0 00000100:00100000:2.0:1788986079.233313:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993443840:0@lo:400:kworker.0 00000100:00100000:2.0:1788986079.233339:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986079.233382:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993443840 00000100:00100000:2.0:1788986079.233386:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993443840 00000100:00100000:2.0:1788986079.233412:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1788986079.233419:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993443840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986079.233454:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993443840:12345-0@lo:400:kworker.0 Request processed in 36us (114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986079.233460:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1788986079.233484:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993443840:0@lo:400:kworker.0 00000100:00100000:3.0:1788986079.241987:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993443712:12345-0@lo:400:kworker.0 Request processed in 9070us (9521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986079.242002:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1788986079.244006:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986079.244137:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993444096:0@lo:400:kworker.0 00000100:00100000:3.0:1788986079.244198:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986079.244230:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993443968:0@lo:400:kworker.0 00000100:00100000:3.0:1788986079.244253:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986079.244289:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993443968 00000100:00100000:3.0:1788986079.244296:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993443968 00000100:00100000:3.0:1788986079.244342:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1788986079.244351:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993443968:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788986079.244367:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986079.244399:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993443968:12345-0@lo:400:kworker.0 Request processed in 49us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986079.244406:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993444096 00000100:00100000:3.0:1788986079.244407:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:2.0:1788986079.244413:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993444096 00000100:00100000:3.0:1788986079.244448:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993443968:0@lo:400:kworker.0 00000100:00100000:2.0:1788986079.244461:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:2.0:1788986079.244471:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993444096:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788986079.244477:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986079.244519:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993444096:12345-0@lo:400:kworker.0 Request processed in 49us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986079.244526:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:3.0:1788986079.244530:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993444096:0@lo:400:kworker.0 00000100:00100000:1.0:1788986079.248655:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993443712:0@lo:400:kworker.0 00000100:00100000:2.0:1788986079.744575:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993444224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986079.744679:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986079.744956:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993444224 00000100:00100000:3.0:1788986079.744967:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993444224 00000100:00100000:3.0:1788986079.745035:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1788986079.745046:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993444224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986079.745127:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986079.748835:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993444224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3778us (4143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986079.748858:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1788986079.749448:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993444224:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986079.964421:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986079.967693:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971217536 00000100:00100000:2.0:1788986079.967708:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971217536 00000100:00100000:2.0:1788986079.967786:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 575 00000100:00100000:2.0:1788986079.967795:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42134:x1875885971217536:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986079.967892:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42134:x1875885971217536:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 97us (3480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986079.967898:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 575 00000100:00080000:3.0:1788986079.969300:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986079.978194:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986079.980242:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971217664 00000100:00100000:1.0:1788986079.980255:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971217664 00000100:00100000:1.0:1788986079.980346:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 314 00000100:00100000:1.0:1788986079.980357:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42134:x1875885971217664:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986079.980729:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42134:x1875885971217664:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 373us (2543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986079.980738:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 314 00000100:00080000:3.0:1788986079.980968:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986079.982972:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986079.983049:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971217792 00000100:00100000:3.0:1788986079.983057:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971217792 00000100:00100000:3.0:1788986079.983148:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 315 00000100:00100000:3.0:1788986079.983158:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42134:x1875885971217792:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986079.983498:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42134:x1875885971217792:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 341us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986079.983506:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 315 00000100:00080000:2.0:1788986079.983666:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986079.985163:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986079.985239:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971217920 00000100:00100000:3.0:1788986079.985246:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971217920 00000100:00100000:3.0:1788986079.985291:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 576 00000100:00100000:3.0:1788986079.985299:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42134:x1875885971217920:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986079.985971:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42134:x1875885971217920:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 670us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986079.985978:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 576 00000100:00100000:0.0:1788986079.992857:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986079.994683:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971218048 00000100:00100000:2.0:1788986079.994697:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971218048 00000100:00100000:2.0:1788986079.994753:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 577 00000100:00100000:2.0:1788986079.994762:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42134:x1875885971218048:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986079.994866:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42134:x1875885971218048:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 104us (2017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986079.994873:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 577 00000100:00100000:0.0:1788986079.997555:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986079.997681:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971218176 00000100:00100000:2.0:1788986079.997689:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971218176 00000100:00100000:2.0:1788986079.997744:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 316 00000100:00100000:2.0:1788986079.997753:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42134:x1875885971218176:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986079.998135:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42134:x1875885971218176:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 381us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986079.998143:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 316 00000100:00100000:3.0:1788986080.011031:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986080.011068:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971218304 00000100:00100000:3.0:1788986080.011077:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971218304 00000100:00100000:3.0:1788986080.011241:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 317 00000100:00100000:3.0:1788986080.011252:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42134:x1875885971218304:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986080.011606:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42134:x1875885971218304:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 355us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986080.011613:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 317 00000100:00100000:3.0:1788986080.015647:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986080.015697:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971218432 00000100:00100000:3.0:1788986080.015706:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971218432 00000100:00100000:3.0:1788986080.016230:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 578 00000100:00100000:3.0:1788986080.016242:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42134:x1875885971218432:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986080.018603:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42134:x1875885971218432:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 2356us (2956us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986080.018616:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 578 00000100:00100000:3.0:1788986080.060824:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986080.060903:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971218560 00000100:00100000:1.0:1788986080.060912:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971218560 00000100:00100000:1.0:1788986080.060983:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 579 00000100:00100000:1.0:1788986080.060995:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42135:x1875885971218560:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986080.061014:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986080.061037:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547c77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0eec expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986080.061134:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547c7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986080.061147:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986080.061158:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986080.061195:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:1.0:1788986080.061198:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986080.061215:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547c7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986080.061239:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547c77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0eec expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986080.061262:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547c7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0eec expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986080.061270:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:1.0:1788986080.061273:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986080.061277:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986080.061331:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42135:x1875885971218560:12345-192.168.206.21@tcp:101:rm.0 Request processed in 339us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986080.061338:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 579 00000100:00100000:0.0:1788986080.065748:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986080.065782:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971218816 00000100:00100000:0.0:1788986080.065792:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971218816 00000100:00100000:0.0:1788986080.065840:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 580 00000100:00100000:0.0:1788986080.065850:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42135:x1875885971218816:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986080.065873:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986080.065894:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547c85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ef3 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986080.065986:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00010000:00010000:0.0:1788986080.066234:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547c85 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ef3 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986080.066249:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986080.066252:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788986080.066257:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf547c85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ef3 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986080.066271:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eec00, rc 0) 00000100:00100000:0.0:1788986080.066324:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42135:x1875885971218816:12345-192.168.206.21@tcp:101:rm.0 Request processed in 475us (581us total) trans 4294967513 rc 301/301 00000100:00100000:0.0:1788986080.066332:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 580 00000100:00100000:1.0:1788986080.075327:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986080.076499:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971218944 00000100:00100000:2.0:1788986080.076520:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971218944 00000100:00100000:2.0:1788986080.076569:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:2.0:1788986080.076578:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42135:x1875885971218944:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:2.0:1788986080.087282:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42135:x1875885971218944:12345-192.168.206.21@tcp:37:rm.0 Request processed in 10695us (11955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986080.087294:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 58 00000100:00100000:0.0:1788986080.090507:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986080.092372:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971219200 00000100:00100000:2.0:1788986080.092384:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971219200 00000100:00100000:2.0:1788986080.092617:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:2.0:1788986080.092631:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42135:x1875885971219200:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:2.0:1788986080.093478:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:42135:x1875885971219200:12345-192.168.206.21@tcp:35:rm.0 Request processed in 459us (2587us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1788986080.093489:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 59 00000100:00100000:1.0:1788986080.101802:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986080.101963:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971219456 00000100:00100000:2.0:1788986080.101973:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971219456 00000100:00100000:2.0:1788986080.102027:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 581 00000100:00100000:2.0:1788986080.102037:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:42135:x1875885971219456:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:2.0:1788986080.102146:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788986080.102175:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547c7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0eec expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.102198:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547c23 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ed7 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.102209:0:5854:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf547879) 00010000:00010000:2.0:1788986080.102212:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:2.0:1788986080.102222:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986080.102292:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547c93 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.102304:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547c93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.102312:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547c93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.102325:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547c9a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.102331:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547c9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.102338:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547c9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104118:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ca1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104134:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ca1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104146:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ca1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104193:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ca1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104201:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ca1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104213:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ca1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104220:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986080.104225:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ca1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104233:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ca1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104245:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:2.0:1788986080.104248:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986080.104254:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ca1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104261:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ca1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104284:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547c93 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104291:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547c93 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104298:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547c93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104303:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986080.104306:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547c93 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104315:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547c93 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104323:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986080.104325:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986080.104328:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547c93 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104334:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547c93 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104346:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547c9a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104352:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547c9a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104358:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547c9a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104363:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986080.104366:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547c9a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104372:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547c9a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104379:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a45aca200) 00010000:00010000:2.0:1788986080.104382:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986080.104384:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547c9a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986080.104394:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547c9a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986080.104760:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42135:x1875885971219456:12345-192.168.206.21@tcp:36:rm.0 Request processed in 2720us (2962us total) trans 0 rc -13/-13 00000100:00100000:2.0:1788986080.104769:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 581 00010000:00010000:2.0:1788986080.193937:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986081.216643:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986081.397019:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986081.397060:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986081.397173:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986081.397197:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986081.397252:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971219712 00000100:00100000:3.0:1788986081.397263:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971219712 00000100:00100000:1.0:1788986081.397266:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971219584 00000100:00100000:1.0:1788986081.397272:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971219584 00000100:00100000:1.0:1788986081.397319:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1080 00000100:00100000:3.0:1788986081.397324:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1297 00000100:00100000:3.0:1788986081.397339:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971219712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986081.397340:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971219584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986081.397414:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971219584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 79us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986081.397425:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1080 00000100:00100000:2.0:1788986081.398896:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971219840 00000100:00100000:2.0:1788986081.398907:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971219840 00000100:00100000:2.0:1788986081.398980:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971219968 00000100:00100000:2.0:1788986081.398984:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971219968 00000100:00100000:2.0:1788986081.399008:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 907 00000100:00100000:2.0:1788986081.399017:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971219840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986081.402289:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971219712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 4944us (5105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986081.402303:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1297 00000100:00100000:3.0:1788986081.402371:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 908 00000100:00100000:3.0:1788986081.402396:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971219968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986081.402445:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971219968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 64us (5247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986081.402452:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 908 00000100:00080000:3.0:1788986081.402473:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986081.402478:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986081.402481:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986081.407291:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971219840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 8260us (10216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986081.407308:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 907 00010000:00010000:1.0:1788986082.241299:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788986082.902695:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967513 is committed 00000001:00080000:1.0:1788986082.902725:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967514 is committed 00000020:00000080:2.0:1788986083.196445:0:72255:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc41faa2b0 20000000:00000080:2.0:1788986083.196461:0:72255:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f4c7400 uarg=0000000000000000 00010000:00010000:2.0:1788986083.197219:0:72255:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986083.197235:0:72255:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986083.197247:0:72255:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986083.197266:0:72255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986083.197283:0:72255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf547c00 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547bf9 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986083.197297:0:72255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986083.197332:0:72255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030600/0xc20d828fcf547c00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547bf9 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986083.197346:0:72255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf547c00 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547bf9 expref: 18 pid: 5849 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986083.197359:0:72255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c12d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72255:1875885993444352:0@lo:104: 00000100:00100000:2.0:1788986083.197423:0:72255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986083.197471:0:72255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51a11780 going to sleep for 11 seconds 00000100:00100000:0.0:1788986083.197562:0:7642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788986083.197575:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993444352 00000100:00100000:0.0:1788986083.197581:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993444352 00000100:00100000:0.0:1788986083.197624:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788986083.197632:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f58f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:72255:x1875885993444352:12345-0@lo:104: 00010000:00010000:0.0:1788986083.197653:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547c00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.197698:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986083.197703:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f58f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:72255:x1875885993444352:12345-0@lo:104: Request processed in 72us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986083.197710:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00010000:00010000:0.0:1788986083.197750:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986083.197756:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547c00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.197763:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986083.197767:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547c00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.197775:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547c00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986083.197782:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547c00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986083.197787:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986083.197810:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547c00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.197815:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986083.197831:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547c00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.197838:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf547bf9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547c00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.197860:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986083.197861:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986083.197863:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986083.197882:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993444480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986083.197920:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986083.197952:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993444480 00000100:00100000:0.0:1788986083.197955:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993444480 00010000:00010000:0.0:1788986083.197971:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030600/0xc20d828fcf547c00 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547bf9 expref: 19 pid: 5849 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986083.197990:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788986083.197995:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993444480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986083.198004:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986083.198008:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030600/0xc20d828fcf547c00 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547bf9 expref: 19 pid: 5849 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.198017:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030600/0xc20d828fcf547c00 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547bf9 expref: 19 pid: 5849 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.198030:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.198038:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.198049:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.198056:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.198068:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.198075:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.198080:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986083.198084:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.198111:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.198119:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.198127:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986083.198152:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe20000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993444480:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986083.198158:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00000100:00100000:0.0:1788986083.198187:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993444480:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986083.198268:0:72255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf547c00 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547bf9 expref: 18 pid: 5849 timeout: 1967 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986083.198278:0:72255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c12d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72255:1875885993444352:0@lo:104: 00010000:00010000:2.0:1788986083.198291:0:72255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986083.198298:0:72255:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986083.198305:0:72255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986083.198311:0:72255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547ca8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986083.269287:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986083.346227:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986083.346251:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993444608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986083.346314:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986083.346517:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993444608 00000100:00100000:2.0:1788986083.346525:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993444608 00000100:00100000:2.0:1788986083.346584:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:2.0:1788986083.346593:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993444608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986083.346628:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986083.346675:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993444608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986083.346683:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00080000:2.0:1788986083.346702:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986083.346735:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993444608:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788986083.997046:0:72303:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9842db50 20000000:00000080:0.0:1788986083.997068:0:72303:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f58f400 uarg=0000000000000000 00010000:00010000:0.0:1788986083.997538:0:72303:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986083.997554:0:72303:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986083.997566:0:72303:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986083.997584:0:72303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf547caf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.997611:0:72303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf547caf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.997622:0:72303:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf547caf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.997629:0:72303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf547caf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.997637:0:72303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf547caf lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.997645:0:72303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf547caf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.997651:0:72303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986083.997655:0:72303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf547caf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.997664:0:72303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf547caf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.997677:0:72303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf547caf lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.997685:0:72303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf547caf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986083.997692:0:72303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf547caf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986084.288267:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986084.352318:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993444736:0@lo:400:kworker.0 00000100:00100000:2.0:1788986084.352398:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986084.352666:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993444736 00000100:00100000:3.0:1788986084.352673:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993444736 00000100:00100000:3.0:1788986084.352847:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:3.0:1788986084.352857:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993444736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986084.355601:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993445120:0@lo:400:kworker.0 00000100:00100000:0.0:1788986084.355661:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986084.355960:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986084.355968:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993445248:0@lo:400:kworker.0 00000100:00100000:0.0:1788986084.355999:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986084.356030:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993444864:0@lo:400:kworker.0 00000100:00100000:0.0:1788986084.356054:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986084.356072:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993445376:0@lo:400:kworker.0 00000100:00100000:0.0:1788986084.356112:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986084.356131:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986084.356136:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993444992:0@lo:400:kworker.0 00000100:00100000:0.0:1788986084.356156:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986084.356187:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993445120 00000100:00100000:0.0:1788986084.356194:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993445120 00000100:00100000:0.0:1788986084.356235:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993445376 00000100:00100000:0.0:1788986084.356238:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993445376 00000100:00100000:0.0:1788986084.356266:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1788986084.356275:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993445120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986084.356329:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993445120:12345-0@lo:400:kworker.0 Request processed in 55us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986084.356337:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:0.0:1788986084.356356:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1788986084.356362:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993445376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986084.356492:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993444736:12345-0@lo:400:kworker.0 Request processed in 3634us (4091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986084.356501:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788986084.356658:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993445376:12345-0@lo:400:kworker.0 Request processed in 296us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986084.356675:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1788986084.356704:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993445248 00000100:00100000:0.0:1788986084.356708:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993445248 00000100:00100000:0.0:1788986084.356731:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993444864 00000100:00100000:0.0:1788986084.356734:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993444864 00000100:00100000:0.0:1788986084.356747:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993444992 00000100:00100000:0.0:1788986084.356749:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993444992 00000100:00100000:0.0:1788986084.356760:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:0.0:1788986084.356764:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993445248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986084.356871:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993445248:12345-0@lo:400:kworker.0 Request processed in 106us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986084.356877:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:0.0:1788986084.356888:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1299 00000100:00100000:0.0:1788986084.356892:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993444864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986084.356928:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993444864:12345-0@lo:400:kworker.0 Request processed in 35us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986084.356933:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1299 00000100:00100000:0.0:1788986084.356942:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:0.0:1788986084.356947:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993444992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986084.356981:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993444992:12345-0@lo:400:kworker.0 Request processed in 34us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986084.356986:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:0.0:1788986084.357029:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993445248:0@lo:400:kworker.0 00000100:00100000:0.0:1788986084.357037:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993445120:0@lo:400:kworker.0 00000100:00100000:2.0:1788986084.359523:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993444736:0@lo:400:kworker.0 00000100:00080000:2.0:1788986084.359571:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986084.359577:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986084.360931:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993445376:0@lo:400:kworker.0 00000100:00100000:3.0:1788986084.360959:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993444992:0@lo:400:kworker.0 00000100:00100000:3.0:1788986084.360971:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993444864:0@lo:400:kworker.0 00000100:00100000:0.0:1788986084.865391:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993445504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986084.865468:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986084.865571:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993445504 00000100:00100000:2.0:1788986084.865583:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993445504 00000100:00100000:2.0:1788986084.865635:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1788986084.865645:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993445504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986084.865675:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986084.865727:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993445504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986084.865733:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 657 00000100:00100000:2.0:1788986084.865775:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993445504:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1788986084.928218:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986084.928226:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986084.928231:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986084.928277:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986084.928290:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986084.928301:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986084.928337:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993445632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986084.928405:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986084.928471:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c61840 going to sleep for 11 seconds 00000100:00100000:1.0:1788986084.928572:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993445632 00000100:00100000:1.0:1788986084.928580:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993445632 00000100:00100000:1.0:1788986084.928631:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:1.0:1788986084.928641:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993445632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986084.928653:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986084.928665:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547cbd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547cb6 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986084.928685:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547cbd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547cb6 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986084.928696:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547cbd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547cb6 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986084.928704:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788986084.928749:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993445632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986084.928756:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1788986084.929025:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe22300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993445632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986084.929039:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547cbd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986084.929048:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547cbd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986084.929063:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986084.929067:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547cbd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986084.929075:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547cbd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986085.313195:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986086.337207:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986086.520077:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986086.520137:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986086.520161:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986086.520184:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986086.520208:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971220096 00000100:00100000:0.0:1788986086.520216:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971220096 00000100:00100000:0.0:1788986086.520255:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1083 00000100:00100000:0.0:1788986086.520263:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971220096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986086.520319:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971220096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 57us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986086.520326:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1083 00000100:00100000:0.0:1788986086.520355:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971220480 00000100:00100000:0.0:1788986086.520369:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971220480 00000100:00100000:0.0:1788986086.520400:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971220352 00000100:00100000:0.0:1788986086.520403:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971220352 00000100:00100000:0.0:1788986086.520424:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 911 00000100:00100000:0.0:1788986086.520431:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971220480:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986086.520460:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971220480:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986086.520466:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 911 00000100:00100000:0.0:1788986086.520478:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 912 00000100:00100000:0.0:1788986086.520485:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971220352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986086.520507:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe22d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971220352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986086.520526:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 912 00000100:00100000:2.0:1788986086.520773:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971220224 00000100:00100000:2.0:1788986086.520778:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971220224 00000100:00100000:2.0:1788986086.520811:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1301 00000100:00100000:2.0:1788986086.520818:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971220224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986086.520851:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971220224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986086.520856:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1301 00000100:00080000:0.0:1788986086.521463:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986086.521468:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986086.521470:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986086.676343:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986086.676452:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971220608 00000100:00100000:0.0:1788986086.676461:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971220608 00000100:00100000:0.0:1788986086.676523:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 582 00000100:00100000:0.0:1788986086.676532:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42248:x1875885971220608:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986086.676549:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986086.676570:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547cc4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0efa expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.676626:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547ccb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.676640:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.676653:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986086.676686:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788986086.676689:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986086.676709:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547ccb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.676730:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547cc4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0efa expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.676747:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547ccb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0efa expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.676768:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986086.676771:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986086.676775:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef800, rc 0) 00000100:00100000:0.0:1788986086.676843:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42248:x1875885971220608:12345-192.168.206.21@tcp:101:rm.0 Request processed in 312us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986086.676850:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 582 00000100:00100000:0.0:1788986086.688686:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986086.688839:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971220736 00000100:00100000:2.0:1788986086.688849:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971220736 00000100:00100000:2.0:1788986086.688915:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 583 00000100:00100000:2.0:1788986086.688942:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42248:x1875885971220736:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986086.688962:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986086.688983:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547cd2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f01 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689298:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547cd9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689313:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547cd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689323:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547cd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689337:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ce0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689345:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689363:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689634:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547ce7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689643:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689650:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986086.689677:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00000004:00200000:2.0:1788986086.689681:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986086.689696:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689706:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547cd9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689713:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547cd9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689719:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547cd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689724:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986086.689728:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547cd9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689735:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547cd9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689746:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:2.0:1788986086.689749:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986086.689753:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547cd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689759:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547cd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689769:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ce0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689775:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ce0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689781:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689786:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986086.689788:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ce0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689794:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ce0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689801:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986086.689803:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986086.689806:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ce0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689811:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547ce0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689843:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547cd2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f01 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689857:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f01 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986086.689864:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986086.689866:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986086.689868:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788986086.692227:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42248:x1875885971220736:12345-192.168.206.21@tcp:101:rm.0 Request processed in 3293us (3541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986086.692239:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 583 00000100:00100000:2.0:1788986086.705773:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986086.705872:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971220992 00000100:00100000:0.0:1788986086.705881:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971220992 00000100:00100000:0.0:1788986086.705965:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 584 00000100:00100000:0.0:1788986086.705985:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42248:x1875885971220992:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986086.706005:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986086.706374:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547cee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f08 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986086.706471:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00010000:00010000:0.0:1788986086.706654:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547cee lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f08 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.706667:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986086.706669:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788986086.706675:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf547cee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f08 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.706686:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788986086.706747:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42248:x1875885971220992:12345-192.168.206.21@tcp:101:rm.0 Request processed in 773us (982us total) trans 4294967515 rc 301/301 00000100:00100000:0.0:1788986086.706764:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 584 00000100:00100000:2.0:1788986086.714211:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986086.714365:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971221120 00000100:00100000:3.0:1788986086.714374:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971221120 00000100:00100000:3.0:1788986086.714436:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:3.0:1788986086.714445:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42248:x1875885971221120:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:3.0:1788986086.751728:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42248:x1875885971221120:12345-192.168.206.21@tcp:37:rm.0 Request processed in 37274us (37517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986086.751741:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 60 00000100:00100000:2.0:1788986086.757872:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986086.757964:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971221376 00000100:00100000:3.0:1788986086.757983:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971221376 00000100:00100000:3.0:1788986086.758044:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:3.0:1788986086.758055:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42248:x1875885971221376:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:2.0:1788986086.764671:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:42248:x1875885971221376:12345-192.168.206.21@tcp:35:rm.0 Request processed in 6609us (6799us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788986086.764684:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 61 00000100:00100000:0.0:1788986086.772343:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986086.772445:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971221632 00000100:00100000:1.0:1788986086.772455:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971221632 00000100:00100000:1.0:1788986086.772512:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 585 00000100:00100000:1.0:1788986086.772523:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:42248:x1875885971221632:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788986086.772580:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986086.772607:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf547ce7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f01 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.772626:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:1.0:1788986086.772642:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547ccb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0efa expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.772651:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:1.0:1788986086.772657:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986086.772680:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547cfc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.772692:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547cfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.772701:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547cfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.772713:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d03 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.772719:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.772724:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.773872:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d0a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.773897:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.773907:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986086.775140:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x2a:0x0]: returning size 16384 00010000:00010000:0.0:1788986086.775161:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d0a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775169:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d0a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775176:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775181:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986086.775185:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d0a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775192:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d0a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775204:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2a:0x0].0x0 (ffff9b0a4823b000) 00010000:00010000:0.0:1788986086.775206:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788986086.775210:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d0a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775222:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d0a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775243:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547cfc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775250:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547cfc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775255:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547cfc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775261:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986086.775264:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547cfc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775269:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547cfc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775277:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316d00) 00010000:00010000:0.0:1788986086.775279:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986086.775281:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547cfc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.775286:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547cfc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986086.775300:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003c3502de reply state 0000000012e68796 transno 4294967517 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986086.775308:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986086.775396:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:42248:x1875885971221632:12345-192.168.206.21@tcp:36:rm.0 Request processed in 2872us (3059us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788986086.775405:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 585 00010000:00010000:3.0:1788986086.787808:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d03 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.787839:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d03 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.787851:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d03 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.787859:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986086.787864:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d03 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.787873:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d03 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.787897:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a45316200) 00010000:00010000:3.0:1788986086.787900:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986086.787905:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d03 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.787912:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d03 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986086.840804:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986086.840936:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971221760 00000100:00100000:2.0:1788986086.840947:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971221760 00000100:00100000:2.0:1788986086.841000:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 586 00000100:00100000:2.0:1788986086.841009:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42252:x1875885971221760:12345-192.168.206.21@tcp:101:mkdir.0 00010000:00010000:2.0:1788986086.841045:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986086.841068:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547d11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f0f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.841745:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.841761:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.841773:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986086.841807:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788986086.841811:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986086.841830:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.841853:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547d11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f0f expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.841871:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f0f expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.841879:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:0.0:1788986086.841882:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986086.841897:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986086.841957:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:42252:x1875885971221760:12345-192.168.206.21@tcp:101:mkdir.0 Request processed in 949us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986086.841965:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 586 00000100:00100000:0.0:1788986086.846523:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986086.846580:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986086.846680:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971221888 00000100:00100000:3.0:1788986086.846693:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971221888 00000100:00100000:3.0:1788986086.846745:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971222144 00000100:00100000:3.0:1788986086.846749:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971222144 00000100:00100000:3.0:1788986086.846772:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 587 00000100:00100000:3.0:1788986086.846781:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:2348:x1875885971221888:12345-192.168.206.21@tcp:41:mkdir.0 00000100:00100000:1.0:1788986086.846834:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 588 00000004:00000024:3.0:1788986086.846837:0:5856:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788986086.846851:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:42252:x1875885971222144:12345-192.168.206.21@tcp:36:mkdir.0 00010000:00010000:1.0:1788986086.846901:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788986086.846919:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094139c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:2348:x1875885971221888:12345-192.168.206.21@tcp:41:mkdir.0 Request processed in 137us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986086.846932:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 587 00010000:00010000:1.0:1788986086.846940:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f0f expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.846963:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:1.0:1788986086.846988:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986086.847069:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d1f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.847084:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.847114:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.847128:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d26 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.847137:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.847144:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986086.847748:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00010000:00010000:1.0:1788986086.847759:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d1f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.847767:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d1f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.847774:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.847784:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986086.847788:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d1f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.847795:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d1f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.847806:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316f00) 00010000:00010000:1.0:1788986086.847809:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986086.847813:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d1f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.847819:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547d1f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986086.847835:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009a488c4f reply state 00000000ec5324aa transno 4294967518 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986086.847844:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986086.847915:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:42252:x1875885971222144:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 1070us (1332us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788986086.847924:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 588 00010000:00010000:1.0:1788986086.851194:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d26 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.851211:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d26 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.851218:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d26 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.851229:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986086.851234:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d26 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.851242:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d26 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.851263:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a45316100) 00010000:00010000:1.0:1788986086.851266:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986086.851271:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d26 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.851278:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d26 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986086.920415:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986086.920542:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971222272 00000100:00100000:0.0:1788986086.920552:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971222272 00000100:00100000:0.0:1788986086.920618:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 589 00000100:00100000:0.0:1788986086.920628:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:42256:x1875885971222272:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:0.0:1788986086.920658:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986086.920682:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547d2d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f16 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.920748:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547d34 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.920762:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.920774:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986086.920808:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788986086.920812:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986086.920831:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547d34 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.920856:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547d2d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f16 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.920875:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547d34 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f16 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986086.920897:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b000) 00010000:00010000:0.0:1788986086.920900:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986086.920903:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efc00, rc 0) 00000100:00100000:0.0:1788986086.921073:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:42256:x1875885971222272:12345-192.168.206.21@tcp:101:chown.0 Request processed in 445us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986086.921080:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 589 00000100:00100000:2.0:1788986086.927985:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986086.928163:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971222400 00000100:00100000:3.0:1788986086.928173:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971222400 00000100:00100000:3.0:1788986086.928229:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 590 00000100:00100000:3.0:1788986086.928238:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:42256:x1875885971222400:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:3.0:1788986086.928257:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986086.928285:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547d3b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f1d expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928337:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547d42 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928350:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928371:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928386:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547d49 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928393:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928400:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928477:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547d50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928485:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928494:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986086.928520:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:3.0:1788986086.928524:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986086.928541:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547d50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928551:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547d42 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928558:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547d42 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928564:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928570:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986086.928574:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547d42 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928581:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547d42 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928592:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b000) 00010000:00010000:3.0:1788986086.928595:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986086.928600:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547d42 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928607:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547d42 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928624:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547d49 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928630:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547d49 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928636:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928641:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986086.928644:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547d49 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928649:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547d49 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928661:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a55745f00) 00010000:00010000:3.0:1788986086.928664:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986086.928666:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547d49 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928671:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf547d49 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928699:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547d3b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f1d expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928713:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547d50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f1d expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986086.928724:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:3.0:1788986086.928726:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986086.928728:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2800, rc 0) 00000100:00100000:3.0:1788986086.929526:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:42256:x1875885971222400:12345-192.168.206.21@tcp:101:chown.0 Request processed in 1286us (1546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986086.929535:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 590 00000100:00100000:2.0:1788986086.936908:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986086.937048:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971222656 00000100:00100000:1.0:1788986086.937059:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971222656 00000100:00100000:1.0:1788986086.937135:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 591 00000100:00100000:1.0:1788986086.937145:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:42256:x1875885971222656:12345-192.168.206.21@tcp:36:chown.0 00010000:00010000:1.0:1788986086.937192:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986086.937216:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547d50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f1d expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.937236:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:1.0:1788986086.937258:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986086.937284:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d57 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.937296:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986086.937305:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788986087.006924:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000001:00080000:1.0:1788986087.006950:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000004:00010000:0.0:1788986087.006956:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000633b829d reply state 0000000003b1ef6a transno 4294967519 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986087.006970:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788986087.006993:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00010000:00080000:0.0:1788986087.007084:0:5855:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788986087.007118:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42256:x1875885971222656:12345-192.168.206.21@tcp:36:chown.0 Request processed in 69970us (70216us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788986087.007127:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 591 00010000:00010000:3.0:1788986087.011189:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d57 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.011205:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d57 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.011212:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.011218:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986087.011222:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d57 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.011229:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d57 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.011244:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:3.0:1788986087.011336:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986087.011342:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d57 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.011348:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf547d57 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.360646:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986087.788639:0:72500:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb2b8e9d0 20000000:00000080:3.0:1788986087.788654:0:72500:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a49820400 uarg=0000000000000000 00010000:00010000:3.0:1788986087.789158:0:72500:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788986087.789189:0:72500:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b000) 00010000:00010000:3.0:1788986087.789192:0:72500:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986087.789203:0:72500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547d34 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f16 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.789222:0:72500:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1788986087.789236:0:72500:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986087.789249:0:72500:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.789262:0:72500:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547cbd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547cb6 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.789269:0:72500:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.789301:0:72500:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547cbd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547cb6 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.789314:0:72500:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547cbd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547cb6 expref: 18 pid: 5848 timeout: 1971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986087.789327:0:72500:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d34380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72500:1875885993445760:0@lo:104: 00000100:00100000:3.0:1788986087.789379:0:72500:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986087.789420:0:72500:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c1e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788986087.791373:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993445760 00000100:00100000:2.0:1788986087.791384:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993445760 00000100:00100000:2.0:1788986087.791433:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788986087.791442:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:72500:x1875885993445760:12345-0@lo:104: 00010000:00010000:2.0:1788986087.791458:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547cbd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791549:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986087.791555:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:72500:x1875885993445760:12345-0@lo:104: Request processed in 114us (2176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986087.791562:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00010000:00010000:2.0:1788986087.791599:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986087.791605:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547cbd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791612:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986087.791616:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547cbd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791624:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547cbd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986087.791630:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547cbd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986087.791640:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986087.791681:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547cbd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791688:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986087.791706:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547cbd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791713:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547cb6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547cbd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791729:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986087.791730:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986087.791733:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986087.791739:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986087.791750:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993445888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986087.791782:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986087.791819:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993445888 00000100:00100000:2.0:1788986087.791823:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993445888 00010000:00010000:2.0:1788986087.791840:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547cbd lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547cb6 expref: 19 pid: 5848 timeout: 1971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986087.791861:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788986087.791866:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993445888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986087.791875:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986087.791891:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547cbd lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547cb6 expref: 19 pid: 5848 timeout: 1971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791906:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547cbd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547cb6 expref: 19 pid: 5848 timeout: 1971 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791922:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791930:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791944:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791951:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791958:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791964:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791969:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986087.791982:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791991:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.791999:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986087.792013:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986087.792042:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993445888:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986087.792049:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788986087.792082:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993445888:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986087.792867:0:72500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf547cbd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547cb6 expref: 18 pid: 5848 timeout: 1971 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986087.792894:0:72500:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d34380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72500:1875885993445760:0@lo:104: 00010000:00010000:3.0:1788986087.792911:0:72500:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.792920:0:72500:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.792927:0:72500:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986087.792933:0:72500:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf547d5e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72500 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986088.389758:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986088.449189:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986088.449208:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993446016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986088.449271:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986088.449407:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993446016 00000100:00100000:2.0:1788986088.449416:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993446016 00000100:00100000:2.0:1788986088.449473:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:2.0:1788986088.449482:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993446016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986088.449513:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986088.449564:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993446016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986088.449570:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:2.0:1788986088.449609:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993446016:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986088.449816:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788986088.564770:0:72548:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff89f7c5f0 20000000:00000080:3.0:1788986088.564786:0:72548:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094295f400 uarg=0000000000000000 00010000:00010000:3.0:1788986088.565006:0:72548:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986088.565021:0:72548:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986088.565034:0:72548:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986088.565053:0:72548:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547d65 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.565067:0:72548:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547d65 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.565077:0:72548:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547d65 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.565084:0:72548:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547d65 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.565143:0:72548:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547d65 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.565421:0:72548:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547d65 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.565430:0:72548:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986088.565434:0:72548:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547d65 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.565442:0:72548:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547d65 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.565455:0:72548:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547d65 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.565462:0:72548:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547d65 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.565469:0:72548:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf547d65 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72548 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986088.963335:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986088.963342:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986088.963346:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986088.963389:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.963400:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.963414:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986088.963437:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993446144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986088.963496:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986088.963543:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a48475cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788986088.963586:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993446144 00000100:00100000:0.0:1788986088.963594:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993446144 00000100:00100000:0.0:1788986088.963643:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1788986088.963652:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993446144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986088.963664:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986088.963676:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf547d73 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547d6c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986088.963696:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf547d73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547d6c expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986088.963707:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf547d73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547d6c expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986088.963715:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788986088.963751:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993446144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986088.963759:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:3.0:1788986088.963832:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d34380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993446144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986088.963848:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547d73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.963856:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547d73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986088.963883:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986088.963888:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547d73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986088.963895:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547d73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986089.418207:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986089.481855:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993446528:0@lo:400:kworker.0 00000100:00100000:2.0:1788986089.481929:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986089.481981:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986089.481987:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993446656:0@lo:400:kworker.0 00000100:00100000:2.0:1788986089.482009:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986089.482039:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993446528 00000100:00100000:2.0:1788986089.482046:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993446528 00000100:00100000:2.0:1788986089.482120:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1788986089.482129:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993446528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986089.482192:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993446528:12345-0@lo:400:kworker.0 Request processed in 64us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986089.482199:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1788986089.482221:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993446656 00000100:00100000:2.0:1788986089.482225:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993446656 00000100:00100000:2.0:1788986089.482248:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:2.0:1788986089.482253:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993446656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986089.482282:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993446656:12345-0@lo:400:kworker.0 Request processed in 28us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986089.482287:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00080000:2.0:1788986089.482301:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986089.482332:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993446656:0@lo:400:kworker.0 00000100:00100000:1.0:1788986089.482449:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993446400:0@lo:400:kworker.0 00000100:00100000:1.0:1788986089.482476:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986089.482494:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993446912:0@lo:400:kworker.0 00000100:00100000:1.0:1788986089.482510:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986089.482526:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788986089.482531:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993446272:0@lo:400:kworker.0 00000100:00100000:1.0:1788986089.482566:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986089.482589:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993446784:0@lo:400:kworker.0 00000100:00100000:1.0:1788986089.482610:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986089.482633:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993446400 00000100:00100000:1.0:1788986089.482636:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993446400 00000100:00100000:1.0:1788986089.482659:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993446784 00000100:00100000:1.0:1788986089.482662:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993446784 00000100:00100000:1.0:1788986089.482685:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1303 00000100:00100000:1.0:1788986089.482691:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993446400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986089.482722:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993446400:12345-0@lo:400:kworker.0 Request processed in 32us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986089.482730:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1303 00000100:00100000:1.0:1788986089.482741:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1788986089.482747:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993446784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986089.482772:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993446784:12345-0@lo:400:kworker.0 Request processed in 25us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986089.482776:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1788986089.482791:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993446912 00000100:00100000:1.0:1788986089.482794:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993446912 00000100:00100000:1.0:1788986089.482817:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1788986089.482823:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993446912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986089.482850:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993446912:12345-0@lo:400:kworker.0 Request processed in 28us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986089.482856:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1788986089.482880:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993446272 00000100:00100000:1.0:1788986089.482884:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993446272 00000100:00100000:1.0:1788986089.482906:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1788986089.482912:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993446272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986089.482936:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993446272:12345-0@lo:400:kworker.0 Request processed in 24us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986089.482941:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1788986089.482981:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993446272:0@lo:400:kworker.0 00000100:00100000:1.0:1788986089.482989:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993446784:0@lo:400:kworker.0 00000100:00100000:1.0:1788986089.482996:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993446400:0@lo:400:kworker.0 00000100:00100000:1.0:1788986089.483003:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993446912:0@lo:400:kworker.0 00000100:00100000:2.0:1788986089.483136:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79797480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993446528:0@lo:400:kworker.0 00000100:00080000:2.0:1788986089.483153:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986089.483156:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986089.985600:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986089.985621:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993447040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986089.985681:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986089.986081:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993447040 00000100:00100000:2.0:1788986089.986136:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993447040 00000100:00100000:2.0:1788986089.986189:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1788986089.986198:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993447040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986089.986229:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986089.986284:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993447040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986089.986291:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1788986089.986334:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993447040:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986090.438198:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986091.381699:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986091.381780:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971222784 00000100:00100000:0.0:1788986091.381790:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971222784 00000100:00100000:0.0:1788986091.381877:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00100000:0.0:1788986091.381889:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5589:x1875885971222784:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986091.381905:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986091.381909:0:8524:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf547d34) 00010000:00010000:0.0:1788986091.381911:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986091.381967:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5589:x1875885971222784:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 82us (278us total) trans 0 rc 116/116 00000100:00100000:0.0:1788986091.381974:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 10 00000100:00080000:2.0:1788986091.382058:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986091.459010:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986091.634648:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986091.634767:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971222912 00000100:00100000:0.0:1788986091.634783:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971222912 00000100:00100000:0.0:1788986091.634872:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1086 00000100:00100000:0.0:1788986091.634884:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971222912:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986091.634979:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971222912:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 97us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986091.634986:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1086 00000100:00100000:1.0:1788986091.637598:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986091.637655:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986091.637701:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971223040 00000100:00100000:1.0:1788986091.637714:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971223040 00000100:00100000:1.0:1788986091.637807:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971223168 00000100:00100000:1.0:1788986091.637811:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971223168 00000100:00100000:1.0:1788986091.637841:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 915 00000100:00100000:1.0:1788986091.637854:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971223040:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986091.637960:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971223040:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 109us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986091.637969:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 915 00000100:00100000:1.0:1788986091.637990:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 916 00000100:00100000:1.0:1788986091.637997:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971223168:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986091.638041:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971223168:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986091.638048:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 916 00000100:00080000:1.0:1788986091.639230:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986091.639239:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986092.480297:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986093.070207:0:72792:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcea147840 20000000:00000080:2.0:1788986093.070223:0:72792:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0941cc2c00 uarg=0000000000000000 00010000:00010000:2.0:1788986093.070980:0:72792:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986093.071445:0:72792:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986093.071469:0:72792:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986093.071487:0:72792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.071508:0:72792:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf547d73 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547d6c expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.071517:0:72792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.071557:0:72792:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf547d73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547d6c expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.071571:0:72792:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf547d73 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547d6c expref: 18 pid: 5849 timeout: 1976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986093.071586:0:72792:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe42d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72792:1875885993447168:0@lo:104: 00000100:00100000:0.0:1788986093.071648:0:72792:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986093.071730:0:72792:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a511f30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986093.074152:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993447168 00000100:00100000:2.0:1788986093.074163:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993447168 00000100:00100000:2.0:1788986093.074285:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 309 00000100:00100000:2.0:1788986093.074296:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:72792:x1875885993447168:12345-0@lo:104: 00010000:00010000:2.0:1788986093.074312:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547d73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986093.074421:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986093.074427:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:72792:x1875885993447168:12345-0@lo:104: Request processed in 134us (2779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986093.074434:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 309 00000100:00100000:1.0:1788986093.074688:0:72792:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe42d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72792:1875885993447168:0@lo:104: 00010000:00010000:1.0:1788986093.074712:0:72792:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986093.074779:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986093.074785:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547d73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986093.074793:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986093.074797:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547d73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986093.074805:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547d73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986093.074813:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547d73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986093.074819:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986093.074905:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547d73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986093.074912:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788986093.074965:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993447296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986093.075002:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986093.075075:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993447296 00000100:00100000:0.0:1788986093.075080:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993447296 00010000:00010000:0.0:1788986093.075122:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf547d73 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547d6c expref: 19 pid: 5849 timeout: 1976 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986093.075146:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788986093.075154:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993447296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986093.075164:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986093.075170:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf547d73 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547d6c expref: 19 pid: 5849 timeout: 1976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.075179:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf547d73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547d6c expref: 19 pid: 5849 timeout: 1976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.075197:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf547d73 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547d6c expref: 19 pid: 5849 timeout: 1976 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.075211:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.075219:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.075233:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.075240:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.075247:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.075253:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.075258:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986093.075262:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.075269:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.075282:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986093.075295:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986093.075465:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547d73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986093.075473:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf547d6c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547d73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986093.075486:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986093.075488:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986093.075489:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986093.075519:0:72792:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986093.075526:0:72792:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986093.075532:0:72792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf547d7a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986093.079876:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993447296:12345-0@lo:103:ldlm_bl.0 Request processed in 4713us (4863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986093.079890:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:1.0:1788986093.081396:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993447296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986093.507980:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986093.568309:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993447424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986093.568387:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986093.568464:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993447424 00000100:00100000:2.0:1788986093.568472:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993447424 00000100:00100000:2.0:1788986093.568523:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:2.0:1788986093.568531:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993447424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986093.568562:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986093.568610:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993447424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986093.568616:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00080000:2.0:1788986093.568636:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986093.568670:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993447424:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986094.531475:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986094.596618:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993447552:0@lo:400:kworker.0 00000100:00100000:2.0:1788986094.596688:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986094.596797:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993447552 00000100:00100000:3.0:1788986094.596814:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993447552 00000100:00100000:3.0:1788986094.596873:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1788986094.596883:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993447552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986094.597123:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993447680:0@lo:400:kworker.0 00000100:00100000:0.0:1788986094.597157:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986094.597181:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986094.597187:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993447808:0@lo:400:kworker.0 00000100:00100000:0.0:1788986094.597210:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986094.597242:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993447936:0@lo:400:kworker.0 00000100:00100000:0.0:1788986094.597266:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986094.597291:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993447936 00000100:00100000:0.0:1788986094.597295:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993447936 00000100:00100000:0.0:1788986094.597322:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:0.0:1788986094.597328:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993447936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986094.597362:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993447936:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986094.597368:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:0.0:1788986094.597403:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993447936:0@lo:400:kworker.0 00000100:00100000:0.0:1788986094.597430:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993447680 00000100:00100000:0.0:1788986094.597433:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993447680 00000100:00100000:0.0:1788986094.597455:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993447808 00000100:00100000:0.0:1788986094.597458:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993447808 00000100:00100000:0.0:1788986094.597479:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:0.0:1788986094.597485:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993447680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986094.597521:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993447680:12345-0@lo:400:kworker.0 Request processed in 36us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986094.597527:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:0.0:1788986094.597552:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1306 00000100:00100000:0.0:1788986094.597559:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993447808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986094.597585:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993447808:12345-0@lo:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986094.597590:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1306 00000100:00100000:0.0:1788986094.597613:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993447808:0@lo:400:kworker.0 00000100:00100000:0.0:1788986094.597623:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993447680:0@lo:400:kworker.0 00000100:00100000:3.0:1788986094.604371:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993447552:12345-0@lo:400:kworker.0 Request processed in 7480us (7673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986094.604386:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00080000:3.0:1788986094.604528:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986094.605920:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993447552:0@lo:400:kworker.0 00000100:00100000:2.0:1788986094.607308:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993448064:0@lo:400:kworker.0 00000100:00100000:2.0:1788986094.607376:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986094.607555:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993448064 00000100:00100000:3.0:1788986094.607562:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993448064 00000100:00100000:3.0:1788986094.607619:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1788986094.607628:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993448064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986094.607733:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993448192:0@lo:400:kworker.0 00000100:00100000:1.0:1788986094.607782:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986094.607816:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993448192 00000100:00100000:1.0:1788986094.607821:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993448192 00000100:00100000:1.0:1788986094.607859:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1788986094.607867:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993448192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986094.607900:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993448192:12345-0@lo:400:kworker.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986094.607907:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1788986094.607957:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993448192:0@lo:400:kworker.0 00000100:00080000:1.0:1788986094.609961:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986094.609970:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986094.611236:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993448064:0@lo:400:kworker.0 00000100:00100000:3.0:1788986094.611678:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993448064:12345-0@lo:400:kworker.0 Request processed in 4047us (4298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986094.611690:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 10000000:01000000:1.0:1788986094.979385:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986094.979392:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986094.979397:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986094.979440:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986094.979451:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986094.979463:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986094.979487:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993448320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986094.979553:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986094.979606:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c61a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788986094.980321:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993448320 00000100:00100000:2.0:1788986094.980333:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993448320 00000100:00100000:2.0:1788986094.980387:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1788986094.980396:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993448320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986094.980526:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986094.980543:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547d88 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547d81 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986094.980566:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547d88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547d81 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986094.980578:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547d88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547d81 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986094.980587:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788986094.980645:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993448320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 250us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986094.980702:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1788986094.980829:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993448320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986094.980855:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547d88 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986094.980864:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547d88 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986094.980886:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986094.980891:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547d88 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986094.980898:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547d88 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986095.108960:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986095.108980:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993448448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986095.109044:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986095.109127:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993448448 00000100:00100000:1.0:1788986095.109135:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993448448 00000100:00100000:1.0:1788986095.109176:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 661 00000100:00100000:1.0:1788986095.109184:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993448448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986095.110139:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986095.110517:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993448448:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986095.110666:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993448448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1022us (1161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986095.110676:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 661 00010000:00010000:2.0:1788986095.555958:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986096.308187:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986096.308270:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971223296 00000100:00100000:0.0:1788986096.308280:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971223296 00000100:00100000:0.0:1788986096.308405:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 592 00000100:00100000:0.0:1788986096.308416:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42434:x1875885971223296:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986096.308441:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986096.308461:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d8f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f24 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986096.308520:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547d96 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986096.308533:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986096.308547:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986096.308582:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788986096.308585:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986096.308604:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547d96 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986096.308626:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547d8f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f24 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986096.308642:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547d96 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f24 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986096.308650:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:0.0:1788986096.308653:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986096.308657:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef200, rc 0) 00000100:00100000:0.0:1788986096.308718:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42434:x1875885971223296:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 304us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986096.308726:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 592 00000100:00080000:1.0:1788986096.308781:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986096.312034:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986096.312116:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971223424 00000100:00100000:2.0:1788986096.312124:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971223424 00000100:00100000:2.0:1788986096.312173:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 593 00000100:00100000:2.0:1788986096.312183:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42434:x1875885971223424:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:2.0:1788986096.312202:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986096.312222:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf547d9d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f2b expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312280:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547da4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312293:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547da4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312315:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547da4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312330:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547dab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312337:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547dab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312344:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547dab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312623:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf547db2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312632:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf547db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312639:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf547db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986096.312669:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:2.0:1788986096.312672:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986096.312690:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf547db2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312706:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547da4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312711:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547da4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312717:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547da4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312722:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986096.312725:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547da4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312732:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547da4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312741:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:2.0:1788986096.312744:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986096.312749:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547da4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312754:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf547da4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312765:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547dab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312770:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547dab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312776:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547dab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312781:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986096.312784:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547dab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312789:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547dab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312796:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986096.312798:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986096.312801:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547dab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312807:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf547dab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312850:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf547d9d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f2b expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312865:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf547db2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f2b expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.312871:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:2.0:1788986096.312874:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986096.312876:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788986096.312934:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42434:x1875885971223424:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 753us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986096.312942:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 593 00000100:00100000:3.0:1788986096.319136:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986096.319260:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971223680 00000100:00100000:1.0:1788986096.319272:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971223680 00000100:00100000:1.0:1788986096.319342:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 594 00000100:00100000:1.0:1788986096.319352:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42434:x1875885971223680:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986096.319404:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986096.319429:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf547db2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f2b expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986096.319449:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:1.0:1788986096.319459:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986096.319484:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547db9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986096.319496:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547db9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986096.319507:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547db9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788986096.416479:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000004:00010000:0.0:1788986096.417491:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001a1f5a78 reply state 000000007b2b1c8c transno 4294967520 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547db9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986096.417507:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788986096.417523:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00010000:00080000:0.0:1788986096.417662:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788986096.417684:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42434:x1875885971223680:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 98329us (98551us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788986096.417693:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 594 00010000:00010000:1.0:1788986096.418900:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547db9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986096.418914:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547db9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986096.418921:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547db9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986096.418927:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986096.418931:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547db9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986096.418938:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547db9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986096.418953:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:1.0:1788986096.418956:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986096.418961:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547db9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986096.418966:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf547db9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986096.576740:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986096.752664:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986096.752871:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971223808 00000100:00100000:1.0:1788986096.752883:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971223808 00000100:00100000:1.0:1788986096.752939:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1089 00000100:00100000:1.0:1788986096.752950:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971223808:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986096.753015:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971223808:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986096.753023:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1089 00000100:00100000:3.0:1788986096.765217:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986096.765319:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971223936 00000100:00100000:0.0:1788986096.765328:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971223936 00000100:00100000:0.0:1788986096.765386:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1308 00000100:00100000:0.0:1788986096.765395:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971223936:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986096.765483:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971223936:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986096.765490:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1308 00000100:00100000:3.0:1788986096.766058:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986096.766122:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986096.766181:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971224192 00000100:00100000:0.0:1788986096.766186:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971224192 00000100:00080000:3.0:1788986096.766274:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986096.766578:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971224064 00000100:00100000:0.0:1788986096.766583:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971224064 00000100:00080000:3.0:1788986096.766639:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986096.767012:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 919 00000100:00100000:2.0:1788986096.767024:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971224192:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986096.767187:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971224192:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 165us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986096.767195:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 919 00000100:00100000:2.0:1788986096.767225:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 920 00000100:00100000:2.0:1788986096.767235:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971224064:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986096.767263:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971224064:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (1176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986096.767269:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 920 00000020:00000080:1.0:1788986097.382594:0:72988:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4c121f40 20000000:00000080:1.0:1788986097.382609:0:72988:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a8096c000 uarg=0000000000000000 00010000:00010000:1.0:1788986097.383065:0:72988:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788986097.383221:0:72988:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:1.0:1788986097.383225:0:72988:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986097.383235:0:72988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547d96 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f24 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986097.383256:0:72988:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1788986097.383274:0:72988:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986097.383289:0:72988:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986097.383301:0:72988:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547d88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547d81 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986097.383309:0:72988:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986097.383342:0:72988:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547d88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547d81 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986097.383355:0:72988:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547d88 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547d81 expref: 18 pid: 5848 timeout: 1981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986097.383367:0:72988:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72988:1875885993448576:0@lo:104: 00000100:00100000:1.0:1788986097.383424:0:72988:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986097.383583:0:72988:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c61600 going to sleep for 11 seconds 00000100:00100000:0.0:1788986097.383721:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993448576 00000100:00100000:0.0:1788986097.383728:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993448576 00000100:00100000:0.0:1788986097.383808:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788986097.383817:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:72988:x1875885993448576:12345-0@lo:104: 00010000:00010000:0.0:1788986097.383839:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547d88 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986097.383904:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986097.383910:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:72988:x1875885993448576:12345-0@lo:104: Request processed in 95us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986097.383917:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00010000:00010000:3.0:1788986097.383969:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986097.383975:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547d88 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.383983:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986097.383986:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547d88 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.383994:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547d88 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986097.384013:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547d88 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986097.384018:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986097.384046:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547d88 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384053:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986097.384072:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547d88 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384078:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf547d81 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547d88 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384118:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986097.384120:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986097.384122:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986097.384134:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993448704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986097.384165:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986097.384194:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993448704 00000100:00100000:3.0:1788986097.384198:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993448704 00010000:00010000:3.0:1788986097.384217:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547d88 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547d81 expref: 19 pid: 5848 timeout: 1981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986097.384236:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788986097.384241:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993448704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986097.384250:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986097.384255:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547d88 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547d81 expref: 19 pid: 5848 timeout: 1981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384265:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547d88 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547d81 expref: 19 pid: 5848 timeout: 1981 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384280:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384288:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384301:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384309:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384315:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384322:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384327:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986097.384331:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384338:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384346:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986097.384358:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986097.384384:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993448704:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986097.384391:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:3.0:1788986097.384421:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993448704:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986097.384702:0:72988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547d88 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547d81 expref: 18 pid: 5848 timeout: 1981 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986097.384712:0:72988:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:72988:1875885993448576:0@lo:104: 00010000:00010000:1.0:1788986097.384726:0:72988:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986097.384734:0:72988:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986097.384740:0:72988:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986097.384746:0:72988:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf547dc0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 72988 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986097.602871:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986098.624231:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986098.689276:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986098.689299:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993448832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986098.689358:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986098.689543:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993448832 00000100:00100000:0.0:1788986098.689551:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993448832 00000100:00100000:0.0:1788986098.689612:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:0.0:1788986098.689622:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993448832:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986098.689662:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986098.689783:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993448832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986098.689796:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:0.0:1788986098.689851:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993448832:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986098.690867:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1788986098.880409:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986098.880469:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986098.880473:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986098.880518:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986098.880528:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986098.880539:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986098.880563:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993448960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986098.880621:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986098.880679:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42f8bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986098.882535:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993448960 00000100:00100000:2.0:1788986098.882545:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993448960 00000100:00100000:2.0:1788986098.882592:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1788986098.882601:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993448960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986098.882615:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986098.882632:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547dce lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547dc7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986098.882657:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547dce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547dc7 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986098.882669:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547dce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547dc7 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986098.882678:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788986098.883022:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993448960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 421us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986098.883033:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1788986098.883160:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d37b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993448960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986098.883176:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547dce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986098.883186:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547dce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986098.883206:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986098.883211:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547dce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986098.883218:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547dce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986099.648270:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986099.712422:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993449216:0@lo:400:kworker.0 00000100:00100000:0.0:1788986099.712453:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993449088:0@lo:400:kworker.0 00000100:00100000:3.0:1788986099.712521:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993449344:0@lo:400:kworker.0 00000100:00100000:3.0:1788986099.713261:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986099.713324:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986099.713331:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993449472:0@lo:400:kworker.0 00000100:00100000:3.0:1788986099.713373:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986099.713380:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986099.713414:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993449472 00000100:00100000:0.0:1788986099.713421:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993449600:0@lo:400:kworker.0 00000100:00100000:3.0:1788986099.713422:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993449472 00000100:00100000:0.0:1788986099.713450:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986099.713487:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993449088 00000100:00100000:0.0:1788986099.713491:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993449088 00000100:00100000:3.0:1788986099.713493:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:3.0:1788986099.713504:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993449472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986099.713543:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1788986099.713553:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993449088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986099.713559:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993449472:12345-0@lo:400:kworker.0 Request processed in 55us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986099.713567:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:0.0:1788986099.713597:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993449088:12345-0@lo:400:kworker.0 Request processed in 45us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986099.713604:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1788986099.713753:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993449088:0@lo:400:kworker.0 00000100:00100000:2.0:1788986099.713776:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993449344 00000100:00100000:2.0:1788986099.713781:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993449344 00000100:00100000:2.0:1788986099.713838:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993449600 00000100:00100000:2.0:1788986099.713841:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993449600 00000100:00100000:2.0:1788986099.713868:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1788986099.713875:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993449344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986099.713940:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993449472:0@lo:400:kworker.0 00000100:00100000:3.0:1788986099.713988:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:3.0:1788986099.713996:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993449600:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788986099.714029:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986099.714041:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993449600:12345-0@lo:400:kworker.0 Request processed in 46us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986099.714049:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:3.0:1788986099.714078:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993449600:0@lo:400:kworker.0 00000100:00100000:2.0:1788986099.714237:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993449344:12345-0@lo:400:kworker.0 Request processed in 362us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986099.714244:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:1.0:1788986099.714342:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986099.714372:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993449728:0@lo:400:kworker.0 00000100:00100000:1.0:1788986099.714397:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986099.714432:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993449216 00000100:00100000:2.0:1788986099.714448:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993449216 00000100:00100000:2.0:1788986099.714473:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1311 00000100:00100000:2.0:1788986099.714479:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993449216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986099.714516:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993449216:12345-0@lo:400:kworker.0 Request processed in 37us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986099.714523:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1311 00000100:00100000:1.0:1788986099.714529:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993449216:0@lo:400:kworker.0 00000100:00100000:0.0:1788986099.714644:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993449728 00000100:00100000:0.0:1788986099.714648:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993449728 00000100:00100000:0.0:1788986099.714694:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:0.0:1788986099.714702:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993449728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986099.714738:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993449728:12345-0@lo:400:kworker.0 Request processed in 38us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986099.714744:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:0.0:1788986099.714770:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993449728:0@lo:400:kworker.0 00000100:00100000:3.0:1788986099.714897:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993449344:0@lo:400:kworker.0 00000100:00080000:1.0:1788986099.715148:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986100.098069:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986100.098334:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971224320 00000100:00100000:2.0:1788986100.098343:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971224320 00000100:00100000:2.0:1788986100.098426:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 595 00000100:00100000:2.0:1788986100.098437:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42511:x1875885971224320:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986100.098455:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986100.098477:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547dd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f32 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.098537:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ddc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.098554:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.098567:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.098578:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547de3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.098585:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.098591:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.098929:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547dea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.098939:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.098947:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986100.098969:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:2.0:1788986100.098972:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986100.098990:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547dea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099001:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ddc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099010:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ddc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099017:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ddc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099023:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986100.099027:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ddc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099034:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ddc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099045:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986100.099048:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986100.099052:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ddc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099056:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ddc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099067:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547de3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099072:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547de3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099077:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547de3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099082:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986100.099086:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547de3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099138:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547de3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099146:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a45aca000) 00010000:00010000:2.0:1788986100.099148:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986100.099151:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547de3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099156:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547de3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099184:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547dd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f32 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099198:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547dea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f32 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.099204:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986100.099207:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986100.099210:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0800, rc 0) 00000100:00100000:2.0:1788986100.099273:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42511:x1875885971224320:12345-192.168.206.21@tcp:101:touch.0 Request processed in 838us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986100.099280:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 595 00000100:00080000:1.0:1788986100.099715:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986100.102609:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986100.103360:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971224576 00000100:00100000:1.0:1788986100.103369:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971224576 00000100:00100000:1.0:1788986100.103465:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 596 00000100:00100000:1.0:1788986100.103476:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42511:x1875885971224576:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986100.103495:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986100.103514:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547df1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f39 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.103884:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547df8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.103902:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.103913:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.103926:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547dff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.103932:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.103938:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986100.110027:0:7899:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x13:0x0], index 0: 0 00010000:00010000:0.0:1788986100.110541:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547e06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.110558:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.110570:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547e06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.110609:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547df8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.110617:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547df8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.110624:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547df8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.110630:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986100.110634:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547df8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.110643:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547df8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.110654:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:0.0:1788986100.110657:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986100.110661:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547df8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.110667:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547df8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986100.110681:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000063658c37 reply state 0000000094d06686 transno 4294967521 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986100.110689:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788986100.110722:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf547df1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f39 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.110739:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547e06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f39 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.110746:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:0.0:1788986100.110748:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986100.110750:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efc00, rc 0) 00000100:00100000:0.0:1788986100.110908:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:42511:x1875885971224576:12345-192.168.206.21@tcp:101:touch.0 Request processed in 7432us (8306us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788986100.110916:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 596 00000100:00100000:3.0:1788986100.121718:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986100.121892:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971224832 00000100:00100000:0.0:1788986100.121902:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971224832 00000100:00100000:0.0:1788986100.121959:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 597 00000100:00100000:0.0:1788986100.121969:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:42511:x1875885971224832:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:0.0:1788986100.122023:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986100.122046:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547e06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f39 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.122064:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:0.0:1788986100.122073:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986100.122129:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547e14 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.122143:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.122152:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986100.122598:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000503550e5 reply state 0000000031f9ef7d transno 4294967522 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986100.122608:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986100.122699:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:42511:x1875885971224832:12345-192.168.206.21@tcp:36:touch.0 Request processed in 727us (985us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788986100.122707:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 597 00010000:00010000:0.0:1788986100.124805:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547e14 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.124828:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547e14 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.124836:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547e14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.124841:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986100.124846:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547e14 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.124853:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547e14 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.124867:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986100.124870:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986100.124875:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547e14 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.124880:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf547e14 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.126144:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547dff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.126156:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547dff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.126164:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547dff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.126169:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986100.126173:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547dff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.126181:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547dff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.126196:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a45aca500) 00010000:00010000:2.0:1788986100.126199:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986100.126202:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547dff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.126207:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547dff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986100.126734:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986100.127010:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971224960 00000100:00100000:2.0:1788986100.127018:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971224960 00000100:00100000:2.0:1788986100.127074:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 598 00000100:00100000:2.0:1788986100.127084:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42511:x1875885971224960:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986100.127131:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986100.127147:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547e1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f40 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.127199:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547e1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f40 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.127212:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547e1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x31:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f40 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.127227:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986100.127230:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788986100.127233:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1a00, rc 0) 00000100:00100000:2.0:1788986100.127438:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:42511:x1875885971224960:12345-192.168.206.21@tcp:101:touch.0 Request processed in 354us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986100.127448:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 598 00000100:00100000:3.0:1788986100.133331:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986100.133487:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971225088 00000100:00100000:2.0:1788986100.133496:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971225088 00000100:00100000:2.0:1788986100.133562:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 318 00000100:00100000:2.0:1788986100.133571:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971225088:12345-192.168.206.21@tcp:2:touch.0 00000100:00080000:1.0:1788986100.133888:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986100.134005:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094242d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971225088:12345-192.168.206.21@tcp:2:touch.0 Request processed in 434us (680us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788986100.134013:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 318 00000100:00100000:1.0:1788986100.137199:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986100.137278:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971225344 00000100:00100000:2.0:1788986100.137356:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971225344 00000100:00100000:2.0:1788986100.137445:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:2.0:1788986100.137455:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:42511:x1875885971225344:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:2.0:1788986100.137751:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:42511:x1875885971225344:12345-192.168.206.21@tcp:35:touch.0 Request processed in 295us (557us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788986100.137760:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 62 00000100:00100000:0.0:1788986100.204974:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986100.205065:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971225472 00000100:00100000:2.0:1788986100.205074:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971225472 00000100:00100000:2.0:1788986100.205163:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 599 00000100:00100000:2.0:1788986100.205173:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:42515:x1875885971225472:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986100.205203:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986100.205222:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547e22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f47 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205294:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547e29 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205313:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547e29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205324:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547e29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205338:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547e30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205346:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205353:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205429:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547e37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205438:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205445:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986100.205475:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x31:0x0]: returning size 0 00000004:00200000:2.0:1788986100.205479:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986100.205496:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205507:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547e37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205519:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547e29 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205525:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547e29 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205532:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547e29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205537:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986100.205541:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547e29 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205548:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547e29 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205558:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986100.205561:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986100.205565:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547e29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205571:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547e29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205583:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547e30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205588:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547e30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205593:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205598:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986100.205601:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547e30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205606:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547e30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205613:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a45aca500) 00010000:00010000:2.0:1788986100.205615:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986100.205618:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547e30 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205624:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547e30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205650:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547e22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f47 expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205664:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547e37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f47 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.205671:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986100.205673:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986100.205675:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1800, rc 0) 00000100:00100000:2.0:1788986100.205732:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:42515:x1875885971225472:12345-192.168.206.21@tcp:101:rm.0 Request processed in 560us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986100.205739:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 599 00000100:00100000:3.0:1788986100.210182:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986100.210271:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971225600 00000100:00100000:0.0:1788986100.210279:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971225600 00000100:00100000:0.0:1788986100.210336:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 319 00000100:00100000:0.0:1788986100.210344:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971225600:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986100.210359:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986100.210379:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002212fc43/0xc20d828fcf547e3e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f4e expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986100.210403:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x6aa1c2f3, atime: 0x6aa1c2f3, ctime: 0x6aa1c2f3, blocks: 0x1 00010000:00010000:0.0:1788986100.210421:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=1884s v=(0 0) 00010000:00010000:0.0:1788986100.210426:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986100.210434:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002212fc43/0xc20d828fcf547e3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f4e expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.210452:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002212fc43/0xc20d828fcf547e3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f4e expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.210463:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eea00, rc 0) 00000100:00100000:0.0:1788986100.210524:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971225600:12345-192.168.206.21@tcp:101:rm.0 Request processed in 180us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986100.210533:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 319 00000100:00100000:1.0:1788986100.213282:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986100.213396:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971225856 00000100:00100000:0.0:1788986100.213405:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971225856 00000100:00100000:0.0:1788986100.213452:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 600 00000100:00100000:0.0:1788986100.213460:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:42515:x1875885971225856:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1788986100.213503:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986100.213525:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547e37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f47 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.213543:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547e1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x31:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f40 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.213551:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:0.0:1788986100.213560:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986100.213578:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547e45 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.213589:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547e45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.213597:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547e45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.213618:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547e4c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.213626:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.213637:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.213736:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547e53 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.213744:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547e53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.213752:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547e53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788986100.214356:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].19, 64 off9408 00000004:00080000:0.0:1788986100.214365:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1884117275338ns, next at 1885117273563ns, rc = 0 00010000:00010000:0.0:1788986100.214411:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547e5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214421:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547e5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214428:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547e5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214435:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547e5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214441:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547e5a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214447:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547e5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214471:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788986100.214489:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547e53 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214495:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547e53 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214501:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547e53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214506:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986100.214510:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547e53 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214516:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547e53 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214524:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:0.0:1788986100.214526:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788986100.214530:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547e53 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214536:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf547e53 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x31:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214549:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547e45 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214554:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547e45 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214563:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547e45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214567:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986100.214570:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547e45 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214575:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547e45 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214582:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:0.0:1788986100.214584:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986100.214587:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547e45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986100.214593:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf547e45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986100.214601:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f8e72585 reply state 000000003ac12fbf transno 4294967524 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986100.214609:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986100.214673:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:42515:x1875885971225856:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1212us (1396us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788986100.214680:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 600 00010000:00010000:2.0:1788986100.214725:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986100.214733:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547e5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.214740:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986100.214743:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547e5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.214749:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547e5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.214759:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x31:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:2.0:1788986100.214761:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788986100.214764:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547e5a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.214770:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547e5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x31:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.214784:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986100.214785:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986100.214787:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986100.217396:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547e4c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.217411:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547e4c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.217418:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547e4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.217424:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986100.217428:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547e4c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.217435:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547e4c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.217448:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a4823b800) 00010000:00010000:2.0:1788986100.217451:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986100.217456:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547e4c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986100.217461:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547e4c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986100.225204:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986100.225227:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993449856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986100.225285:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986100.225517:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993449856 00000100:00100000:1.0:1788986100.225524:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993449856 00000100:00100000:1.0:1788986100.225571:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:1.0:1788986100.225579:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993449856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986100.225618:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986100.225675:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993449856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986100.225809:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:2.0:1788986100.226052:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993449856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986100.673960:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788986100.784350:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967334 is committed 00010000:00010000:0.0:1788986101.696394:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986101.804962:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000004:00080000:3.0:1788986101.804974:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 49 committed 00000100:00100000:3.0:1788986101.805129:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993449984:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788986101.805188:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986101.805445:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993449984 00000100:00100000:3.0:1788986101.805452:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993449984 00000100:00100000:3.0:1788986101.805511:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788986101.805518:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993449984:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788986101.805541:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:19 count 1 00010000:00010000:3.0:1788986101.805573:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.805599:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002212fc43/0xc20d828fcf547e3e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f4e expref: 5 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.805608:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788986101.805613:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986101.805618:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.805644:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002212fc43/0xc20d828fcf547e3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f4e expref: 5 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.805658:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002212fc43/0xc20d828fcf547e3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f4e expref: 5 pid: 6695 timeout: 1985 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986101.805670:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993450112:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788986101.805719:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a554e0600 going to sleep for 11 seconds 00000100:00080000:1.0:1788986101.806962:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986101.811592:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993450112:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788986101.811620:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986101.811865:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986101.811959:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971225984 00000100:00100000:2.0:1788986101.811966:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971225984 00010000:00010000:2.0:1788986101.812001:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002212fc43/0xc20d828fcf547e3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f4e expref: 6 pid: 6695 timeout: 1985 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986101.812203:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 345 00000100:00100000:2.0:1788986101.812213:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971225984:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788986101.812228:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986101.812235:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002212fc43/0xc20d828fcf547e3e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f4e expref: 6 pid: 6695 timeout: 1985 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986101.812248:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002212fc43/0xc20d828fcf547e3e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f4e expref: 6 pid: 6695 timeout: 1985 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986101.812269:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002212fc43/0xc20d828fcf547e3e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f4e expref: 6 pid: 6695 timeout: 1985 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986101.812293:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986101.812298:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986101.812303:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986101.812313:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986101.812341:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986101.812393:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971225984:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 181us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986101.812401:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 345 00010000:00010000:3.0:1788986101.812484:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.812494:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.812503:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.812510:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.812527:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788986101.813067:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993449984:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7547us (7877us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788986101.813076:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00010000:3.0:1788986101.813118:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986101.813124:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.813131:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986101.813135:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.813144:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.813157:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.813164:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000651ca737/0xc20d828fcf547e61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986101.813183:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986101.813185:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986101.813187:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986101.813213:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b094247d500/2, rc 0, transno 4294967335 00000100:00100000:3.0:1788986101.813219:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993449984:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788986101.881577:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986101.881626:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986101.881673:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971226112 00000100:00100000:1.0:1788986101.881683:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971226112 00000100:00100000:1.0:1788986101.881739:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1092 00000100:00100000:1.0:1788986101.881750:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971226112:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986101.881766:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971226240 00000100:00100000:0.0:1788986101.881772:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971226240 00000100:00100000:1.0:1788986101.881826:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971226112:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 78us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986101.881835:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1312 00000100:00100000:1.0:1788986101.881836:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1092 00000100:00100000:0.0:1788986101.881850:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971226240:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986101.881893:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971226240:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 47us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986101.881901:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1312 00000100:00100000:3.0:1788986101.885924:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986101.886069:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971226368 00000100:00100000:1.0:1788986101.886103:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971226368 00000100:00100000:1.0:1788986101.886232:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 321 00000100:00100000:1.0:1788986101.886242:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971226368:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:1.0:1788986101.886269:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf547c07 00000100:00080000:1.0:1788986101.886290:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f56c000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788986101.886326:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967333 00000100:00100000:1.0:1788986101.889292:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971226368:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 3032us (3359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986101.889305:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 321 00000100:00080000:0.0:1788986101.890159:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788986101.890173:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986102.045330:0:73234:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd680e1e70 20000000:00000080:3.0:1788986102.045346:0:73234:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0943181c00 uarg=0000000000000000 00010000:00010000:3.0:1788986102.046256:0:73234:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788986102.046289:0:73234:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:3.0:1788986102.046293:0:73234:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986102.046303:0:73234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547dea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f32 expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986102.046323:0:73234:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1788986102.046339:0:73234:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986102.046351:0:73234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986102.046363:0:73234:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547dce lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547dc7 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986102.046371:0:73234:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986102.046405:0:73234:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547dce lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547dc7 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986102.046420:0:73234:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547dce lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547dc7 expref: 18 pid: 5848 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986102.046432:0:73234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73234:1875885993450240:0@lo:104: 00000100:00100000:3.0:1788986102.046491:0:73234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986102.046589:0:73234:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a554e0600 going to sleep for 11 seconds 00000100:00100000:2.0:1788986102.046630:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993450240 00000100:00100000:2.0:1788986102.046637:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993450240 00000100:00100000:2.0:1788986102.046729:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1788986102.046738:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:73234:x1875885993450240:12345-0@lo:104: 00010000:00010000:2.0:1788986102.046752:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547dce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986102.046834:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986102.046841:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:73234:x1875885993450240:12345-0@lo:104: Request processed in 105us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986102.046848:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00010000:00010000:1.0:1788986102.046897:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986102.046903:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547dce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.046912:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986102.046915:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547dce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.046924:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547dce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986102.046932:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547dce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986102.046938:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986102.046963:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547dce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.046971:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986102.046989:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547dce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047000:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf547dc7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547dce expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047013:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986102.047015:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986102.047017:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986102.047033:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993450368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986102.047065:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986102.047123:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993450368 00000100:00100000:1.0:1788986102.047127:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993450368 00010000:00010000:1.0:1788986102.047146:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547dce lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547dc7 expref: 19 pid: 5848 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986102.047168:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788986102.047174:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993450368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986102.047183:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986102.047187:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547dce lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547dc7 expref: 19 pid: 5848 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047196:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547dce lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547dc7 expref: 19 pid: 5848 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047210:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047218:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047236:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047244:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047251:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047258:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047264:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986102.047268:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047275:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047284:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986102.047293:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986102.047320:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993450368:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986102.047326:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:1.0:1788986102.047361:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993450368:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986102.047444:0:73234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547dce lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547dc7 expref: 18 pid: 5848 timeout: 1985 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986102.047458:0:73234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73234:1875885993450240:0@lo:104: 00010000:00010000:3.0:1788986102.047471:0:73234:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986102.047480:0:73234:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986102.047486:0:73234:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986102.047493:0:73234:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547e68 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986102.723183:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788986103.243899:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986103.243905:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986103.243910:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986103.243966:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986103.243979:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986103.243990:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986103.244014:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993450496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986103.244073:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986103.244135:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a45b97540 going to sleep for 11 seconds 00000100:00100000:2.0:1788986103.244156:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993450496 00000100:00100000:2.0:1788986103.244163:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993450496 00000100:00100000:2.0:1788986103.244205:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:2.0:1788986103.244214:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993450496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986103.244227:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986103.244238:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf547e76 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547e6f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986103.244260:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf547e76 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547e6f expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986103.244270:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf547e76 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547e6f expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986103.244279:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0800, rc 0) 00000100:00100000:2.0:1788986103.244316:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993450496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986103.244322:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:2.0:1788986103.244368:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993450496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986103.244381:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547e76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986103.244390:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547e76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986103.244406:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986103.244411:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547e76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986103.244417:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547e76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986103.746722:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986103.808372:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993450624:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986103.808433:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986103.812188:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993450624 00000100:00100000:0.0:1788986103.812201:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993450624 00000100:00100000:0.0:1788986103.812280:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:0.0:1788986103.812291:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993450624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986103.812323:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986103.812397:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993450624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (3962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986103.812404:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00080000:0.0:1788986103.812425:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986103.812462:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993450624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986104.768215:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986104.833243:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993451008:0@lo:400:kworker.0 00000100:00100000:2.0:1788986104.833314:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986104.833366:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986104.833373:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993451136:0@lo:400:kworker.0 00000100:00100000:2.0:1788986104.833399:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986104.833964:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993450752:0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834000:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986104.834033:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993451264:0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834055:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986104.834075:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788986104.834081:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993450880:0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834122:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986104.834138:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993451392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834157:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986104.834186:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993451008 00000100:00100000:3.0:1788986104.834193:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993451008 00000100:00100000:3.0:1788986104.834236:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993451264 00000100:00100000:3.0:1788986104.834240:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993451264 00000100:00100000:3.0:1788986104.834271:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993450880 00000100:00100000:3.0:1788986104.834274:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993450880 00000100:00100000:3.0:1788986104.834290:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1788986104.834297:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993451008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834345:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993451008:12345-0@lo:400:kworker.0 Request processed in 48us (1031us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986104.834352:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1788986104.834367:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1788986104.834373:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993451264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834403:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993451264:12345-0@lo:400:kworker.0 Request processed in 30us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986104.834408:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1314 00000100:00100000:3.0:1788986104.834422:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:3.0:1788986104.834428:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993450880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834452:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993450880:12345-0@lo:400:kworker.0 Request processed in 24us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986104.834456:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00100000:3.0:1788986104.834474:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993451136 00000100:00100000:3.0:1788986104.834477:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993451136 00000100:00100000:3.0:1788986104.834497:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993451392 00000100:00100000:3.0:1788986104.834499:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993451392 00000100:00100000:3.0:1788986104.834520:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1788986104.834525:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993451136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834551:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993451136:12345-0@lo:400:kworker.0 Request processed in 26us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986104.834556:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1788986104.834567:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:3.0:1788986104.834572:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993451392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834596:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993451392:12345-0@lo:400:kworker.0 Request processed in 24us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986104.834601:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00080000:3.0:1788986104.834624:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986104.834628:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986104.834664:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993451136:0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834674:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993451008:0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834700:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993450880:0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834708:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993451392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986104.834717:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993451264:0@lo:400:kworker.0 00000100:00100000:2.0:1788986104.835267:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993450752 00000100:00100000:2.0:1788986104.835272:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993450752 00000100:00100000:2.0:1788986104.835306:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:2.0:1788986104.835313:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993450752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986104.835357:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993450752:12345-0@lo:400:kworker.0 Request processed in 45us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986104.835362:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:2.0:1788986104.835397:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993450752:0@lo:400:kworker.0 00000100:00100000:0.0:1788986104.904520:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986104.904606:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971226496 00000100:00100000:3.0:1788986104.904616:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971226496 00000100:00080000:0.0:1788986104.904782:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986104.904849:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 601 00000100:00100000:3.0:1788986104.904862:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42ccf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42602:x1875885971226496:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986104.904880:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986104.904899:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f55 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.904958:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547e84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.904972:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.904984:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986104.905022:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:3.0:1788986104.905026:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986104.905044:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547e84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.905067:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f55 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.905110:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547e84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f55 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.905119:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:3.0:1788986104.905122:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986104.905125:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3c00, rc 0) 00000100:00100000:3.0:1788986104.905184:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42ccf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42602:x1875885971226496:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 324us (672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986104.905191:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 601 00000100:00100000:2.0:1788986104.917420:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986104.917502:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971226752 00000100:00100000:3.0:1788986104.917511:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971226752 00000100:00100000:3.0:1788986104.917559:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 602 00000100:00100000:3.0:1788986104.917568:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42602:x1875885971226752:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986104.917621:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986104.917648:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547e84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f55 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.917666:0:15241:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf547dea) 00010000:00010000:3.0:1788986104.917670:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:3.0:1788986104.917680:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986104.917713:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.917727:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.917736:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986104.938394:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c8128419 reply state 00000000da088652 transno 4294967525 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986104.938411:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986104.938426:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000100:00100000:3.0:1788986104.938515:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42602:x1875885971226752:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 20944us (21099us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788986104.938523:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 602 00000001:00080000:3.0:1788986104.938561:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00010000:00010000:3.0:1788986104.938669:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.938677:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.938695:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.938708:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986104.938713:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.938722:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.938737:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986104.938740:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986104.938745:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986104.938752:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf547e8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986105.347862:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986105.347883:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993451520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986105.347945:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986105.348193:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993451520 00000100:00100000:0.0:1788986105.348201:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993451520 00000100:00100000:0.0:1788986105.348301:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1788986105.348313:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993451520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986105.348344:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986105.348410:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993451520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986105.348417:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000100:00100000:3.0:1788986105.348553:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993451520:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986105.793758:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788986105.912518:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788986105.912527:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b0a7f56d800/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:3.0:1788986105.912865:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a7f56d800/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0001 00000020:00000080:3.0:1788986105.912912:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a7f56c000 for lustre-OST0001 00000001:00080000:2.0:1788986105.924348:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967335 is committed 00000020:00000080:2.0:1788986105.934468:0:73432:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeb567d2d0 20000000:00000080:2.0:1788986105.934484:0:73432:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0942b5b000 uarg=0000000000000000 00010000:00010000:2.0:1788986105.935314:0:73432:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986105.935330:0:73432:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986105.935344:0:73432:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986105.935360:0:73432:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986105.935376:0:73432:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf547e76 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547e6f expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986105.935384:0:73432:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986105.935418:0:73432:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf547e76 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547e6f expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986105.935439:0:73432:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf547e76 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547e6f expref: 18 pid: 5849 timeout: 1989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986105.935452:0:73432:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73432:1875885993451648:0@lo:104: 00000100:00100000:2.0:1788986105.935508:0:73432:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986105.935708:0:73432:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a44db3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788986105.935747:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993451648 00000100:00100000:0.0:1788986105.935754:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993451648 00000100:00100000:0.0:1788986105.935836:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788986105.935845:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:73432:x1875885993451648:12345-0@lo:104: 00010000:00010000:0.0:1788986105.935856:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547e76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986105.936001:0:73432:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73432:1875885993451648:0@lo:104: 00010000:00010000:3.0:1788986105.936019:0:73432:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936041:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986105.936049:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:73432:x1875885993451648:12345-0@lo:104: Request processed in 205us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986105.936057:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00010000:00010000:1.0:1788986105.936154:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986105.936161:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547e76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986105.936168:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986105.936172:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547e76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986105.936179:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547e76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986105.936186:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547e76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986105.936191:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986105.936226:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547e76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986105.936233:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986105.936251:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547e76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986105.936258:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf547e6f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547e76 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986105.936272:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986105.936274:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986105.936275:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986105.936282:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986105.936292:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993451776:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986105.936322:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986105.936587:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993451776 00000100:00100000:0.0:1788986105.936592:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993451776 00010000:00010000:0.0:1788986105.936611:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf547e76 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547e6f expref: 19 pid: 5849 timeout: 1989 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986105.936669:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:0.0:1788986105.936676:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993451776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986105.936686:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986105.936691:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf547e76 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547e6f expref: 19 pid: 5849 timeout: 1989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936704:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf547e76 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547e6f expref: 19 pid: 5849 timeout: 1989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936715:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf547e76 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547e6f expref: 19 pid: 5849 timeout: 1989 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936726:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936734:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936746:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936753:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936760:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936767:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936773:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986105.936777:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936795:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936819:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986105.936828:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986105.936862:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993451776:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986105.936868:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00010000:3.0:1788986105.936947:0:73432:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986105.936957:0:73432:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986105.936964:0:73432:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf547e92 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73432 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986105.937075:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993451776:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986106.816399:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986107.003064:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986107.003218:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971227008 00000100:00100000:1.0:1788986107.003231:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971227008 00000100:00100000:1.0:1788986107.003328:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1316 00000100:00100000:1.0:1788986107.003343:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971227008:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986107.003461:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971227008:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 123us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986107.003469:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1316 00000100:00080000:2.0:1788986107.003650:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986107.012454:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986107.012537:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986107.012558:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971226880 00000100:00100000:3.0:1788986107.012574:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971226880 00000100:00100000:3.0:1788986107.012644:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1095 00000100:00100000:3.0:1788986107.012656:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971226880:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986107.020013:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971226880:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 7344us (7556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986107.020029:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1095 00000100:00100000:3.0:1788986107.020113:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971227136 00000100:00100000:3.0:1788986107.020120:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971227136 00000100:00100000:3.0:1788986107.020175:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 925 00000100:00100000:3.0:1788986107.020183:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971227136:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:2.0:1788986107.026374:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986107.031876:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971227136:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 11679us (19330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986107.031891:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 925 00010000:00010000:1.0:1788986107.841233:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788986107.908291:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986107.908301:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986107.908307:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986107.908364:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986107.908378:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986107.908391:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986107.908423:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993451904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986107.908514:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986107.908575:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a4d5ee180 going to sleep for 11 seconds 00000100:00100000:3.0:1788986107.909148:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993451904 00000100:00100000:3.0:1788986107.909160:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993451904 00000100:00100000:3.0:1788986107.909234:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:3.0:1788986107.909381:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993451904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986107.909400:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986107.909419:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547ea0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547e99 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986107.909447:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547ea0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547e99 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986107.909461:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547ea0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547e99 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986107.909472:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788986107.911538:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993451904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2153us (3016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986107.911553:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:1.0:1788986107.913085:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993451904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986107.913330:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547ea0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986107.913345:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547ea0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986107.913374:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986107.913380:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547ea0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986107.913388:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547ea0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986108.868199:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986108.928740:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993452032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986108.928842:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986108.930673:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993452032 00000100:00100000:0.0:1788986108.930690:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993452032 00000100:00100000:0.0:1788986108.930799:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1788986108.930811:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993452032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986108.930872:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986108.930977:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993452032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986108.930985:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:0.0:1788986108.931052:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000004:00080000:0.0:1788986108.931058:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b094247d500, transno 4294967335 00000100:00100000:0.0:1788986108.931113:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993452032:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986108.932117:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986109.083686:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986109.083722:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971227264 00000100:00100000:3.0:1788986109.083732:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971227264 00000100:00100000:3.0:1788986109.083804:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 603 00000100:00100000:3.0:1788986109.083814:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42679:x1875885971227264:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:3.0:1788986109.083833:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986109.083855:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547ea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f5c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.083919:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547eae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.083932:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547eae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.083943:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547eae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.083954:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547eb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.083960:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.083966:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084291:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547ebc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084300:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084307:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986109.084328:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:3.0:1788986109.084332:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986109.084349:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547ebc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084361:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547eae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084367:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547eae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084373:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547eae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084378:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986109.084382:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547eae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084389:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547eae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084400:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986109.084403:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986109.084408:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547eae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084414:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547eae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084428:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547eb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084433:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547eb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084438:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084443:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986109.084445:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547eb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084451:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547eb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084458:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a55745700) 00010000:00010000:3.0:1788986109.084460:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986109.084463:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547eb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084468:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547eb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084497:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547ea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f5c expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084517:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547ebc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f5c expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.084524:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986109.084526:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986109.084529:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986109.084585:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42679:x1875885971227264:12345-192.168.206.21@tcp:101:touch.0 Request processed in 772us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986109.084592:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 603 00000100:00080000:3.0:1788986109.084617:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986109.096303:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986109.096351:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971227520 00000100:00100000:1.0:1788986109.096362:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971227520 00000100:00100000:1.0:1788986109.096431:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 604 00000100:00100000:1.0:1788986109.096442:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42679:x1875885971227520:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986109.096461:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986109.096480:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547ec3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f63 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096561:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547eca lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096575:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547eca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096588:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547eca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096602:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547ed1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096609:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096617:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986109.096632:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00010000:00010000:1.0:1788986109.096652:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547eca lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096659:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547eca lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096667:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547eca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096673:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986109.096677:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547eca lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096685:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547eca lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096696:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:1.0:1788986109.096699:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986109.096704:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547eca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096710:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf547eca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096723:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547ed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096730:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547ed1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096736:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547ed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096746:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986109.096749:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547ed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096755:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547ed1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096762:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a45316c00) 00010000:00010000:1.0:1788986109.096776:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986109.096779:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547ed1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096786:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf547ed1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096822:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547ec3 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f63 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096842:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:1.0:1788986109.096844:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986109.096848:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf547ec3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f63 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986109.096858:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788986109.096914:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42679:x1875885971227520:12345-192.168.206.21@tcp:101:touch.0 Request processed in 473us (618us total) trans 0 rc 301/301 00000100:00100000:1.0:1788986109.096921:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 604 00000100:00100000:3.0:1788986109.101985:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986109.102778:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971227648 00000100:00100000:3.0:1788986109.102909:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971227648 00000100:00100000:3.0:1788986109.103628:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 605 00000100:00100000:3.0:1788986109.103651:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42679:x1875885971227648:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:3.0:1788986109.103682:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986109.103710:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547ed8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f6a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103820:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547edf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103838:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103855:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103878:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547ee6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103886:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103893:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103919:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547edf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103928:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547edf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103935:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103943:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986109.103949:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547edf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103957:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547edf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103971:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986109.103975:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986109.103980:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547edf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.103988:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf547edf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.104004:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547ee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.104010:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547ee6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.104017:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.104023:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986109.104027:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547ee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.104034:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547ee6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.104043:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a55745100) 00010000:00010000:3.0:1788986109.104046:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986109.104049:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547ee6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.104056:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf547ee6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.104142:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547ed8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f6a expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.104154:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986109.104158:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986109.104164:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf547ed8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f6a expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.104184:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2800, rc 0) 00000100:00100000:3.0:1788986109.104567:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42679:x1875885971227648:12345-192.168.206.21@tcp:101:touch.0 Request processed in 924us (2593us total) trans 0 rc 301/301 00000100:00100000:3.0:1788986109.104577:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 605 00000100:00100000:2.0:1788986109.114411:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986109.114761:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971227776 00000100:00100000:3.0:1788986109.114783:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971227776 00000100:00100000:3.0:1788986109.114864:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 606 00000100:00100000:3.0:1788986109.114879:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42679:x1875885971227776:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:3.0:1788986109.114906:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986109.114935:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547eed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f71 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.115039:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547ef4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.115060:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.115076:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117031:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547efb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117151:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117168:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117362:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547ef4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117371:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547ef4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117380:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547ef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117387:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986109.117392:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547ef4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117400:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547ef4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117416:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986109.117419:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986109.117425:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547ef4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117432:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf547ef4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117454:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547efb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117460:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547efb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117466:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117472:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986109.117476:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547efb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117481:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547efb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117488:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a55745700) 00010000:00010000:3.0:1788986109.117558:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986109.117563:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547efb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117569:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547efb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117630:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547eed lrc: 1/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f71 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117643:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986109.117645:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986109.117649:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547eed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f71 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986109.117659:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986109.117760:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42679:x1875885971227776:12345-192.168.206.21@tcp:101:touch.0 Request processed in 2883us (3362us total) trans 0 rc 301/301 00000100:00100000:3.0:1788986109.117784:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 606 00010000:00010000:0.0:1788986109.889241:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986109.954752:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993452544:0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.954853:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986109.955000:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788986109.955009:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993452160:0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.955044:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986109.955072:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993452672:0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.955121:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986109.955151:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993452288:0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.955177:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986109.955198:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993452800:0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.955219:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986109.956016:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986109.956028:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993452416:0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.956068:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986109.956161:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993452544 00000100:00100000:3.0:1788986109.956172:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993452544 00000100:00100000:1.0:1788986109.956350:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993452672 00000100:00100000:1.0:1788986109.956355:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993452672 00000100:00100000:1.0:1788986109.956408:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993452288 00000100:00100000:1.0:1788986109.956411:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993452288 00000100:00100000:1.0:1788986109.956430:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993452416 00000100:00100000:1.0:1788986109.956432:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993452416 00000100:00100000:1.0:1788986109.956450:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1788986109.956462:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993452672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986109.956542:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993452672:12345-0@lo:400:kworker.0 Request processed in 83us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986109.956549:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1788986109.956573:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1788986109.956579:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993452288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986109.956613:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993452288:12345-0@lo:400:kworker.0 Request processed in 35us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986109.956618:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1788986109.956631:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1788986109.956638:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993452416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986109.956666:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993452416:12345-0@lo:400:kworker.0 Request processed in 29us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986109.956671:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:3.0:1788986109.956726:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993452800 00000100:00100000:3.0:1788986109.956731:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993452800 00000100:00100000:3.0:1788986109.956777:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:3.0:1788986109.956786:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993452544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.956822:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993452544:12345-0@lo:400:kworker.0 Request processed in 38us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986109.956829:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00100000:3.0:1788986109.956845:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:3.0:1788986109.956851:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993452800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.956881:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993452800:12345-0@lo:400:kworker.0 Request processed in 30us (1661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986109.956889:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:3.0:1788986109.958324:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993452160 00000100:00100000:3.0:1788986109.958335:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993452160 00000100:00100000:3.0:1788986109.958382:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1788986109.958390:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993452160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.958457:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993452160:12345-0@lo:400:kworker.0 Request processed in 69us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986109.958464:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00080000:3.0:1788986109.958519:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986109.958526:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986109.958575:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993452416:0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.958590:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993452288:0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.958603:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993452800:0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.958649:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993452160:0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.958670:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993452672:0@lo:400:kworker.0 00000100:00100000:3.0:1788986109.958682:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993452544:0@lo:400:kworker.0 00000100:00100000:0.0:1788986110.464378:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993452928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986110.464441:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986110.464565:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993452928 00000100:00100000:2.0:1788986110.464573:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993452928 00000100:00100000:2.0:1788986110.464621:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1788986110.464629:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993452928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986110.464658:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986110.464704:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993452928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986110.464710:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1788986110.464872:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993452928:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986110.926061:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986110.960440:0:73677:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffeddd5620 20000000:00000080:3.0:1788986110.960456:0:73677:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0943182400 uarg=0000000000000000 00010000:00010000:3.0:1788986110.960923:0:73677:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788986110.960952:0:73677:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986110.960956:0:73677:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986110.960966:0:73677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547ebc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f5c expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986110.960987:0:73677:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1788986110.960999:0:73677:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986110.961012:0:73677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986110.961024:0:73677:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547ea0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547e99 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986110.961032:0:73677:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986110.961063:0:73677:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547ea0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547e99 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986110.961075:0:73677:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547ea0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547e99 expref: 18 pid: 5849 timeout: 1994 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986110.961241:0:73677:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73677:1875885993453056:0@lo:104: 00000100:00100000:3.0:1788986110.961294:0:73677:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986110.961420:0:73677:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812540 going to sleep for 11 seconds 00000100:00100000:2.0:1788986110.961462:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993453056 00000100:00100000:2.0:1788986110.961468:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993453056 00000100:00100000:2.0:1788986110.961547:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:2.0:1788986110.961556:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:73677:x1875885993453056:12345-0@lo:104: 00010000:00010000:2.0:1788986110.961567:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547ea0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986110.961624:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986110.961629:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:73677:x1875885993453056:12345-0@lo:104: Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986110.961635:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00010000:00010000:1.0:1788986110.961675:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986110.961681:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547ea0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961688:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986110.961693:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547ea0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961706:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547ea0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986110.961713:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547ea0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986110.961719:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986110.961744:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547ea0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961751:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986110.961779:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547ea0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961786:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf547e99 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547ea0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961798:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986110.961800:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986110.961801:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986110.961811:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993453184:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986110.961837:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986110.961865:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993453184 00000100:00100000:1.0:1788986110.961868:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993453184 00010000:00010000:1.0:1788986110.961884:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547ea0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547e99 expref: 19 pid: 5849 timeout: 1994 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986110.961901:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788986110.961907:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993453184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986110.961917:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986110.961922:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547ea0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547e99 expref: 19 pid: 5849 timeout: 1994 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961931:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547ea0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547e99 expref: 19 pid: 5849 timeout: 1994 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961944:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961952:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961965:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961972:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961978:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961985:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.961990:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986110.961994:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.962001:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.962014:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986110.962022:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986110.962043:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993453184:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986110.962049:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:1.0:1788986110.962077:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993453184:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986110.962168:0:73677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547ea0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547e99 expref: 18 pid: 5849 timeout: 1994 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986110.962178:0:73677:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73677:1875885993453056:0@lo:104: 00010000:00010000:3.0:1788986110.962189:0:73677:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986110.962197:0:73677:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986110.962204:0:73677:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986110.962211:0:73677:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547f02 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986111.957565:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986112.115500:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986112.115549:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986112.115585:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986112.115614:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971228160 00000100:00100000:3.0:1788986112.115623:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971228160 00000100:00100000:3.0:1788986112.115676:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 928 00000100:00100000:3.0:1788986112.115685:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971228160:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986112.115759:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971228160:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986112.115767:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 928 00000100:00080000:3.0:1788986112.115788:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986112.115827:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971227904 00000100:00100000:0.0:1788986112.115831:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971227904 00000100:00100000:0.0:1788986112.115873:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1098 00000100:00100000:0.0:1788986112.115881:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971227904:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986112.115913:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971227904:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986112.115919:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1098 00000100:00100000:1.0:1788986112.116076:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971228032 00000100:00100000:1.0:1788986112.116081:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971228032 00000100:00100000:1.0:1788986112.116152:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1320 00000100:00100000:1.0:1788986112.116160:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971228032:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986112.116192:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971228032:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986112.116198:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1320 00000100:00080000:0.0:1788986112.116360:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1788986112.448362:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986112.448372:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986112.448379:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986112.448447:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986112.448461:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986112.448473:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986112.448507:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993453312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986112.448597:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986112.448698:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09427c4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788986112.449765:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993453312 00000100:00100000:3.0:1788986112.449778:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993453312 00000100:00100000:3.0:1788986112.449854:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1788986112.449866:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993453312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986112.449886:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986112.449909:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547f10 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547f09 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986112.449940:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547f10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547f09 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986112.449956:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547f10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547f09 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986112.449965:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788986112.450063:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993453312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986112.450070:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1788986112.450350:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe41f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993453312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986112.450372:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547f10 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986112.450383:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547f10 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986112.450408:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986112.450414:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547f10 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986112.450426:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547f10 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986112.965042:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986113.917082:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986113.917224:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971228288 00000100:00100000:3.0:1788986113.917233:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971228288 00000100:00100000:3.0:1788986113.917289:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 607 00000100:00100000:3.0:1788986113.917299:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42766:x1875885971228288:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986113.917319:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986113.917340:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547f17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f78 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986113.917400:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547f1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986113.917413:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986113.917426:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986113.917460:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:3.0:1788986113.917464:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986113.917481:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547f1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986113.917505:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf547f17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f78 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986113.917524:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547f1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f78 expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986113.917532:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:3.0:1788986113.917535:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986113.917539:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986113.917592:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42766:x1875885971228288:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 294us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986113.917598:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 607 00000100:00100000:0.0:1788986113.922401:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986113.922455:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971228544 00000100:00100000:3.0:1788986113.922465:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971228544 00000100:00100000:3.0:1788986113.922521:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 608 00000100:00100000:3.0:1788986113.922531:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42766:x1875885971228544:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986113.922577:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986113.922601:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf547f1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f78 expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986113.922630:0:5855:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf547ebc) 00010000:00010000:3.0:1788986113.922634:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:3.0:1788986113.922645:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986113.922668:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547f25 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986113.922681:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547f25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986113.922691:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547f25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986113.923058:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000975703a reply state 00000000b120f5bd transno 4294967526 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547f25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986113.923068:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986113.923077:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000100:00100000:2.0:1788986113.923237:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42766:x1875885971228544:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 706us (843us total) trans 4294967526 rc 0/0 00000100:00100000:2.0:1788986113.923245:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 608 00010000:00010000:2.0:1788986113.924796:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547f25 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986113.924809:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547f25 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986113.924823:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547f25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986113.924829:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986113.924834:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547f25 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986113.924842:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547f25 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986113.924855:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:2.0:1788986113.924858:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986113.924862:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547f25 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986113.924877:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf547f25 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986113.984369:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986114.050219:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986114.050239:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993453440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986114.050300:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986114.050368:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993453440 00000100:00100000:1.0:1788986114.050376:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993453440 00000100:00100000:1.0:1788986114.050432:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:1.0:1788986114.050441:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993453440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986114.050473:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986114.050517:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993453440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986114.050524:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00080000:1.0:1788986114.050544:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986114.050581:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993453440:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788986114.699712:0:73874:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb5c96c80 20000000:00000080:1.0:1788986114.699730:0:73874:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a8096d000 uarg=0000000000000000 00010000:00010000:1.0:1788986114.699946:0:73874:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788986114.699962:0:73874:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788986114.699975:0:73874:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986114.699992:0:73874:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986114.700008:0:73874:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547f10 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547f09 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986114.700021:0:73874:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986114.700056:0:73874:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547f10 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547f09 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986114.700070:0:73874:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547f10 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547f09 expref: 18 pid: 5848 timeout: 1998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986114.700083:0:73874:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73874:1875885993453568:0@lo:104: 00000100:00100000:1.0:1788986114.700252:0:73874:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986114.700337:0:73874:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09426a6840 going to sleep for 11 seconds 00000100:00100000:0.0:1788986114.700420:0:7642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788986114.700433:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993453568 00000100:00100000:0.0:1788986114.700438:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993453568 00000100:00100000:0.0:1788986114.700525:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788986114.700535:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f9e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:73874:x1875885993453568:12345-0@lo:104: 00010000:00010000:0.0:1788986114.700547:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547f10 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986114.700613:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986114.700619:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f9e2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:73874:x1875885993453568:12345-0@lo:104: Request processed in 87us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986114.700626:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00010000:00010000:3.0:1788986114.700692:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986114.700699:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547f10 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.700706:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986114.700710:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547f10 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.700718:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547f10 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986114.700725:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547f10 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986114.700731:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986114.700772:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547f10 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.700778:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986114.700797:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547f10 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.700809:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf547f09 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547f10 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.700824:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986114.700826:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986114.700827:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986114.700845:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993453696:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986114.700875:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986114.700910:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993453696 00000100:00100000:3.0:1788986114.700915:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993453696 00010000:00010000:3.0:1788986114.700933:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547f10 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547f09 expref: 19 pid: 5848 timeout: 1998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986114.700956:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788986114.700962:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993453696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986114.700972:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986114.700977:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547f10 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547f09 expref: 19 pid: 5848 timeout: 1998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.700986:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547f10 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547f09 expref: 19 pid: 5848 timeout: 1998 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.700999:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.701007:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.701022:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.701029:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.701035:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.701041:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.701046:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986114.701050:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.701058:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.701067:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986114.701076:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986114.701130:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993453696:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986114.701136:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788986114.701170:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993453696:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986114.701259:0:73874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf547f10 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547f09 expref: 18 pid: 5848 timeout: 1998 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986114.701270:0:73874:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:73874:1875885993453568:0@lo:104: 00010000:00010000:1.0:1788986114.701282:0:73874:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986114.701291:0:73874:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986114.701296:0:73874:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986114.701302:0:73874:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf547f2c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 73874 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986115.021676:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986115.083486:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993454208:0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.083550:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986115.083598:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788986115.083605:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993453824:0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.083628:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986115.083644:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993454336:0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.083664:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986115.083685:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993454080:0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.083704:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986115.083719:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986115.083724:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993453952:0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.083759:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986115.083796:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993454208 00000100:00100000:0.0:1788986115.083802:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993454208 00000100:00100000:0.0:1788986115.083843:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993453824 00000100:00100000:0.0:1788986115.083845:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993453824 00000100:00100000:0.0:1788986115.083859:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993453952 00000100:00100000:0.0:1788986115.083861:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993453952 00000100:00100000:0.0:1788986115.083878:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1788986115.083884:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993454208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.083929:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993454208:12345-0@lo:400:kworker.0 Request processed in 44us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986115.083936:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:0.0:1788986115.083951:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1788986115.083957:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993453824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.083985:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993453824:12345-0@lo:400:kworker.0 Request processed in 28us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986115.083990:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1322 00000100:00100000:0.0:1788986115.084002:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1788986115.084008:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993453952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.084036:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993453952:12345-0@lo:400:kworker.0 Request processed in 29us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986115.084041:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00000100:00100000:0.0:1788986115.084059:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993454336 00000100:00100000:0.0:1788986115.084063:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993454336 00000100:00100000:0.0:1788986115.084085:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993454080 00000100:00080000:1.0:1788986115.084859:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986115.084865:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986115.090322:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993454080 00000100:00100000:0.0:1788986115.090400:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1788986115.090410:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993454336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.090493:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993454336:12345-0@lo:400:kworker.0 Request processed in 84us (6827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986115.090500:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:0.0:1788986115.090518:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:0.0:1788986115.090525:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993454080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.090553:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993454080:12345-0@lo:400:kworker.0 Request processed in 29us (6848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986115.090558:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:0.0:1788986115.090607:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993453824:0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.090618:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993454336:0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.090628:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993454208:0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.090665:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993453952:0@lo:400:kworker.0 00000100:00100000:0.0:1788986115.090674:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993454080:0@lo:400:kworker.0 00000001:00080000:3.0:1788986115.145362:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000100:00100000:3.0:1788986115.585218:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986115.585240:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993454464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986115.585304:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986115.585364:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993454464 00000100:00100000:3.0:1788986115.585371:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993454464 00000100:00100000:3.0:1788986115.585412:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1788986115.585420:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993454464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986115.585450:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986115.585495:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993454464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986115.585502:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 669 00000100:00100000:3.0:1788986115.585547:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993454464:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986116.032231:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788986116.288310:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986116.288317:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986116.288322:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986116.288380:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986116.288392:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986116.288403:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986116.288427:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993454592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986116.288490:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986116.288561:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c6b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986116.289001:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993454592 00000100:00100000:2.0:1788986116.289010:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993454592 00000100:00100000:2.0:1788986116.289068:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1788986116.289077:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993454592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986116.289373:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986116.289398:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547f3a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547f33 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986116.289423:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547f3a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547f33 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986116.289433:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547f3a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547f33 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986116.289443:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788986116.289506:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993454592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 429us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986116.289512:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:1.0:1788986116.289778:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993454592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986116.289795:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547f3a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986116.289804:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547f3a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986116.289835:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986116.289841:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547f3a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986116.289848:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547f3a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.057363:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986117.240128:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986117.240183:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986117.240197:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971228800 00000100:00100000:1.0:1788986117.240210:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971228800 00000100:00100000:0.0:1788986117.240214:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986117.240241:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971228672 00000100:00100000:0.0:1788986117.240246:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971228672 00000100:00100000:1.0:1788986117.240285:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1324 00000100:00100000:0.0:1788986117.240285:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1101 00000100:00100000:1.0:1788986117.240295:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971228800:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986117.240295:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971228672:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986117.240376:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971228672:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 82us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986117.240384:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1101 00000100:00100000:0.0:1788986117.240425:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971228928 00000100:00100000:0.0:1788986117.240429:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971228928 00000100:00100000:0.0:1788986117.240462:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 931 00000100:00100000:0.0:1788986117.240469:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971228928:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986117.241653:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971228800:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1349us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986117.241667:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1324 00000100:00080000:1.0:1788986117.241707:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986117.241714:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986117.241908:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971228928:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1437us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986117.241920:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 931 00000100:00100000:0.0:1788986117.810968:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986117.811123:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971229056 00000100:00100000:2.0:1788986117.811136:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971229056 00000100:00100000:2.0:1788986117.811280:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 609 00000100:00100000:2.0:1788986117.811326:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42850:x1875885971229056:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986117.811526:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42850:x1875885971229056:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 235us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986117.811534:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 609 00000100:00100000:0.0:1788986117.822170:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986117.822227:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971229184 00000100:00100000:0.0:1788986117.822240:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971229184 00000100:00100000:0.0:1788986117.822426:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 322 00000100:00100000:0.0:1788986117.822440:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42850:x1875885971229184:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986117.822994:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42850:x1875885971229184:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 554us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986117.823002:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 322 00000100:00100000:1.0:1788986117.847370:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986117.847429:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971229312 00000100:00100000:1.0:1788986117.847440:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971229312 00000100:00100000:1.0:1788986117.847486:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 323 00000100:00100000:1.0:1788986117.847495:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875885971229312:12345-192.168.206.21@tcp:8:lfs.0 00010000:00080000:1.0:1788986117.847534:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 1901 last 0 00000020:00000080:1.0:1788986117.847568:0:6697:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf547f41 00002000:00100000:1.0:1788986117.847581:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b0a489ed800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788986117.847610:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788986117.848001:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788986117.848037:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b0a489e8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788986117.848133:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971229312:12345-192.168.206.21@tcp:8:lfs.0 Request processed in 637us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986117.848142:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 323 00000100:00100000:0.0:1788986117.861585:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986117.861766:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971229440 00000100:00100000:2.0:1788986117.861778:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971229440 00000100:00100000:2.0:1788986117.861915:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 324 00000100:00100000:2.0:1788986117.861930:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42850:x1875885971229440:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986117.862448:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42850:x1875885971229440:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 522us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986117.862457:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 324 00000100:00080000:1.0:1788986117.863762:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986117.869195:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986117.869300:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971229568 00000100:00100000:2.0:1788986117.869313:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971229568 00000100:00100000:2.0:1788986117.869407:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 610 00000100:00100000:2.0:1788986117.869419:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42850:x1875885971229568:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986117.870307:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42850:x1875885971229568:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 885us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986117.870321:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 610 00000100:00100000:3.0:1788986117.876820:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986117.876894:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971229696 00000100:00100000:1.0:1788986117.876911:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971229696 00000100:00100000:1.0:1788986117.876987:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 611 00000100:00100000:1.0:1788986117.876999:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42850:x1875885971229696:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986117.877170:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42850:x1875885971229696:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 172us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986117.877178:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 611 00000100:00100000:0.0:1788986117.880382:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986117.880466:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971229824 00000100:00100000:1.0:1788986117.880479:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971229824 00000100:00100000:1.0:1788986117.880553:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 325 00000100:00100000:1.0:1788986117.880566:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42850:x1875885971229824:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986117.881548:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42850:x1875885971229824:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 980us (1176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986117.881558:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 325 00000100:00100000:0.0:1788986117.886663:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986117.886809:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971229952 00000100:00100000:3.0:1788986117.886822:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971229952 00000100:00100000:3.0:1788986117.886895:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 326 00000100:00100000:3.0:1788986117.886908:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42850:x1875885971229952:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986117.887430:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42850:x1875885971229952:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 523us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986117.887439:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 326 00000100:00100000:3.0:1788986117.891690:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986117.891804:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971230080 00000100:00100000:0.0:1788986117.891822:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971230080 00000100:00100000:0.0:1788986117.891924:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 612 00000100:00100000:0.0:1788986117.891937:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42850:x1875885971230080:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986117.892571:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42850:x1875885971230080:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 634us (887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986117.892580:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 612 00000100:00100000:0.0:1788986117.981225:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986117.982831:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971230208 00000100:00100000:2.0:1788986117.982848:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971230208 00000100:00100000:2.0:1788986117.982938:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 613 00000100:00100000:2.0:1788986117.982948:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:42854:x1875885971230208:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788986117.982972:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986117.983000:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547f48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f7f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983077:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547f4f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983143:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547f4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983159:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547f4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983173:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547f56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983180:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547f56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983186:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547f56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983556:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547f5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983570:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983578:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986117.983601:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:2.0:1788986117.983604:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986117.983625:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547f5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983638:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547f4f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983645:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547f4f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983733:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547f4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983740:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986117.983745:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547f4f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983754:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547f4f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983767:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986117.983770:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986117.983775:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547f4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983786:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf547f4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983800:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547f56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983805:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547f56 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983811:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547f56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983817:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986117.983819:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547f56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983825:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547f56 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983831:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986117.983833:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986117.983835:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547f56 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983840:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf547f56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983869:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf547f48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f7f expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983884:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547f5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f7f expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986117.983893:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:2.0:1788986117.983895:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986117.983897:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986117.983982:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42854:x1875885971230208:12345-192.168.206.21@tcp:101:dd.0 Request processed in 1035us (2773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986117.983990:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 613 00000100:00100000:2.0:1788986117.988731:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986117.988838:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971230464 00000100:00100000:0.0:1788986117.988851:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971230464 00000100:00100000:0.0:1788986117.988988:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 614 00000100:00100000:0.0:1788986117.989001:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42854:x1875885971230464:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1788986117.989027:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986117.989052:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547f64 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f86 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.989426:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547f6b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.989444:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547f6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.989469:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547f6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.989486:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547f72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.989494:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.989501:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986117.991450:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x13:0x0], index 1: 0 00010000:00010000:0.0:1788986117.992373:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547f79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.992395:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.992408:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547f79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.992470:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547f6b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.992484:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547f6b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.992491:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547f6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.992497:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986117.992502:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547f6b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.992512:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547f6b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.992527:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:0.0:1788986117.992530:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986117.992536:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547f6b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.992542:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf547f6b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986117.992557:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009ffa0224 reply state 00000000441aa95e transno 4294967527 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986117.992567:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788986117.992611:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf547f64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f86 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.992628:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547f79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f86 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.992641:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:0.0:1788986117.992644:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986117.992646:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788986117.993307:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:42854:x1875885971230464:12345-192.168.206.21@tcp:101:dd.0 Request processed in 4306us (4661us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1788986117.993318:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 614 00010000:00010000:0.0:1788986117.997033:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547f72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.997057:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547f72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.997066:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547f72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.997074:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986117.997080:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547f72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.997122:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547f72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.997143:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a4823b400) 00010000:00010000:0.0:1788986117.997146:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986117.997153:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547f72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986117.997159:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf547f72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986118.015025:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986118.015523:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971230592 00000100:00100000:1.0:1788986118.015536:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971230592 00000100:00100000:1.0:1788986118.015766:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 327 00000100:00100000:1.0:1788986118.015779:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:42854:x1875885971230592:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:1.0:1788986118.015802:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986118.015828:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000001199380/0xc20d828fcf547f87 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f8d expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788986118.015861:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788986118.015890:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=1901s v=(0 0) 00010000:00010000:1.0:1788986118.015896:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986118.015908:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000001199380/0xc20d828fcf547f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f8d expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986118.015929:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000001199380/0xc20d828fcf547f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f8d expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986118.015943:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986118.016026:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42854:x1875885971230592:12345-192.168.206.21@tcp:101:dd.0 Request processed in 250us (1051us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986118.016034:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 327 00000100:00100000:3.0:1788986118.046928:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986118.048045:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971230720 00000100:00100000:0.0:1788986118.048064:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971230720 00002000:00100000:0.0:1788986118.048462:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff9b0a80ca0000 x1875885971230720/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:39/0 lens 488/0 e 0 to 0 dl 1788986129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788986118.048478:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a80ca0000 with x1875885971230720 ext(0->1048575) 00002000:00010000:0.0:1788986118.048486:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a80ca0000 00000100:00100000:0.0:1788986118.048536:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:0.0:1788986118.048550:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971230720:12345-192.168.206.21@tcp:4:dd.0 00010000:00010000:3.0:1788986118.080565:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788986118.134842:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:2.0:1788986118.140229:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971230720:12345-192.168.206.21@tcp:4:dd.0 Request processed in 91667us (93301us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788986118.140246:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00002000:00100000:2.0:1788986118.140263:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x13:0x0] (0->1048575) req@ffff9b0a80ca0000 x1875885971230720/t4294967334(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:39/0 lens 488/448 e 0 to 0 dl 1788986129 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788986118.140274:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a80ca0000 with x1875885971230720 ext(0->1048575) 00002000:00010000:2.0:1788986118.140282:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a80ca0000 00000100:00100000:2.0:1788986118.144058:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986118.144189:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971230848 00000100:00100000:1.0:1788986118.144203:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971230848 00000100:00100000:1.0:1788986118.144308:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 615 00000100:00100000:1.0:1788986118.144320:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42854:x1875885971230848:12345-192.168.206.21@tcp:44:dd.0 00000100:00100000:1.0:1788986118.174276:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42854:x1875885971230848:12345-192.168.206.21@tcp:44:dd.0 Request processed in 29943us (30292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986118.174293:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 615 00000001:00080000:3.0:1788986118.175273:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000100:00100000:2.0:1788986118.176802:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986118.176898:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971230976 00000100:00100000:3.0:1788986118.176910:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971230976 00000100:00100000:3.0:1788986118.176982:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 328 00000100:00100000:3.0:1788986118.176993:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971230976:12345-192.168.206.21@tcp:16:dd.0 00000001:00080000:0.0:1788986118.211030:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967334 is committed 00000100:00100000:3.0:1788986118.211308:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971230976:12345-192.168.206.21@tcp:16:dd.0 Request processed in 34309us (34510us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986118.211321:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 328 00000100:00100000:0.0:1788986118.214023:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986118.214305:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971231232 00000100:00100000:3.0:1788986118.214318:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971231232 00000100:00100000:3.0:1788986118.214385:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 63 00000100:00100000:3.0:1788986118.214399:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:42854:x1875885971231232:12345-192.168.206.21@tcp:35:dd.0 00000100:00100000:3.0:1788986118.215071:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:42854:x1875885971231232:12345-192.168.206.21@tcp:35:dd.0 Request processed in 672us (1056us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1788986118.215080:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 63 00010000:00010000:1.0:1788986119.107924:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986119.169558:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993454720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986119.169664:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986119.170307:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993454720 00000100:00100000:1.0:1788986119.170318:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993454720 00000100:00080000:0.0:1788986119.170384:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986119.170406:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1788986119.170417:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993454720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986119.170552:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986119.171116:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993454720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 670us (1421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986119.171126:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 670 00000100:00100000:1.0:1788986119.171751:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993454720:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788986119.283319:0:73899:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00010000:00010000:3.0:1788986120.129404:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986120.195880:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993455232:0@lo:400:kworker.0 00000100:00100000:1.0:1788986120.195950:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986120.196074:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993454976:0@lo:400:kworker.0 00000100:00100000:2.0:1788986120.196127:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986120.196160:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993455488:0@lo:400:kworker.0 00000100:00100000:3.0:1788986120.196184:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993455104:0@lo:400:kworker.0 00000100:00100000:2.0:1788986120.196187:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986120.196217:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788986120.196224:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993454848:0@lo:400:kworker.0 00000100:00100000:3.0:1788986120.196232:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986120.196262:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986120.196286:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993455360:0@lo:400:kworker.0 00000100:00100000:2.0:1788986120.196327:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986120.196357:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993454848 00000100:00100000:2.0:1788986120.196364:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993454848 00000100:00100000:2.0:1788986120.196403:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1788986120.196410:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993454848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986120.196464:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993454848:12345-0@lo:400:kworker.0 Request processed in 54us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986120.196471:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1788986120.196515:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993454848:0@lo:400:kworker.0 00000100:00100000:0.0:1788986120.196603:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993454976 00000100:00100000:0.0:1788986120.196608:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993454976 00000100:00100000:0.0:1788986120.196641:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1788986120.196648:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993454976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986120.196688:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993454976:12345-0@lo:400:kworker.0 Request processed in 41us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986120.196695:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:0.0:1788986120.196718:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993455104 00000100:00100000:0.0:1788986120.196721:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993455104 00000100:00100000:0.0:1788986120.196748:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993455360 00000100:00100000:0.0:1788986120.196751:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993455360 00000100:00100000:0.0:1788986120.196767:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1788986120.196773:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993455104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986120.196806:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993455104:12345-0@lo:400:kworker.0 Request processed in 33us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986120.196812:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:0.0:1788986120.196824:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1788986120.196830:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993455360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986120.196856:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993455360:12345-0@lo:400:kworker.0 Request processed in 26us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986120.196861:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1788986120.196880:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993455232 00000100:00100000:0.0:1788986120.196884:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993455232 00000100:00100000:0.0:1788986120.196907:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993455488 00000100:00100000:0.0:1788986120.196911:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993455488 00000100:00100000:0.0:1788986120.196933:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:0.0:1788986120.196938:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993455232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986120.196966:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993455232:12345-0@lo:400:kworker.0 Request processed in 28us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986120.196972:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00100000:0.0:1788986120.196983:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:0.0:1788986120.196988:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993455488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986120.197033:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993455488:12345-0@lo:400:kworker.0 Request processed in 45us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986120.197039:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00080000:0.0:1788986120.197055:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986120.197059:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986120.197079:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993455104:0@lo:400:kworker.0 00000100:00100000:0.0:1788986120.197138:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993455360:0@lo:400:kworker.0 00000100:00100000:0.0:1788986120.197149:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993454976:0@lo:400:kworker.0 00000100:00100000:0.0:1788986120.197158:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993455488:0@lo:400:kworker.0 00000100:00100000:1.0:1788986120.197309:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993455232:0@lo:400:kworker.0 00000004:00080000:2.0:1788986120.465675:0:74124:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1904368582668ns, next at 1885117273563ns, rc = 0 00000004:00080000:2.0:1788986120.465796:0:74124:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1904368705748ns, next at 1845089800307ns, rc = 0 00000004:00080000:3.0:1788986120.470071:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 50 committed 00000004:00080000:3.0:1788986120.470116:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 50 committed 00000100:00100000:3.0:1788986120.704348:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986120.704369:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993455616:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986120.704433:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986120.704489:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993455616 00000100:00100000:3.0:1788986120.704497:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993455616 00000100:00100000:3.0:1788986120.704538:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1788986120.704547:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993455616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986120.704578:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788986120.704625:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993455616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986120.704632:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 671 00000100:00100000:3.0:1788986120.704680:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993455616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986121.152746:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986121.772220:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986121.772289:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971231360 00000100:00100000:0.0:1788986121.772300:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971231360 00000100:00100000:0.0:1788986121.772369:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 616 00000100:00100000:0.0:1788986121.772379:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43047:x1875885971231360:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986121.772573:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43047:x1875885971231360:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 194us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986121.772581:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 616 00000100:00080000:1.0:1788986121.772877:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986121.775283:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986121.775564:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971231488 00000100:00100000:0.0:1788986121.775574:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971231488 00000100:00100000:0.0:1788986121.775652:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 329 00000100:00100000:0.0:1788986121.775663:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43047:x1875885971231488:12345-192.168.206.21@tcp:19:lfs.0 00000100:00080000:1.0:1788986121.776189:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986121.776366:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43047:x1875885971231488:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 703us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986121.776375:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 329 00000100:00100000:1.0:1788986121.785747:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986121.786133:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971231616 00000100:00100000:3.0:1788986121.786141:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971231616 00000100:00100000:3.0:1788986121.786210:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 330 00000100:00100000:3.0:1788986121.786222:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43047:x1875885971231616:12345-192.168.206.21@tcp:19:lfs.0 00000100:00080000:1.0:1788986121.786412:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986121.786555:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43047:x1875885971231616:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 334us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986121.786563:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 330 00000100:00100000:1.0:1788986121.793933:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986121.794035:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971231744 00000100:00100000:2.0:1788986121.794046:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971231744 00000100:00100000:2.0:1788986121.794136:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 617 00000100:00100000:2.0:1788986121.794147:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43047:x1875885971231744:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986121.794608:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43047:x1875885971231744:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 463us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986121.794616:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 617 00000100:00100000:2.0:1788986121.800206:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986121.801483:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971231872 00000100:00100000:3.0:1788986121.801496:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971231872 00000100:00100000:3.0:1788986121.801560:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 618 00000100:00100000:3.0:1788986121.801581:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43047:x1875885971231872:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986121.801681:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43047:x1875885971231872:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 103us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986121.801689:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 618 00000100:00100000:1.0:1788986121.811042:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986121.811138:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971232000 00000100:00100000:3.0:1788986121.811146:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971232000 00000100:00100000:3.0:1788986121.811209:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 331 00000100:00100000:3.0:1788986121.811219:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43047:x1875885971232000:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986121.813791:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43047:x1875885971232000:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 2563us (2747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986121.813805:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 331 00000100:00100000:3.0:1788986121.819244:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986121.819631:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971232128 00000100:00100000:2.0:1788986121.819640:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971232128 00000100:00100000:2.0:1788986121.819705:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 332 00000100:00100000:2.0:1788986121.819715:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43047:x1875885971232128:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986121.820073:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43047:x1875885971232128:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 358us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986121.820081:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 332 00000100:00100000:1.0:1788986121.833531:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986121.833690:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971232256 00000100:00100000:3.0:1788986121.833753:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971232256 00000100:00100000:3.0:1788986121.834036:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 619 00000100:00100000:3.0:1788986121.834048:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43047:x1875885971232256:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986121.835479:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43047:x1875885971232256:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 1427us (1949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986121.835489:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 619 00000100:00100000:0.0:1788986121.916926:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986121.917460:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971232512 00000100:00100000:2.0:1788986121.917469:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971232512 00000100:00100000:2.0:1788986121.917525:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 620 00000100:00100000:2.0:1788986121.917534:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43051:x1875885971232512:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:2.0:1788986121.917581:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986121.917606:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf547f79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f86 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.917623:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:2.0:1788986121.917634:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986121.917655:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547f8e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.917667:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547f8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.917676:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547f8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.917689:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf547f95 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.917709:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf547f95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.917720:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf547f95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.918021:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547f9c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.918030:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547f9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.918037:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547f9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x33:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986121.918985:0:15241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].19, 64 off9408 00000004:00080000:2.0:1788986121.918996:0:15241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1905821906406ns, next at 1906821904053ns, rc = 0 00010000:00010000:2.0:1788986121.919118:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547fa3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919131:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919139:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547fa3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919147:0:15241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547fa3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919153:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547fa3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919159:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547fa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919188:0:15241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986121.919208:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547f9c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919215:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547f9c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919221:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547f9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919227:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986121.919231:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547f9c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919238:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547f9c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919248:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986121.919252:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986121.919256:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547f9c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x33:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.919257:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986121.919269:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547fa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919269:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf547f9c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x33:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919294:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547f8e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.919296:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986121.919304:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547fa3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919305:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547f8e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.919321:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547fa3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919327:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547f8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919336:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986121.919338:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x33:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986121.919340:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547f8e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.919343:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986121.919348:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547fa3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919351:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547f8e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.919361:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf547fa3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x33:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919366:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:2.0:1788986121.919371:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986121.919374:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547f8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986121.919380:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf547f8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.919390:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:2.0:1788986121.919392:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d23bfe44 reply state 00000000c332d6c0 transno 4294967529 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf547f95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.919394:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986121.919397:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986121.919403:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986121.919484:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:43051:x1875885971232512:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1948us (2566us total) trans 4294967529 rc 0/0 00000100:00100000:2.0:1788986121.919492:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 620 00010000:00010000:3.0:1788986121.921970:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf547f95 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.921987:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf547f95 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.921995:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf547f95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.922000:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986121.922005:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf547f95 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.922012:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf547f95 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.922025:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a45acae00) 00010000:00010000:3.0:1788986121.922029:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986121.922033:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf547f95 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986121.922039:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf547f95 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986122.176352:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986122.357219:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986122.357290:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971232640 00000100:00100000:2.0:1788986122.357300:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971232640 00000100:00100000:2.0:1788986122.357356:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1103 00000100:00100000:2.0:1788986122.357365:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971232640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986122.357441:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971232640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 76us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986122.357448:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1103 00010000:00010000:3.0:1788986123.207303:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788986124.106347:0:74268:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1908009254417ns, next at 1885117273563ns, rc = 0 00000004:00080000:0.0:1788986124.106453:0:74268:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1908009363240ns, next at 1906821904053ns, rc = 0 00000004:00080000:0.0:1788986124.135854:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 52 committed 00000004:00080000:0.0:1788986124.135878:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 51 committed 00000001:00080000:0.0:1788986124.135893:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967529 is committed 00000004:00080000:0.0:1788986124.135898:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 51 committed 00000100:00100000:0.0:1788986124.136287:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986124.136305:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993455744:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788986124.136365:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986124.136564:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993455744 00000100:00100000:2.0:1788986124.136571:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993455744 00000100:00100000:2.0:1788986124.136630:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:2.0:1788986124.136639:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993455744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788986124.136663:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:19 count 1 00010000:00010000:2.0:1788986124.136695:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986124.136716:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000001199380/0xc20d828fcf547f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f8d expref: 5 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986124.136725:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x13:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1788986124.136729:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788986124.136734:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 4/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986124.136761:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000001199380/0xc20d828fcf547f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f8d expref: 5 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986124.136774:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000001199380/0xc20d828fcf547f87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f8d expref: 5 pid: 6698 timeout: 2008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986124.136786:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875885993455872:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986124.136842:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7780 going to sleep for 11 seconds 00000100:00080000:0.0:1788986124.137961:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986124.140832:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986124.141008:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971232768 00000100:00100000:1.0:1788986124.141016:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971232768 00010000:00010000:1.0:1788986124.141068:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000001199380/0xc20d828fcf547f87 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f8d expref: 6 pid: 6698 timeout: 2008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986124.141131:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 350 00000100:00100000:1.0:1788986124.141141:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971232768:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986124.141166:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986124.141172:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000001199380/0xc20d828fcf547f87 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f8d expref: 6 pid: 6698 timeout: 2008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986124.141185:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000001199380/0xc20d828fcf547f87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f8d expref: 6 pid: 6698 timeout: 2008 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986124.141208:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986124.141213:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986124.141220:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986124.141231:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986124.141251:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986124.141298:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c13480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971232768:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 158us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986124.141305:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 350 00010000:00010000:2.0:1788986124.141442:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000001199380/0xc20d828fcf547f87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f8d expref: 5 pid: 6698 timeout: 2008 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986124.141459:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875885993455872:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788986124.141478:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986124.141489:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986124.141496:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986124.141506:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986124.141514:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986124.141535:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788986124.142134:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993455744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5495us (5767us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788986124.142143:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000004:00080000:2.0:1788986124.142267:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0942bb1180/2, rc 0, transno 4294967335 00000100:00100000:2.0:1788986124.142278:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993455744:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788986124.142352:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986124.142360:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986124.142370:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986124.142374:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986124.142383:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986124.142399:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986124.142405:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf547faa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986124.142427:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986124.142429:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986124.142430:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788986124.142924:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788986124.224341:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986124.288403:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993456000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986124.288469:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986124.288541:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993456000 00000100:00100000:3.0:1788986124.288548:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993456000 00000100:00100000:3.0:1788986124.288601:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:3.0:1788986124.288610:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993456000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986124.288642:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986124.288700:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993456000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986124.288708:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00000100:00080000:3.0:1788986124.288728:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986124.288763:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993456000:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986125.248195:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986125.313390:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993456128:0@lo:400:kworker.0 00000100:00100000:3.0:1788986125.313450:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986125.313620:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993456512:0@lo:400:kworker.0 00000100:00100000:1.0:1788986125.313652:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986125.313738:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993456128 00000100:00100000:0.0:1788986125.313752:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993456128 00000100:00100000:0.0:1788986125.313796:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:0.0:1788986125.313804:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993456128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986125.314049:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993456256:0@lo:400:kworker.0 00000100:00100000:2.0:1788986125.314079:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986125.314278:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993456768:0@lo:400:kworker.0 00000100:00100000:2.0:1788986125.314301:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986125.314320:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986125.314325:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993456384:0@lo:400:kworker.0 00000100:00100000:2.0:1788986125.314344:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986125.314370:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993456512 00000100:00100000:2.0:1788986125.314373:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993456512 00000100:00100000:2.0:1788986125.314399:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993456768 00000100:00100000:2.0:1788986125.314401:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993456768 00000100:00100000:2.0:1788986125.314418:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:2.0:1788986125.314425:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993456512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986125.314457:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993456512:12345-0@lo:400:kworker.0 Request processed in 32us (803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986125.314463:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00100000:2.0:1788986125.314478:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:2.0:1788986125.314483:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993456768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986125.314512:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993456768:12345-0@lo:400:kworker.0 Request processed in 28us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986125.314517:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:2.0:1788986125.314536:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993456256 00000100:00100000:2.0:1788986125.314539:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993456256 00000100:00100000:2.0:1788986125.314558:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993456384 00000100:00100000:2.0:1788986125.314561:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993456384 00000100:00100000:2.0:1788986125.314585:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1788986125.314591:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993456256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986125.314620:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993456256:12345-0@lo:400:kworker.0 Request processed in 29us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986125.314626:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1788986125.314637:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:2.0:1788986125.314643:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993456384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986125.314665:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993456384:12345-0@lo:400:kworker.0 Request processed in 23us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986125.314671:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:1.0:1788986125.314768:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993456512:0@lo:400:kworker.0 00000100:00100000:1.0:1788986125.314784:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986125.314789:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993456640:0@lo:400:kworker.0 00000100:00100000:1.0:1788986125.314811:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986125.314908:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993456640 00000100:00100000:2.0:1788986125.314912:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993456640 00000100:00100000:2.0:1788986125.314931:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1788986125.314937:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993456640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986125.315014:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993456640:12345-0@lo:400:kworker.0 Request processed in 77us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986125.315021:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:2.0:1788986125.315051:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993456384:0@lo:400:kworker.0 00000100:00100000:2.0:1788986125.315060:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993456256:0@lo:400:kworker.0 00000100:00100000:2.0:1788986125.315069:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993456768:0@lo:400:kworker.0 00000100:00100000:0.0:1788986125.316050:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993456128:12345-0@lo:400:kworker.0 Request processed in 2243us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986125.316061:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:1.0:1788986125.316862:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993456640:0@lo:400:kworker.0 00000100:00080000:0.0:1788986125.317147:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986125.317428:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993456128:0@lo:400:kworker.0 00000100:00100000:1.0:1788986125.824898:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986125.824921:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993456896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986125.824988:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986125.825955:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993456896 00000100:00100000:3.0:1788986125.825964:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993456896 00000100:00100000:3.0:1788986125.826028:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 673 00000100:00100000:3.0:1788986125.826043:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993456896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986125.826107:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788986125.826171:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993456896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986125.826178:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 673 00000100:00100000:1.0:1788986125.826358:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993456896:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986126.273156:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986126.923723:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967335 is committed 00010000:00010000:0.0:1788986127.298689:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986127.474041:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986127.474086:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986127.474136:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986127.474155:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986127.474183:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971233280 00000100:00100000:2.0:1788986127.474192:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971233280 00000100:00100000:2.0:1788986127.474242:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971233152 00000100:00100000:2.0:1788986127.474246:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971233152 00000100:00100000:2.0:1788986127.474270:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 936 00000100:00100000:2.0:1788986127.474279:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971233280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986127.474343:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971233280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986127.474350:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 936 00000100:00100000:2.0:1788986127.474367:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 937 00000100:00100000:2.0:1788986127.474374:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971233152:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986127.474399:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971233152:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986127.474405:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 937 00000100:00080000:2.0:1788986127.474421:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986127.474425:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986127.474761:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971233024 00000100:00100000:3.0:1788986127.474766:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971233024 00000100:00100000:3.0:1788986127.474816:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1331 00000100:00100000:3.0:1788986127.474824:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971233024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986127.474865:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971233024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 42us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986127.474875:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1331 00000100:00100000:3.0:1788986127.474895:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971232896 00000100:00100000:3.0:1788986127.474899:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971232896 00000100:00080000:2.0:1788986127.474993:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986127.475185:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1105 00000100:00100000:2.0:1788986127.475193:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971232896:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986127.475225:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971232896:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986127.475232:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1105 00010000:00010000:3.0:1788986128.320244:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986129.344432:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986129.414830:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986129.414861:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993457024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986129.414956:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986129.415117:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993457024 00000100:00100000:0.0:1788986129.415137:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993457024 00000100:00100000:0.0:1788986129.415215:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1788986129.415228:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993457024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986129.415272:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986129.415332:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993457024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986129.415340:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 674 00000100:00100000:0.0:1788986129.415402:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993457024:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986129.415646:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986130.368294:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986130.435932:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986130.435961:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993457280:0@lo:400:kworker.0 00000100:00100000:0.0:1788986130.436049:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986130.436159:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993457408:0@lo:400:kworker.0 00000100:00100000:0.0:1788986130.436185:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986130.436218:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993457280 00000100:00100000:0.0:1788986130.436228:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993457280 00000100:00100000:0.0:1788986130.436276:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993457408 00000100:00100000:0.0:1788986130.436280:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993457408 00000100:00100000:0.0:1788986130.436311:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1788986130.436320:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993457280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986130.436446:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993457152:0@lo:400:kworker.0 00000100:00100000:2.0:1788986130.436492:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986130.436548:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:2.0:1788986130.436557:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993457408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986130.436619:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993457408:12345-0@lo:400:kworker.0 Request processed in 63us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986130.436626:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00080000:2.0:1788986130.436664:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986130.436678:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993457152 00000100:00100000:2.0:1788986130.436682:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993457152 00000100:00100000:2.0:1788986130.436715:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1788986130.436721:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993457152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986130.436757:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993457152:12345-0@lo:400:kworker.0 Request processed in 36us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986130.436763:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1788986130.436802:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993457152:0@lo:400:kworker.0 00000100:00100000:3.0:1788986130.436803:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993457408:0@lo:400:kworker.0 00000100:00100000:2.0:1788986130.436857:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986130.436864:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993457536:0@lo:400:kworker.0 00000100:00100000:2.0:1788986130.436896:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986130.436924:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993457536 00000100:00100000:2.0:1788986130.436928:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993457536 00000100:00100000:2.0:1788986130.436955:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:2.0:1788986130.436961:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993457536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986130.436998:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993457536:12345-0@lo:400:kworker.0 Request processed in 37us (100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986130.437004:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00100000:2.0:1788986130.437033:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993457536:0@lo:400:kworker.0 00000100:00100000:1.0:1788986130.437192:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993457792:0@lo:400:kworker.0 00000100:00100000:1.0:1788986130.437234:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986130.437270:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993457664:0@lo:400:kworker.0 00000100:00100000:1.0:1788986130.437295:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986130.437321:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993457664 00000100:00100000:1.0:1788986130.437325:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993457664 00000100:00100000:1.0:1788986130.437370:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:1.0:1788986130.437377:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993457664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986130.437414:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993457664:12345-0@lo:400:kworker.0 Request processed in 38us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986130.437421:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00080000:1.0:1788986130.437437:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986130.437456:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d37100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993457664:0@lo:400:kworker.0 00000100:00100000:2.0:1788986130.437658:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993457792 00000100:00100000:2.0:1788986130.437664:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993457792 00000100:00100000:2.0:1788986130.437705:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1788986130.437713:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993457792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986130.437755:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993457792:12345-0@lo:400:kworker.0 Request processed in 43us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986130.437761:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00080000:1.0:1788986130.437821:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986130.437841:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967335 gen 2 00000004:00080000:1.0:1788986130.437848:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0942bb1180, transno 4294967335 00000100:00100000:1.0:1788986130.437870:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993457792:0@lo:400:kworker.0 00000100:00100000:3.0:1788986130.444496:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993457280:0@lo:400:kworker.0 00000100:00100000:0.0:1788986130.444659:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993457280:12345-0@lo:400:kworker.0 Request processed in 8328us (8597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986130.444674:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1788986130.944596:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993457920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986130.944687:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986130.944766:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993457920 00000100:00100000:1.0:1788986130.944781:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993457920 00000100:00100000:1.0:1788986130.944952:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 675 00000100:00100000:1.0:1788986130.944967:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993457920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986130.945017:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986130.953351:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993457920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8370us (8645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986130.953371:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 675 00000100:00100000:0.0:1788986130.953398:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993457920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986131.392563:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986132.416247:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986132.594049:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986132.594127:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986132.594162:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986132.594215:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986132.594246:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971233792 00000100:00100000:2.0:1788986132.594255:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971233792 00000100:00100000:2.0:1788986132.594310:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971233664 00000100:00100000:2.0:1788986132.594314:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971233664 00000100:00100000:2.0:1788986132.594337:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 940 00000100:00100000:2.0:1788986132.594347:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971233792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986132.594414:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971233792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986132.594421:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 940 00000100:00100000:2.0:1788986132.594438:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 941 00000100:00100000:2.0:1788986132.594445:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971233664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986132.594491:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971233664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 47us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986132.594498:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 941 00000100:00080000:2.0:1788986132.594514:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986132.594517:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986132.594860:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971233536 00000100:00100000:3.0:1788986132.594865:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971233536 00000100:00100000:3.0:1788986132.594911:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1335 00000100:00100000:3.0:1788986132.594918:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971233536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986132.594954:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971233536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986132.594960:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1335 00000100:00080000:2.0:1788986132.595354:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986132.597679:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971233408 00000100:00100000:1.0:1788986132.597692:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971233408 00000100:00100000:1.0:1788986132.597754:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1107 00000100:00100000:1.0:1788986132.597764:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971233408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986132.597835:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971233408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (3672us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986132.597842:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1107 00010000:00010000:0.0:1788986133.440409:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986134.465360:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986134.528536:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993458048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986134.528609:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986134.529259:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993458048 00000100:00100000:1.0:1788986134.529267:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993458048 00000100:00080000:0.0:1788986134.529296:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986134.529329:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 676 00000100:00100000:1.0:1788986134.529342:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993458048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986134.529374:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986134.529944:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993458048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 602us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986134.529953:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 676 00000100:00100000:3.0:1788986134.541233:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993458048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986135.488453:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986135.552337:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993458304:0@lo:400:kworker.0 00000100:00100000:0.0:1788986135.552346:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993458432:0@lo:400:kworker.0 00000100:00100000:1.0:1788986135.552428:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993458176:0@lo:400:kworker.0 00000100:00100000:3.0:1788986135.552488:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993458560:0@lo:400:kworker.0 00000100:00100000:0.0:1788986135.552735:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986135.552788:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986135.552795:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993458816:0@lo:400:kworker.0 00000100:00100000:0.0:1788986135.552819:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986135.552858:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993458432 00000100:00100000:0.0:1788986135.552865:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993458432 00000100:00100000:0.0:1788986135.552911:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1788986135.552920:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993458432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986135.552980:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993458432:12345-0@lo:400:kworker.0 Request processed in 61us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986135.552987:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00080000:0.0:1788986135.553007:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986135.553031:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993458432:0@lo:400:kworker.0 00000100:00100000:0.0:1788986135.553065:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993458816 00000100:00100000:0.0:1788986135.553068:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993458816 00000100:00100000:0.0:1788986135.553131:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:0.0:1788986135.553138:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993458816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986135.553171:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993458816:12345-0@lo:400:kworker.0 Request processed in 34us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986135.553177:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00080000:0.0:1788986135.553191:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986135.553207:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993458816:0@lo:400:kworker.0 00000100:00100000:2.0:1788986135.554012:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986135.554215:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993458304 00000100:00100000:0.0:1788986135.554222:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993458304 00000100:00100000:0.0:1788986135.554301:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:0.0:1788986135.554310:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993458304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986135.554369:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993458304:12345-0@lo:400:kworker.0 Request processed in 61us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986135.554375:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:2.0:1788986135.554607:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993458304:0@lo:400:kworker.0 00000100:00100000:1.0:1788986135.554649:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986135.554829:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993458688:0@lo:400:kworker.0 00000100:00100000:1.0:1788986135.554860:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986135.554893:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993458688 00000100:00100000:1.0:1788986135.554897:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993458688 00000100:00100000:1.0:1788986135.554934:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:1.0:1788986135.554941:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993458688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986135.554979:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993458688:12345-0@lo:400:kworker.0 Request processed in 39us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986135.554986:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00080000:1.0:1788986135.555001:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986135.555021:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993458688:0@lo:400:kworker.0 00000100:00100000:2.0:1788986135.555070:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993458176 00000100:00100000:2.0:1788986135.555075:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993458176 00000100:00100000:2.0:1788986135.555222:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1788986135.555230:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993458176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986135.555290:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993458176:12345-0@lo:400:kworker.0 Request processed in 61us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986135.555296:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:0.0:1788986135.555363:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993458176:0@lo:400:kworker.0 00000100:00100000:3.0:1788986135.564160:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986135.565041:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993458560 00000100:00100000:2.0:1788986135.565054:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993458560 00000100:00100000:2.0:1788986135.565142:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:2.0:1788986135.565153:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993458560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986135.565315:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993458560:12345-0@lo:400:kworker.0 Request processed in 164us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986135.565322:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:3.0:1788986135.567493:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993458560:0@lo:400:kworker.0 00000100:00100000:0.0:1788986136.071900:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993458944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986136.071975:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986136.072130:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993458944 00000100:00100000:1.0:1788986136.072138:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993458944 00000100:00100000:1.0:1788986136.072183:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 677 00000100:00100000:1.0:1788986136.072191:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993458944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986136.072240:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986136.076439:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993458944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4238us (4454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986136.076454:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 677 00000100:00100000:0.0:1788986136.081765:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993458944:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986136.514233:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986137.536393:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986137.714566:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986137.714603:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986137.714640:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986137.714674:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986137.714705:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971234176 00000100:00100000:2.0:1788986137.714713:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971234176 00000100:00100000:2.0:1788986137.714764:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971234304 00000100:00100000:2.0:1788986137.714767:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971234304 00000100:00100000:2.0:1788986137.714786:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 944 00000100:00100000:2.0:1788986137.714795:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971234176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986137.714854:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971234176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 60us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986137.714861:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 944 00000100:00100000:2.0:1788986137.714876:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 945 00000100:00100000:2.0:1788986137.714882:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971234304:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986137.714899:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971234304:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 18us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986137.714905:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 945 00000100:00080000:2.0:1788986137.714920:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986137.714924:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986137.715072:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971234048 00000100:00100000:1.0:1788986137.715085:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971234048 00000100:00100000:1.0:1788986137.715147:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1339 00000100:00100000:1.0:1788986137.715154:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971234048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986137.715180:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971234048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986137.715186:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1339 00000100:00100000:3.0:1788986137.715411:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971233920 00000100:00100000:3.0:1788986137.715415:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971233920 00000100:00100000:3.0:1788986137.715447:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1109 00000100:00100000:3.0:1788986137.715453:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971233920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986137.715477:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971233920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986137.715483:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1109 00000100:00080000:3.0:1788986137.715510:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986138.560296:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986139.584462:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986139.648423:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986139.648452:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993459072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986139.648569:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986139.648648:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993459072 00000100:00100000:1.0:1788986139.648659:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993459072 00000100:00100000:1.0:1788986139.648746:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 678 00000100:00100000:1.0:1788986139.648757:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993459072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986139.648805:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986139.648876:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993459072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986139.648896:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 678 00000100:00080000:0.0:1788986139.649033:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986139.649704:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993459072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986140.608345:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986140.672684:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993459200:0@lo:400:kworker.0 00000100:00100000:3.0:1788986140.672691:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993459456:0@lo:400:kworker.0 00000100:00100000:1.0:1788986140.672779:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993459584:0@lo:400:kworker.0 00000100:00100000:2.0:1788986140.672825:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993459328:0@lo:400:kworker.0 00000100:00100000:0.0:1788986140.673352:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986140.673670:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993459712:0@lo:400:kworker.0 00000100:00100000:0.0:1788986140.674410:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986140.674495:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993459712 00000100:00100000:0.0:1788986140.674504:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993459712 00000100:00100000:0.0:1788986140.674562:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1788986140.674572:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993459712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986140.674656:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993459712:12345-0@lo:400:kworker.0 Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986140.674663:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00080000:0.0:1788986140.674697:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986140.674725:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993459712:0@lo:400:kworker.0 00000100:00100000:0.0:1788986140.674794:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993459200 00000100:00100000:0.0:1788986140.674799:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993459200 00000100:00100000:0.0:1788986140.674827:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1788986140.674833:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993459200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986140.674870:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993459200:12345-0@lo:400:kworker.0 Request processed in 36us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986140.674877:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1788986140.674909:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993459200:0@lo:400:kworker.0 00000100:00100000:3.0:1788986140.676986:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986140.677176:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993459456 00000100:00100000:0.0:1788986140.677187:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993459456 00000100:00100000:0.0:1788986140.677302:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1788986140.677313:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993459456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986140.677408:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993459456:12345-0@lo:400:kworker.0 Request processed in 97us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986140.677416:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00100000:1.0:1788986140.679264:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986140.679673:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993459584 00000100:00100000:0.0:1788986140.679687:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993459584 00000100:00100000:0.0:1788986140.679767:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1788986140.679777:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993459584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986140.679873:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993459584:12345-0@lo:400:kworker.0 Request processed in 97us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986140.679880:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00100000:0.0:1788986140.679947:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993459456:0@lo:400:kworker.0 00000100:00080000:3.0:1788986140.680084:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986140.680136:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993459584:0@lo:400:kworker.0 00000100:00100000:2.0:1788986140.680483:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986140.680563:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993459840:0@lo:400:kworker.0 00000100:00100000:2.0:1788986140.680591:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986140.680693:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993459840 00000100:00100000:3.0:1788986140.680698:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993459840 00000100:00100000:3.0:1788986140.680747:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:3.0:1788986140.680755:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993459840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986140.680793:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993459840:12345-0@lo:400:kworker.0 Request processed in 39us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986140.680799:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1788986140.680878:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993459840:0@lo:400:kworker.0 00000100:00080000:0.0:1788986140.680981:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986140.681012:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993459328 00000100:00100000:1.0:1788986140.681016:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993459328 00000100:00100000:1.0:1788986140.681084:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1788986140.681110:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993459328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986140.681158:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993459328:12345-0@lo:400:kworker.0 Request processed in 67us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986140.681164:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:2.0:1788986140.681221:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993459328:0@lo:400:kworker.0 00000100:00100000:0.0:1788986141.184515:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993459968:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986141.184604:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986141.185953:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993459968 00000100:00100000:1.0:1788986141.185964:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993459968 00000100:00100000:1.0:1788986141.186029:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 679 00000100:00100000:1.0:1788986141.186039:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993459968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986141.186085:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986141.186198:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993459968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 159us (1592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986141.186205:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 679 00000100:00100000:0.0:1788986141.186516:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993459968:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986141.632324:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986142.241036:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986142.241304:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971234432 00000100:00100000:0.0:1788986142.241314:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971234432 00000100:00100000:0.0:1788986142.241429:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 621 00000100:00100000:0.0:1788986142.241440:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43309:x1875885971234432:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986142.241537:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43309:x1875885971234432:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 99us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986142.241545:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 621 00000100:00080000:3.0:1788986142.249071:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986142.249167:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986142.263978:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971234560 00000100:00100000:3.0:1788986142.263990:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971234560 00000100:00100000:3.0:1788986142.264061:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 334 00000100:00100000:3.0:1788986142.264072:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43309:x1875885971234560:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986142.264776:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43309:x1875885971234560:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 704us (15610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986142.264784:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 334 00000100:00080000:3.0:1788986142.264810:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986142.269521:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986142.269564:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971234688 00000100:00100000:3.0:1788986142.269573:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971234688 00000100:00100000:2.0:1788986142.269689:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 335 00000100:00100000:2.0:1788986142.269699:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43309:x1875885971234688:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986142.270058:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43309:x1875885971234688:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 359us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986142.270065:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 335 00000100:00080000:3.0:1788986142.270294:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986142.283481:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986142.283519:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971234816 00000100:00100000:3.0:1788986142.283528:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971234816 00000100:00100000:3.0:1788986142.283572:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 622 00000100:00100000:3.0:1788986142.283582:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43309:x1875885971234816:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986142.283989:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43309:x1875885971234816:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 407us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986142.283996:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 622 00000100:00100000:2.0:1788986142.290576:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986142.292884:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971234944 00000100:00100000:3.0:1788986142.292896:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971234944 00000100:00100000:3.0:1788986142.292953:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 623 00000100:00100000:3.0:1788986142.292964:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43309:x1875885971234944:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986142.293057:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43309:x1875885971234944:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 95us (2488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986142.293064:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 623 00000100:00100000:3.0:1788986142.295497:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986142.295572:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971235072 00000100:00100000:2.0:1788986142.295580:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971235072 00000100:00100000:2.0:1788986142.295640:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 336 00000100:00100000:2.0:1788986142.295650:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43309:x1875885971235072:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986142.296046:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43309:x1875885971235072:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 396us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986142.296065:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 336 00000100:00100000:2.0:1788986142.304927:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986142.305248:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971235200 00000100:00100000:3.0:1788986142.305257:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971235200 00000100:00100000:3.0:1788986142.305306:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 337 00000100:00100000:3.0:1788986142.305318:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43309:x1875885971235200:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986142.305659:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43309:x1875885971235200:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 344us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986142.305667:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 337 00000100:00100000:0.0:1788986142.315291:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986142.323659:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971235328 00000100:00100000:2.0:1788986142.323671:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971235328 00000100:00100000:2.0:1788986142.323733:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 624 00000100:00100000:2.0:1788986142.323743:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43309:x1875885971235328:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986142.324276:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43309:x1875885971235328:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 532us (8992us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986142.324285:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 624 00010000:00010000:3.0:1788986142.656228:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986142.835530:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986142.835567:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986142.835618:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986142.835643:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986142.835667:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971235456 00000100:00100000:0.0:1788986142.835675:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971235456 00000100:00100000:0.0:1788986142.835728:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1111 00000100:00100000:0.0:1788986142.835738:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971235456:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986142.835799:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971235456:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 63us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986142.835806:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1111 00000100:00100000:0.0:1788986142.835840:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971235712 00000100:00100000:0.0:1788986142.835845:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971235712 00000100:00100000:0.0:1788986142.835870:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971235840 00000100:00100000:0.0:1788986142.835873:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971235840 00000100:00100000:0.0:1788986142.835891:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 948 00000100:00100000:0.0:1788986142.835897:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971235712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986142.835924:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971235712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986142.835930:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 948 00000100:00100000:0.0:1788986142.835943:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 949 00000100:00100000:0.0:1788986142.835949:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971235840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986142.835970:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971235840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 21us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986142.835976:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 949 00000100:00100000:0.0:1788986142.835992:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971235584 00000100:00100000:0.0:1788986142.835995:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971235584 00000100:00100000:0.0:1788986142.836021:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1343 00000100:00100000:0.0:1788986142.836027:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971235584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986142.836066:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971235584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 39us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986142.836073:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1343 00010000:00010000:0.0:1788986143.686451:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986144.581945:0:74582:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd42e9780 20000000:00000080:3.0:1788986144.581964:0:74582:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a42c4b000 uarg=0000000000000000 00010000:00010000:3.0:1788986144.582491:0:74582:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788986144.582566:0:74582:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:3.0:1788986144.582580:0:74582:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986144.582591:0:74582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf547f5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f7f expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986144.582611:0:74582:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1788986144.582626:0:74582:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986144.582638:0:74582:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986144.582650:0:74582:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547f3a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547f33 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986144.582657:0:74582:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986144.582689:0:74582:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547f3a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547f33 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986144.582701:0:74582:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547f3a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547f33 expref: 18 pid: 5846 timeout: 2028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986144.582715:0:74582:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74582:1875885993460096:0@lo:104: 00000100:00100000:3.0:1788986144.582774:0:74582:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986144.587488:0:74582:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941ecd840 going to sleep for 11 seconds 00000100:00100000:2.0:1788986144.588585:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993460096 00000100:00100000:2.0:1788986144.588596:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993460096 00000100:00100000:2.0:1788986144.588658:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:2.0:1788986144.588667:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:74582:x1875885993460096:12345-0@lo:104: 00010000:00010000:2.0:1788986144.588684:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547f3a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986144.588799:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986144.588805:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:74582:x1875885993460096:12345-0@lo:104: Request processed in 140us (6031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986144.588813:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00010000:00010000:1.0:1788986144.588919:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986144.588927:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547f3a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.588934:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986144.588938:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547f3a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.588947:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547f3a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986144.588954:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547f3a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986144.588960:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986144.589007:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547f3a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589014:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986144.589039:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547f3a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589047:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf547f33 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547f3a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589070:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986144.589072:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986144.589074:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986144.589085:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993460224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986144.589154:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986144.589226:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993460224 00000100:00100000:1.0:1788986144.589231:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993460224 00010000:00010000:1.0:1788986144.589255:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547f3a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547f33 expref: 19 pid: 5846 timeout: 2028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986144.589287:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788986144.589294:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993460224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986144.589306:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986144.589312:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547f3a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547f33 expref: 19 pid: 5846 timeout: 2028 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589324:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547f3a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547f33 expref: 19 pid: 5846 timeout: 2028 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589341:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589349:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589363:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589370:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589377:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589385:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589391:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986144.589395:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589403:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589412:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986144.589422:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986144.589464:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993460224:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986144.589471:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:0.0:1788986144.589525:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993460224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986144.589957:0:74582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf547f3a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547f33 expref: 18 pid: 5846 timeout: 2028 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986144.589970:0:74582:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74582:1875885993460096:0@lo:104: 00010000:00010000:3.0:1788986144.589990:0:74582:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986144.589999:0:74582:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986144.590006:0:74582:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986144.590012:0:74582:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf547fb1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74582 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986144.704590:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986144.768309:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986144.768329:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993460352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986144.768389:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986144.768459:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993460352 00000100:00100000:0.0:1788986144.768466:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993460352 00000100:00100000:0.0:1788986144.768516:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1788986144.768525:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993460352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986144.768556:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986144.768612:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993460352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986144.768619:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 680 00000100:00100000:0.0:1788986144.768662:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993460352:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986144.768797:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986145.728782:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986145.792673:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993460736:0@lo:400:kworker.0 00000100:00100000:1.0:1788986145.792739:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986145.792809:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986145.792815:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993460864:0@lo:400:kworker.0 00000100:00100000:1.0:1788986145.792839:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986145.792913:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993460608:0@lo:400:kworker.0 00000100:00100000:3.0:1788986145.792942:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986145.792969:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993461120:0@lo:400:kworker.0 00000100:00100000:3.0:1788986145.792990:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986145.793005:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788986145.793011:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993460480:0@lo:400:kworker.0 00000100:00100000:3.0:1788986145.793037:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986145.793065:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993460992:0@lo:400:kworker.0 00000100:00100000:3.0:1788986145.793108:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986145.793138:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993460480 00000100:00100000:3.0:1788986145.793145:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993460480 00000100:00100000:3.0:1788986145.793189:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:3.0:1788986145.793197:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993460480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986145.793244:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993460480:12345-0@lo:400:kworker.0 Request processed in 47us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986145.793252:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:3.0:1788986145.793301:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993460480:0@lo:400:kworker.0 00000100:00100000:2.0:1788986145.793389:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993460736 00000100:00100000:2.0:1788986145.793394:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993460736 00000100:00100000:2.0:1788986145.793451:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993460608 00000100:00100000:2.0:1788986145.793454:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993460608 00000100:00100000:2.0:1788986145.793469:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993460992 00000100:00100000:2.0:1788986145.793471:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993460992 00000100:00100000:2.0:1788986145.793486:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1788986145.793492:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993460736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986145.793539:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993460736:12345-0@lo:400:kworker.0 Request processed in 47us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986145.793544:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:2.0:1788986145.793556:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:2.0:1788986145.793561:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993460608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986145.793786:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993460608:12345-0@lo:400:kworker.0 Request processed in 224us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986145.793792:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:2.0:1788986145.793805:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1788986145.793810:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993460992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986145.793836:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993460992:12345-0@lo:400:kworker.0 Request processed in 26us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986145.793841:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:2.0:1788986145.793877:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993460736:0@lo:400:kworker.0 00000100:00100000:2.0:1788986145.793899:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993460992:0@lo:400:kworker.0 00000100:00100000:2.0:1788986145.793908:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993460608:0@lo:400:kworker.0 00000100:00080000:3.0:1788986145.794306:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986145.794427:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993460864 00000100:00100000:0.0:1788986145.794440:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993460864 00000100:00100000:0.0:1788986145.794473:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993461120 00000100:00100000:0.0:1788986145.794475:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993461120 00000100:00100000:0.0:1788986145.794507:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1788986145.794513:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993460864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986145.794547:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993460864:12345-0@lo:400:kworker.0 Request processed in 35us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986145.794552:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1788986145.794563:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1788986145.794579:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993461120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986145.794602:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993461120:12345-0@lo:400:kworker.0 Request processed in 24us (1612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986145.794607:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00080000:1.0:1788986145.794716:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986145.794842:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993460864:0@lo:400:kworker.0 00000100:00100000:2.0:1788986145.794872:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993461120:0@lo:400:kworker.0 00000100:00100000:3.0:1788986146.311069:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986146.311276:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993461248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986146.311337:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986146.314000:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993461248 00000100:00100000:2.0:1788986146.314013:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993461248 00000100:00100000:2.0:1788986146.314080:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1788986146.314107:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993461248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986146.314142:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986146.314224:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993461248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986146.314231:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 681 00000100:00100000:2.0:1788986146.314285:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993461248:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1788986146.496479:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986146.496486:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986146.496491:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986146.496531:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986146.496542:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986146.496555:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986146.496591:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993461376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986146.496652:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986146.496752:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a41254300 going to sleep for 11 seconds 00000100:00100000:1.0:1788986146.498909:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993461376 00000100:00100000:1.0:1788986146.498920:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993461376 00000100:00100000:0.0:1788986146.499079:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:0.0:1788986146.499108:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993461376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986146.499124:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986146.499142:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf547fbf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547fb8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986146.499167:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf547fbf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547fb8 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986146.499178:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf547fbf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547fb8 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986146.499186:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef800, rc 0) 00000100:00100000:0.0:1788986146.499259:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993461376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 171us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986146.499266:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:1.0:1788986146.499522:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993461376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986146.499539:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547fbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986146.499549:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547fbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986146.499584:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986146.499590:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547fbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986146.499598:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547fbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986146.753130:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986147.776173:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986147.811677:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986147.811766:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971235968 00000100:00100000:2.0:1788986147.811777:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971235968 00000100:00100000:2.0:1788986147.811853:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 625 00000100:00100000:2.0:1788986147.811864:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43396:x1875885971235968:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:2.0:1788986147.811882:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986147.811939:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf547fc6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f94 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986147.812005:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547fcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986147.812020:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986147.812033:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986147.812066:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:2.0:1788986147.812070:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986147.812109:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547fcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986147.812137:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf547fc6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f94 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986147.812159:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547fcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f94 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986147.812167:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986147.812170:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986147.812174:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0800, rc 0) 00000100:00100000:2.0:1788986147.812232:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43396:x1875885971235968:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 369us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986147.812242:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 625 00000100:00080000:1.0:1788986147.812348:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986147.818668:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986147.818751:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971236224 00000100:00100000:2.0:1788986147.818761:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971236224 00000100:00100000:2.0:1788986147.818820:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 626 00000100:00100000:2.0:1788986147.818830:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43396:x1875885971236224:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986147.818881:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986147.818908:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547fcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f94 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986147.818925:0:5856:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf547f5d) 00010000:00010000:2.0:1788986147.818928:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986147.818938:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986147.818963:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547fd4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986147.818976:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986147.818985:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986147.846688:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c015db47 reply state 0000000033f4f177 transno 4294967530 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986147.846705:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986147.846723:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000100:00100000:3.0:1788986147.846823:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43396:x1875885971236224:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 27991us (28160us total) trans 4294967530 rc 0/0 00000100:00100000:3.0:1788986147.846832:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 626 00000001:00080000:2.0:1788986147.846953:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967530 is committed 00010000:00010000:3.0:1788986147.847007:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547fd4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986147.847017:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547fd4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986147.847033:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547fd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986147.847039:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986147.847047:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547fd4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986147.847055:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547fd4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986147.847072:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:3.0:1788986147.847075:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986147.847082:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547fd4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986147.847130:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547fd4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986147.956606:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986147.956696:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971236352 00000100:00100000:2.0:1788986147.956705:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971236352 00000100:00100000:2.0:1788986147.956756:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1114 00000100:00100000:2.0:1788986147.956770:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971236352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986147.956842:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971236352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986147.956850:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1114 00000100:00100000:3.0:1788986147.960624:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986147.960666:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986147.960753:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971236480 00000100:00100000:0.0:1788986147.960762:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971236480 00000100:00100000:0.0:1788986147.960834:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971236608 00000100:00100000:0.0:1788986147.960838:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971236608 00000100:00100000:0.0:1788986147.960862:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 952 00000100:00100000:0.0:1788986147.960871:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971236480:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986147.960943:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971236480:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 73us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986147.960950:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 952 00000100:00100000:0.0:1788986147.961163:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 953 00000100:00100000:0.0:1788986147.961172:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971236608:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986147.961200:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971236608:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986147.961206:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 953 00000100:00080000:3.0:1788986147.961538:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986147.961543:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788986148.713717:0:74780:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0b6ce590 20000000:00000080:3.0:1788986148.713733:0:74780:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a42c4ac00 uarg=0000000000000000 00010000:00010000:3.0:1788986148.714359:0:74780:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986148.714374:0:74780:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986148.714386:0:74780:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986148.714402:0:74780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.714485:0:74780:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf547fbf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547fb8 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.714495:0:74780:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.714534:0:74780:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf547fbf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547fb8 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.714559:0:74780:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf547fbf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547fb8 expref: 18 pid: 5849 timeout: 2032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986148.714574:0:74780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74780:1875885993461504:0@lo:104: 00000100:00100000:3.0:1788986148.714629:0:74780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986148.714725:0:74780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c6b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986148.714796:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993461504 00000100:00100000:2.0:1788986148.714803:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993461504 00000100:00100000:2.0:1788986148.714875:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:2.0:1788986148.714884:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:74780:x1875885993461504:12345-0@lo:104: 00010000:00010000:2.0:1788986148.714896:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547fbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986148.714959:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986148.714965:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:74780:x1875885993461504:12345-0@lo:104: Request processed in 83us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986148.714971:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00010000:00010000:1.0:1788986148.715009:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986148.715027:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547fbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986148.715034:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986148.715039:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547fbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986148.715047:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547fbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986148.715055:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547fbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986148.715061:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986148.715109:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547fbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986148.715120:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986148.715139:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547fbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986148.715146:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1200/0xc20d828fcf547fb8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547fbf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986148.715161:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986148.715163:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986148.715164:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986148.715344:0:74780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:74780:1875885993461504:0@lo:104: 00010000:00010000:3.0:1788986148.715361:0:74780:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986148.715445:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986148.715456:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993461632:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986148.715486:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986148.715616:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993461632 00000100:00100000:3.0:1788986148.715621:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993461632 00010000:00010000:3.0:1788986148.715639:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf547fbf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547fb8 expref: 19 pid: 5849 timeout: 2032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986148.715665:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788986148.715671:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993461632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986148.715680:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986148.715685:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf547fbf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547fb8 expref: 19 pid: 5849 timeout: 2032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.715694:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf547fbf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547fb8 expref: 19 pid: 5849 timeout: 2032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.715706:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf547fbf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547fb8 expref: 19 pid: 5849 timeout: 2032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.715719:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.715727:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.715739:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.715745:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.715751:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.715756:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.715761:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986148.715765:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.715772:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.715793:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986148.715803:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986148.715832:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993461632:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986148.715838:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00010000:00010000:1.0:1788986148.715916:0:74780:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986148.715924:0:74780:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986148.715929:0:74780:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf547fdb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 74780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986148.717990:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993461632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986148.802116:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986149.824294:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788986149.889793:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986149.889798:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986149.889802:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986149.889833:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986149.889843:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986149.889854:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986149.889874:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993461888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986149.889950:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986149.889997:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76320000 going to sleep for 11 seconds 00000100:00100000:1.0:1788986149.890111:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993461888 00000100:00100000:1.0:1788986149.890119:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993461888 00000100:00100000:1.0:1788986149.890169:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:1.0:1788986149.890192:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993461888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986149.890205:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986149.890217:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547fe9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf547fe2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986149.890244:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547fe9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf547fe2 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986149.890256:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547fe9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547fe2 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986149.890264:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788986149.890304:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993461888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986149.890311:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1788986149.890668:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993461888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986149.890684:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547fe9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986149.890692:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf547fe9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986149.890708:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986149.890712:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547fe9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986149.890719:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf547fe9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986149.890795:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993461760:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986149.890830:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986149.890975:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993461760 00000100:00100000:0.0:1788986149.890980:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993461760 00000100:00100000:0.0:1788986149.891026:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 682 00000100:00100000:0.0:1788986149.891033:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993461760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986149.891058:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986149.891118:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993461760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986149.891125:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 682 00000100:00080000:1.0:1788986149.891188:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986149.891378:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993461760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986150.849075:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986150.913335:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993462144:0@lo:400:kworker.0 00000100:00100000:0.0:1788986150.913399:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986150.913444:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993462656:0@lo:400:kworker.0 00000100:00100000:0.0:1788986150.913469:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986150.913492:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986150.913498:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993462272:0@lo:400:kworker.0 00000100:00100000:0.0:1788986150.913518:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986150.913553:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993462144 00000100:00100000:0.0:1788986150.913560:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993462144 00000100:00100000:0.0:1788986150.913598:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993462272 00000100:00100000:0.0:1788986150.913601:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993462272 00000100:00100000:0.0:1788986150.913632:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1788986150.913640:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993462144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986150.913685:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993462144:12345-0@lo:400:kworker.0 Request processed in 46us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986150.913692:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1347 00000100:00100000:0.0:1788986150.913710:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1788986150.913717:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993462272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986150.913742:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993462272:12345-0@lo:400:kworker.0 Request processed in 26us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986150.913748:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:0.0:1788986150.913770:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993462656 00000100:00100000:0.0:1788986150.913774:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993462656 00000100:00100000:0.0:1788986150.913801:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1788986150.913808:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993462656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986150.913835:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993462656:12345-0@lo:400:kworker.0 Request processed in 29us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986150.913841:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00080000:0.0:1788986150.913859:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986150.913863:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986150.913894:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993462272:0@lo:400:kworker.0 00000100:00100000:0.0:1788986150.913905:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993462144:0@lo:400:kworker.0 00000100:00100000:0.0:1788986150.913913:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993462656:0@lo:400:kworker.0 00000100:00100000:2.0:1788986150.913971:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993462016:0@lo:400:kworker.0 00000100:00100000:2.0:1788986150.914006:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986150.914040:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993462528:0@lo:400:kworker.0 00000100:00100000:2.0:1788986150.914062:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986150.914082:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986150.914116:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993462400:0@lo:400:kworker.0 00000100:00100000:2.0:1788986150.914138:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986150.914163:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993462528 00000100:00100000:2.0:1788986150.914166:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993462528 00000100:00100000:2.0:1788986150.914195:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1788986150.914201:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993462528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986150.914232:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993462528:12345-0@lo:400:kworker.0 Request processed in 31us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986150.914238:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:2.0:1788986150.914257:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993462400 00000100:00100000:2.0:1788986150.914260:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993462400 00000100:00100000:2.0:1788986150.914279:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:2.0:1788986150.914284:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993462400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986150.914310:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993462400:12345-0@lo:400:kworker.0 Request processed in 26us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986150.914316:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00080000:2.0:1788986150.914332:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986150.914349:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993462400:0@lo:400:kworker.0 00000100:00100000:2.0:1788986150.914357:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993462528:0@lo:400:kworker.0 00000100:00100000:0.0:1788986150.914466:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993462016 00000100:00100000:0.0:1788986150.914470:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993462016 00000100:00100000:0.0:1788986150.914503:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1788986150.914510:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993462016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986150.914558:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993462016:12345-0@lo:400:kworker.0 Request processed in 48us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986150.914564:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:2.0:1788986150.914648:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993462016:0@lo:400:kworker.0 00000100:00100000:2.0:1788986151.424224:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986151.424251:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993462784:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986151.424333:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986151.424412:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993462784 00000100:00100000:2.0:1788986151.424420:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993462784 00000100:00100000:2.0:1788986151.424473:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1788986151.424484:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993462784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986151.424522:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986151.424582:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993462784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986151.424591:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1788986151.424637:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79796a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993462784:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986151.588524:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986151.590375:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971236736 00000100:00100000:2.0:1788986151.590388:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971236736 00000100:00100000:2.0:1788986151.590467:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 627 00000100:00100000:2.0:1788986151.590477:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43472:x1875885971236736:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986151.590498:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986151.590519:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf547ff0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0f9b expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.590590:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547ff7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.590604:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.590615:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.590672:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ffe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.590680:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ffe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.590687:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ffe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591002:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548005 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591012:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591019:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986151.591040:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:2.0:1788986151.591043:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986151.591061:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548005 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591072:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547ff7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591079:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547ff7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591109:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591116:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986151.591121:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547ff7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591128:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547ff7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591140:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:2.0:1788986151.591143:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986151.591148:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547ff7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591159:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf547ff7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591170:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ffe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591176:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ffe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591182:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ffe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591187:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986151.591190:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ffe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591196:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ffe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591203:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986151.591205:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986151.591208:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ffe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591214:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf547ffe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591240:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf547ff0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f9b expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591254:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548005 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f9b expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986151.591263:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:2.0:1788986151.591265:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986151.591268:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1e00, rc 0) 00000100:00100000:2.0:1788986151.591321:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43472:x1875885971236736:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 845us (2805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986151.591328:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 627 00000100:00080000:3.0:1788986151.591795:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788986151.879279:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986152.896292:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986153.079376:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986153.079414:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986153.079480:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986153.079507:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986153.079551:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971236992 00000100:00100000:3.0:1788986153.079561:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971236992 00000100:00100000:3.0:1788986153.079626:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1350 00000100:00100000:3.0:1788986153.079637:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971236992:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986153.079704:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971236992:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986153.079712:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1350 00000100:00080000:3.0:1788986153.079731:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986153.083286:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971236864 00000100:00100000:3.0:1788986153.083298:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971236864 00000100:00100000:3.0:1788986153.083357:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1117 00000100:00100000:3.0:1788986153.083368:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971236864:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986153.083432:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971236864:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 66us (3952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986153.083440:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1117 00000100:00100000:0.0:1788986153.083723:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971237248 00000100:00100000:0.0:1788986153.083729:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971237248 00000100:00100000:0.0:1788986153.083774:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971237120 00000100:00100000:0.0:1788986153.083777:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971237120 00000100:00100000:0.0:1788986153.083799:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 956 00000100:00100000:0.0:1788986153.083807:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971237248:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986153.083842:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971237248:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (4427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986153.083848:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 956 00000100:00100000:0.0:1788986153.083864:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 957 00000100:00100000:0.0:1788986153.083871:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971237120:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986153.083896:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971237120:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (4388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986153.083901:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 957 00000100:00080000:3.0:1788986153.084914:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986153.084920:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:3.0:1788986153.265186:0:75024:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc02a0db0 20000000:00000080:3.0:1788986153.265203:0:75024:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a42c49800 uarg=0000000000000000 00010000:00010000:3.0:1788986153.266000:0:75024:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788986153.266034:0:75024:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:3.0:1788986153.266038:0:75024:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986153.266047:0:75024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548005 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0f9b expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986153.266073:0:75024:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1788986153.266362:0:75024:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986153.266379:0:75024:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986153.266392:0:75024:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547fe9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf547fe2 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986153.266400:0:75024:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986153.266434:0:75024:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547fe9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf547fe2 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986153.266447:0:75024:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547fe9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf547fe2 expref: 18 pid: 5849 timeout: 2037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986153.266459:0:75024:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75024:1875885993462912:0@lo:104: 00000100:00100000:3.0:1788986153.266514:0:75024:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986153.266624:0:75024:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b6840 going to sleep for 11 seconds 00000100:00100000:2.0:1788986153.266758:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993462912 00000100:00100000:2.0:1788986153.266766:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993462912 00000100:00100000:2.0:1788986153.266853:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:2.0:1788986153.266864:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:75024:x1875885993462912:12345-0@lo:104: 00010000:00010000:2.0:1788986153.266876:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547fe9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986153.266939:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986153.266945:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:75024:x1875885993462912:12345-0@lo:104: Request processed in 84us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986153.266951:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00010000:00010000:1.0:1788986153.266992:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986153.266999:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf547fe9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267006:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986153.267009:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf547fe9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267017:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf547fe9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986153.267029:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf547fe9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986153.267035:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986153.267064:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547fe9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267070:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986153.267112:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547fe9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267120:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf547fe2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf547fe9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267133:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986153.267135:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986153.267136:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986153.267153:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993463040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986153.267182:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986153.267215:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993463040 00000100:00100000:1.0:1788986153.267219:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993463040 00010000:00010000:1.0:1788986153.267238:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547fe9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547fe2 expref: 19 pid: 5849 timeout: 2037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986153.267258:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788986153.267264:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993463040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986153.267273:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986153.267278:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547fe9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf547fe2 expref: 19 pid: 5849 timeout: 2037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267289:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547fe9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf547fe2 expref: 19 pid: 5849 timeout: 2037 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267303:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267311:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267323:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267331:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267337:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267343:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267348:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986153.267351:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267357:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267365:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.267376:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986153.267403:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993463040:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986153.267409:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:1.0:1788986153.267447:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993463040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986153.267559:0:75024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf547fe9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf547fe2 expref: 18 pid: 5849 timeout: 2037 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986153.267573:0:75024:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75024:1875885993462912:0@lo:104: 00010000:00010000:3.0:1788986153.267587:0:75024:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986153.267611:0:75024:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986153.267627:0:75024:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986153.267634:0:75024:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54800c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75024 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986153.922672:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788986154.374201:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986154.374207:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986154.374211:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986154.374251:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986154.374262:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986154.374273:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986154.374296:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993463168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986154.374357:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986154.374421:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161900 going to sleep for 11 seconds 00000100:00100000:3.0:1788986154.376257:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993463168 00000100:00100000:3.0:1788986154.376268:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993463168 00000100:00100000:3.0:1788986154.376447:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:3.0:1788986154.376459:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993463168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986154.376474:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986154.376490:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54801a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548013 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986154.376513:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54801a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548013 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986154.376537:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54801a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548013 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986154.376546:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788986154.376716:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993463168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 259us (2358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986154.376724:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:2.0:1788986154.376821:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993463168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986154.376838:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54801a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986154.377237:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54801a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986154.377261:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986154.377266:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54801a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986154.377275:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54801a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986154.952081:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986155.015711:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993463296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986155.015792:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986155.015831:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993463296 00000100:00100000:2.0:1788986155.015839:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993463296 00000100:00100000:2.0:1788986155.015900:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 684 00000100:00100000:2.0:1788986155.015915:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993463296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986155.015947:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986155.021328:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993463296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5410us (5527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986155.022260:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993463296:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986155.023173:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986155.025584:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 684 00010000:00010000:3.0:1788986155.971412:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986156.032393:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993463680:0@lo:400:kworker.0 00000100:00100000:0.0:1788986156.032458:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986156.032503:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986156.032519:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993463808:0@lo:400:kworker.0 00000100:00100000:0.0:1788986156.032542:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986156.032718:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993463552:0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.032747:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986156.032765:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993464064:0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.032785:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986156.032804:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788986156.032809:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993463424:0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.032834:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986156.032856:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993463936:0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.032876:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986156.032904:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993463808 00000100:00100000:3.0:1788986156.032911:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993463808 00000100:00100000:3.0:1788986156.032961:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993464064 00000100:00100000:3.0:1788986156.032964:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993464064 00000100:00100000:3.0:1788986156.033007:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1788986156.033016:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993463808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.033067:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993463808:12345-0@lo:400:kworker.0 Request processed in 51us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986156.033074:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:3.0:1788986156.033110:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:3.0:1788986156.033117:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993464064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.033149:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993464064:12345-0@lo:400:kworker.0 Request processed in 33us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986156.033155:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:3.0:1788986156.033172:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993463424 00000100:00100000:3.0:1788986156.033176:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993463424 00000100:00100000:3.0:1788986156.033199:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:3.0:1788986156.033205:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993463424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.033232:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993463424:12345-0@lo:400:kworker.0 Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986156.033237:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:3.0:1788986156.033260:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993463680 00000100:00100000:3.0:1788986156.033264:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993463680 00000100:00100000:3.0:1788986156.033287:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993463552 00000100:00100000:3.0:1788986156.033290:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993463552 00000100:00100000:3.0:1788986156.033304:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993463936 00000100:00100000:3.0:1788986156.033306:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993463936 00000100:00100000:3.0:1788986156.033320:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1788986156.033326:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993463680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.033354:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993463680:12345-0@lo:400:kworker.0 Request processed in 28us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986156.033360:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1351 00000100:00100000:3.0:1788986156.033370:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1788986156.033375:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993463552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.033632:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993463552:12345-0@lo:400:kworker.0 Request processed in 24us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986156.033639:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:3.0:1788986156.033652:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:3.0:1788986156.033659:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993463936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.033688:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993463936:12345-0@lo:400:kworker.0 Request processed in 30us (811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986156.033694:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00080000:3.0:1788986156.033725:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986156.033730:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986156.033763:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993463424:0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.033776:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993463936:0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.033785:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993463552:0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.033794:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993464064:0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.033831:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993463808:0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.033841:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993463680:0@lo:400:kworker.0 00000100:00100000:3.0:1788986156.069668:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986156.069699:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971237376 00000100:00100000:3.0:1788986156.069720:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971237376 00000100:00100000:3.0:1788986156.069771:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 628 00000100:00100000:3.0:1788986156.069780:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43564:x1875885971237376:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986156.069797:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986156.069818:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548021 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0fa2 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.069878:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548028 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.069891:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.069904:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986156.069951:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:3.0:1788986156.069954:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986156.069972:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548028 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.069995:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548021 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fa2 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.070014:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548028 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fa2 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.070022:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745b00) 00010000:00010000:3.0:1788986156.070025:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986156.070028:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2800, rc 0) 00000100:00100000:3.0:1788986156.070076:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43564:x1875885971237376:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 296us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986156.070083:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 628 00000100:00080000:3.0:1788986156.070200:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986156.075685:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986156.075728:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971237632 00000100:00100000:3.0:1788986156.075736:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971237632 00000100:00100000:3.0:1788986156.075783:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 629 00000100:00100000:3.0:1788986156.075792:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43564:x1875885971237632:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986156.075838:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986156.075861:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548028 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fa2 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.075883:0:5856:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf548005) 00010000:00010000:3.0:1788986156.075886:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745b00) 00010000:00010000:3.0:1788986156.075897:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986156.075933:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54802f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.075946:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54802f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.075956:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54802f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788986156.137904:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967531 is committed 00000004:00010000:3.0:1788986156.137995:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002b3eb6e2 reply state 0000000005c67844 transno 4294967531 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54802f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986156.138011:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986156.138030:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00010000:00080000:3.0:1788986156.138196:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788986156.138215:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43564:x1875885971237632:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 62421us (62532us total) trans 4294967531 rc 0/0 00000100:00100000:3.0:1788986156.138224:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 629 00010000:00010000:2.0:1788986156.138293:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54802f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986156.138302:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54802f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986156.138310:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54802f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986156.138316:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986156.138320:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54802f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986156.138328:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54802f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986156.138344:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:2.0:1788986156.138347:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986156.138352:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54802f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986156.138359:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54802f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986156.544465:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986156.544486:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993464192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986156.544560:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986156.544635:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993464192 00000100:00100000:0.0:1788986156.544643:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993464192 00000100:00100000:0.0:1788986156.544684:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1788986156.544693:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993464192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986156.544724:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986156.544769:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993464192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986156.544775:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 685 00000100:00100000:0.0:1788986156.544818:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993464192:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788986156.925154:0:75220:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeef10d3e0 20000000:00000080:1.0:1788986156.925171:0:75220:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a8096e400 uarg=0000000000000000 00010000:00010000:1.0:1788986156.925619:0:75220:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788986156.925635:0:75220:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788986156.925648:0:75220:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986156.925667:0:75220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986156.925682:0:75220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54801a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548013 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986156.925690:0:75220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986156.925725:0:75220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54801a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548013 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986156.925740:0:75220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54801a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548013 expref: 18 pid: 5849 timeout: 2040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986156.925752:0:75220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75220:1875885993464320:0@lo:104: 00000100:00100000:1.0:1788986156.925807:0:75220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986156.925860:0:75220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51df2300 going to sleep for 11 seconds 00000100:00100000:2.0:1788986156.926174:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993464320 00000100:00100000:2.0:1788986156.926182:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993464320 00000100:00100000:2.0:1788986156.926233:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 318 00000100:00100000:2.0:1788986156.926242:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:75220:x1875885993464320:12345-0@lo:104: 00010000:00010000:2.0:1788986156.926255:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54801a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986156.926322:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986156.926328:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:75220:x1875885993464320:12345-0@lo:104: Request processed in 88us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986156.926335:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 318 00010000:00010000:3.0:1788986156.926435:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986156.926442:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54801a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926450:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986156.926453:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54801a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926467:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54801a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986156.926475:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54801a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986156.926481:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986156.926524:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54801a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926531:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986156.926556:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54801a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926564:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf548013 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54801a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926578:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986156.926580:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986156.926582:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986156.926589:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986156.926599:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993464448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986156.926630:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986156.926662:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993464448 00000100:00100000:3.0:1788986156.926666:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993464448 00010000:00010000:3.0:1788986156.926685:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54801a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548013 expref: 19 pid: 5849 timeout: 2040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986156.926707:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788986156.926714:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993464448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986156.926723:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986156.926728:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54801a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548013 expref: 19 pid: 5849 timeout: 2040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926750:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54801a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548013 expref: 19 pid: 5849 timeout: 2040 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926765:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926773:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926787:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926794:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926800:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926806:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926811:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986156.926815:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926821:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926830:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.926839:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986156.926867:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993464448:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986156.926874:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788986156.926909:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993464448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986156.927651:0:75220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54801a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548013 expref: 18 pid: 5849 timeout: 2040 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986156.927666:0:75220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75220:1875885993464320:0@lo:104: 00010000:00010000:1.0:1788986156.927684:0:75220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986156.927691:0:75220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986156.927697:0:75220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986156.927702:0:75220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548036 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986156.993221:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986158.016238:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986158.197411:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986158.197460:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986158.197494:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986158.197535:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986158.197567:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971237760 00000100:00100000:3.0:1788986158.197568:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971238144 00000100:00100000:3.0:1788986158.197579:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971238144 00000100:00100000:0.0:1788986158.197579:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971237760 00000100:00100000:3.0:1788986158.197630:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971238016 00000100:00100000:3.0:1788986158.197635:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971238016 00000100:00100000:0.0:1788986158.197638:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1120 00000100:00100000:0.0:1788986158.197652:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971237760:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986158.197665:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 960 00000100:00100000:3.0:1788986158.197675:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971238144:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986158.197763:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 961 00000100:00100000:1.0:1788986158.197786:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971238016:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986158.197859:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971237760:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 211us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986158.197868:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1120 00000100:00100000:2.0:1788986158.198003:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971237888 00000100:00100000:2.0:1788986158.198008:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971237888 00000100:00100000:2.0:1788986158.198040:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1354 00000100:00100000:2.0:1788986158.198048:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971237888:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986158.198243:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971238144:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 569us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986158.198251:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 960 00000100:00080000:3.0:1788986158.198270:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986158.198274:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986158.198277:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986158.198422:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971237888:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 374us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986158.198430:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1354 00000100:00100000:1.0:1788986158.201546:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971238016:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 3764us (4000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986158.201562:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 961 10000000:01000000:2.0:1788986158.208200:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986158.208208:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986158.208213:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986158.208260:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986158.208275:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986158.208285:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986158.208309:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993464576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986158.208372:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986158.208426:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09427c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788986158.209124:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993464576 00000100:00100000:3.0:1788986158.209136:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993464576 00000100:00100000:3.0:1788986158.209185:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:3.0:1788986158.209194:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993464576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986158.209206:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986158.209223:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548044 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54803d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986158.209246:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548044 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54803d expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986158.209255:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548044 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54803d expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986158.209263:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2800, rc 0) 00000100:00100000:3.0:1788986158.209324:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993464576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986158.209330:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1788986158.209562:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79796a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993464576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986158.209576:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548044 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986158.209586:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548044 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986158.209606:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986158.209611:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548044 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986158.209618:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548044 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.040482:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986159.811868:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986159.812073:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971238272 00000100:00100000:0.0:1788986159.812084:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971238272 00000100:00100000:0.0:1788986159.812185:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 630 00000100:00100000:0.0:1788986159.812196:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43641:x1875885971238272:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788986159.812215:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986159.812235:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54804b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0fa9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.812294:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548052 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.812308:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.812319:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.812330:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548059 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.812337:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.812344:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813250:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548060 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813262:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813270:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986159.813294:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:0.0:1788986159.813298:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986159.813315:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548060 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813327:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548052 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813333:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548052 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813339:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548052 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813346:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986159.813350:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548052 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813357:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548052 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813368:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986159.813371:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986159.813376:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548052 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813383:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548052 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813394:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548059 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813454:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548059 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813461:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548059 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813466:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986159.813469:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548059 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813475:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548059 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813482:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a4823b700) 00010000:00010000:0.0:1788986159.813485:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986159.813498:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548059 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813505:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548059 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813597:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54804b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fa9 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813614:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548060 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fa9 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.813620:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986159.813622:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986159.813625:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788986159.813735:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43641:x1875885971238272:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 1540us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986159.813743:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 630 00000100:00100000:3.0:1788986159.818237:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986159.819139:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971238528 00000100:00100000:0.0:1788986159.819150:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971238528 00000100:00100000:0.0:1788986159.819260:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 631 00000100:00100000:0.0:1788986159.819271:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43641:x1875885971238528:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788986159.819292:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986159.819312:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548067 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0fb0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.819595:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54806e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.819612:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54806e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.819623:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54806e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.819851:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548075 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.819861:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.819879:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986159.820893:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x14:0x0], index 0: 0 00010000:00010000:0.0:1788986159.821756:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54807c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.821772:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54807c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.821783:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54807c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.821821:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54806e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.821829:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54806e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.821835:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54806e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.821841:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986159.821845:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54806e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.821852:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54806e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.821864:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986159.821867:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986159.821872:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54806e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.821878:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54806e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986159.821895:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004254ee26 reply state 00000000eb8a248f transno 4294967532 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986159.821904:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788986159.821937:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548067 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fb0 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.821952:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54807c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fb0 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.822041:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986159.822044:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986159.822046:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efe00, rc 0) 00000100:00100000:0.0:1788986159.824187:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:43641:x1875885971238528:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 4909us (5949us total) trans 4294967532 rc 0/0 00000100:00100000:0.0:1788986159.824198:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 631 00010000:00010000:2.0:1788986159.827032:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.827048:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548075 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.827061:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.827068:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986159.827072:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.827080:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548075 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.827152:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a4823b000) 00010000:00010000:2.0:1788986159.827156:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986159.827161:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548075 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.827167:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548075 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986159.830381:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986159.830908:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971238784 00000100:00100000:2.0:1788986159.830918:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971238784 00000100:00100000:2.0:1788986159.830982:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 632 00000100:00100000:2.0:1788986159.830993:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:43641:x1875885971238784:12345-192.168.206.21@tcp:36:touch.60003 00010000:00010000:2.0:1788986159.831047:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986159.831072:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54807c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fb0 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.831128:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:2.0:1788986159.831141:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986159.831183:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54808a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.831196:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54808a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.831206:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54808a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986159.831323:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a291234b reply state 00000000dfa8f038 transno 4294967533 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54808a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986159.831332:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986159.832153:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:43641:x1875885971238784:12345-192.168.206.21@tcp:36:touch.60003 Request processed in 1159us (1777us total) trans 4294967533 rc 0/0 00000100:00100000:2.0:1788986159.832161:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 632 00010000:00010000:3.0:1788986159.834173:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54808a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.834188:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54808a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.834196:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54808a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.834208:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986159.834212:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54808a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.834220:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54808a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.834235:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:3.0:1788986159.834239:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986159.834243:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54808a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.834251:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54808a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986159.836800:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986159.836859:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971238912 00000100:00100000:0.0:1788986159.836870:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971238912 00000100:00100000:0.0:1788986159.836920:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 633 00000100:00100000:0.0:1788986159.836931:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:43641:x1875885971238912:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788986159.836954:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986159.836976:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548091 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0fb7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.837032:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548091 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fb7 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.837052:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548091 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x34:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fb7 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.837070:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986159.837073:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788986159.837076:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eee00, rc 0) 00000100:00100000:0.0:1788986159.837162:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:43641:x1875885971238912:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 232us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986159.837170:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 633 00000100:00100000:1.0:1788986159.843940:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986159.844217:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971239040 00000100:00100000:0.0:1788986159.844226:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971239040 00000100:00100000:0.0:1788986159.844283:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 338 00000100:00100000:0.0:1788986159.844295:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971239040:12345-192.168.206.21@tcp:2:touch.60003 00000100:00100000:0.0:1788986159.845627:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971239040:12345-192.168.206.21@tcp:2:touch.60003 Request processed in 1327us (1687us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788986159.845638:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 338 00000100:00100000:3.0:1788986159.856144:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986159.856215:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971239296 00000100:00100000:2.0:1788986159.856224:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971239296 00000100:00100000:2.0:1788986159.856280:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:2.0:1788986159.856290:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:43641:x1875885971239296:12345-192.168.206.21@tcp:35:touch.60003 00000100:00100000:2.0:1788986159.856630:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:43641:x1875885971239296:12345-192.168.206.21@tcp:35:touch.60003 Request processed in 340us (494us total) trans 4294967534 rc 0/0 00000100:00100000:2.0:1788986159.856637:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 64 00000100:00100000:3.0:1788986159.918061:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986159.918189:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971239424 00000100:00100000:0.0:1788986159.918210:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971239424 00000100:00100000:0.0:1788986159.918265:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 634 00000100:00100000:0.0:1788986159.918276:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:43645:x1875885971239424:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:0.0:1788986159.918298:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986159.918316:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548098 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0fbe expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918375:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54809f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918389:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54809f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918410:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54809f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918424:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918431:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918437:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918525:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5480ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918533:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5480ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918539:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5480ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986159.918586:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x34:0x0]: returning size 0 00000004:00200000:0.0:1788986159.918590:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986159.918611:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5480ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918623:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5480ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918635:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54809f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918641:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54809f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918648:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54809f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918654:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986159.918658:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54809f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918666:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54809f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918677:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986159.918681:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986159.918685:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54809f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918691:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54809f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918703:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918709:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918715:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918721:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986159.918724:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918730:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918737:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a4823b700) 00010000:00010000:0.0:1788986159.918739:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986159.918742:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918747:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918777:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548098 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fbe expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918790:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5480ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fbe expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.918797:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986159.918799:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986159.918802:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef000, rc 0) 00000100:00100000:0.0:1788986159.921057:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:43645:x1875885971239424:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 2772us (2994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986159.921069:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 634 00000100:00100000:0.0:1788986159.925991:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986159.926122:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971239552 00000100:00100000:3.0:1788986159.926131:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971239552 00000100:00100000:3.0:1788986159.926320:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 339 00000100:00100000:3.0:1788986159.926330:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971239552:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:3.0:1788986159.926347:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986159.926377:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e36856b6/0xc20d828fcf5480b4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0fc5 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788986159.926404:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x6aa1c32f, atime: 0x6aa1c32f, ctime: 0x6aa1c32f, blocks: 0x1 00010000:00010000:3.0:1788986159.926422:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=1943s v=(0 0) 00010000:00010000:3.0:1788986159.926427:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986159.926436:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e36856b6/0xc20d828fcf5480b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fc5 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.926453:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e36856b6/0xc20d828fcf5480b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fc5 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.926466:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986159.926583:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971239552:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 253us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986159.926590:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 339 00000100:00100000:2.0:1788986159.937389:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986159.937461:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971239808 00000100:00100000:0.0:1788986159.937471:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971239808 00000100:00100000:0.0:1788986159.937537:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 635 00000100:00100000:0.0:1788986159.937547:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:43645:x1875885971239808:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:0.0:1788986159.937602:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986159.937626:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5480ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fbe expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.937647:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548091 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x34:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fb7 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.937657:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986159.937668:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986159.937687:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5480bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.937700:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5480bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.937708:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5480bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.937721:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.937728:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.937735:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.937827:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480c9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.937835:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.937841:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788986159.938673:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].20, 64 off9472 00000004:00080000:0.0:1788986159.938683:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1943841593340ns, next at 1944841591208ns, rc = 0 00010000:00010000:0.0:1788986159.938741:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5480d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938751:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5480d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938760:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5480d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938768:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5480d0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938775:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5480d0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938781:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5480d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938803:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788986159.938822:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480c9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938829:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480c9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938836:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938842:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986159.938847:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480c9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938854:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480c9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938864:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:0.0:1788986159.938867:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788986159.938871:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480c9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938877:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480c9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x34:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938891:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5480bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938897:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5480bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938903:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5480bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938907:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986159.938911:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5480bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938916:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5480bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938924:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986159.938926:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986159.938929:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5480bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986159.938934:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5480bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986159.938944:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cd9effef reply state 0000000019c8507c transno 4294967535 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986159.938953:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788986159.939158:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986159.939175:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5480d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.939183:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986159.939186:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5480d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.939193:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5480d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.939202:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x34:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:3.0:1788986159.939204:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986159.939207:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5480d0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.939213:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5480d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x34:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986159.939232:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986159.939234:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986159.939235:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986159.939600:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:43645:x1875885971239808:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 2051us (2217us total) trans 4294967535 rc 0/0 00000100:00100000:0.0:1788986159.939609:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 635 00010000:00010000:2.0:1788986159.942361:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.942377:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.942388:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.942394:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986159.942398:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.942413:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.942428:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a4823b700) 00010000:00010000:2.0:1788986159.942431:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986159.942436:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986159.942442:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5480c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986160.064311:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986160.139299:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986160.146650:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993464704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986160.146721:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986160.146881:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993464704 00000100:00100000:1.0:1788986160.146890:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993464704 00000100:00100000:1.0:1788986160.146966:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 686 00000100:00080000:3.0:1788986160.146970:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986160.146989:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993464704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986160.147028:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986160.147103:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993464704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986160.147111:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 686 00000100:00100000:3.0:1788986160.147181:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993464704:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986161.093402:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986161.161412:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993464832:0@lo:400:kworker.0 00000100:00100000:2.0:1788986161.161508:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986161.161570:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993465344:0@lo:400:kworker.0 00000100:00100000:2.0:1788986161.161596:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986161.161621:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986161.161626:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993465216:0@lo:400:kworker.0 00000100:00100000:2.0:1788986161.161647:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986161.161681:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993465216 00000100:00100000:2.0:1788986161.161689:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993465216 00000100:00100000:2.0:1788986161.161748:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:2.0:1788986161.161767:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993465216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986161.161820:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993465216:12345-0@lo:400:kworker.0 Request processed in 63us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986161.161827:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:2.0:1788986161.161869:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993465216:0@lo:400:kworker.0 00000100:00100000:3.0:1788986161.162035:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993464960:0@lo:400:kworker.0 00000100:00100000:3.0:1788986161.162132:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986161.162177:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993465472:0@lo:400:kworker.0 00000100:00100000:3.0:1788986161.162208:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986161.162244:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986161.162253:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993465088:0@lo:400:kworker.0 00000100:00100000:3.0:1788986161.162279:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986161.162325:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993465472 00000100:00100000:3.0:1788986161.162333:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993465472 00000100:00100000:3.0:1788986161.162392:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:3.0:1788986161.162402:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993465472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986161.162462:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993465472:12345-0@lo:400:kworker.0 Request processed in 62us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986161.162469:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:3.0:1788986161.162514:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993465344 00000100:00100000:3.0:1788986161.162519:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993465344 00000100:00100000:3.0:1788986161.162559:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993464960 00000100:00100000:3.0:1788986161.162563:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993464960 00000100:00100000:3.0:1788986161.162590:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993465088 00000100:00100000:3.0:1788986161.162593:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993465088 00000100:00100000:3.0:1788986161.162607:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1788986161.162614:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993465344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986161.162676:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993465344:12345-0@lo:400:kworker.0 Request processed in 61us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986161.162683:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1355 00000100:00100000:3.0:1788986161.162711:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1788986161.162715:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993465344:0@lo:400:kworker.0 00000100:00100000:3.0:1788986161.162726:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993464960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986161.162774:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993464960:12345-0@lo:400:kworker.0 Request processed in 49us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986161.162783:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:3.0:1788986161.162809:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:3.0:1788986161.162818:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993465088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986161.162997:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993465088:12345-0@lo:400:kworker.0 Request processed in 182us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986161.163003:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00080000:3.0:1788986161.163028:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986161.163033:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986161.163063:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993465088:0@lo:400:kworker.0 00000100:00100000:3.0:1788986161.163075:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993464960:0@lo:400:kworker.0 00000100:00100000:3.0:1788986161.163112:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993465472:0@lo:400:kworker.0 00000100:00100000:0.0:1788986161.163204:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993464832 00000100:00100000:0.0:1788986161.163214:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993464832 00000100:00100000:0.0:1788986161.163267:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:0.0:1788986161.163277:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993464832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986161.163347:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993464832:12345-0@lo:400:kworker.0 Request processed in 72us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986161.163356:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1788986161.163393:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79796680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993464832:0@lo:400:kworker.0 00000001:00080000:1.0:1788986161.244476:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967535 is committed 00000004:00080000:1.0:1788986161.244497:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 52 committed 00000100:00100000:1.0:1788986161.244728:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993465600:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788986161.244792:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986161.244860:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993465600 00000100:00100000:2.0:1788986161.244873:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993465600 00000100:00100000:2.0:1788986161.244943:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788986161.244954:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993465600:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788986161.244988:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:20 count 1 00010000:00010000:2.0:1788986161.245020:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986161.245048:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e36856b6/0xc20d828fcf5480b4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fc5 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986161.245057:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788986161.245063:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986161.245068:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986161.245134:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e36856b6/0xc20d828fcf5480b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fc5 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986161.245151:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e36856b6/0xc20d828fcf5480b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fc5 expref: 6 pid: 6697 timeout: 2045 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986161.245167:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993465728:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986161.245255:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0942afe240 going to sleep for 11 seconds 00000100:00100000:2.0:1788986161.264028:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986161.264150:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971239936 00000100:00100000:0.0:1788986161.264164:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971239936 00010000:00010000:0.0:1788986161.264229:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e36856b6/0xc20d828fcf5480b4 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fc5 expref: 7 pid: 6697 timeout: 2045 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986161.264266:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993465728:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986161.264280:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 355 00000100:00100000:0.0:1788986161.264295:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971239936:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986161.264310:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986161.264313:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.264320:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e36856b6/0xc20d828fcf5480b4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fc5 expref: 7 pid: 6697 timeout: 2045 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788986161.264426:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986161.265448:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e36856b6/0xc20d828fcf5480b4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fc5 expref: 7 pid: 6697 timeout: 2045 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.266634:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e36856b6/0xc20d828fcf5480b4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fc5 expref: 7 pid: 6697 timeout: 2045 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.266654:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986161.266658:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986161.266665:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.266675:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.266714:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986161.266840:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971239936:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 2548us (2826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986161.266850:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 355 00010000:00010000:3.0:1788986161.266948:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986161.266967:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986161.266980:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986161.266989:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986161.267022:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788986161.267051:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986161.267059:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.267069:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986161.267073:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.267084:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.267125:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.267134:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cc85b72/0xc20d828fcf5480d7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.267152:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986161.267154:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986161.267264:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986161.267849:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993465600:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22893us (23053us total) trans 4294967337 rc 0/0 00000100:00100000:3.0:1788986161.267862:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00000004:00080000:0.0:1788986161.267895:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b09413af480/2, rc 0, transno 4294967337 00000100:00100000:0.0:1788986161.267906:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993465600:0@lo:6:osp-syn-0-0.0 00000020:00000080:0.0:1788986161.602977:0:75465:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe10ff7ca0 20000000:00000080:0.0:1788986161.602992:0:75465:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0943180400 uarg=0000000000000000 00010000:00010000:0.0:1788986161.603717:0:75465:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788986161.603751:0:75465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986161.603755:0:75465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986161.603765:0:75465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548060 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fa9 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.603788:0:75465:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1788986161.603803:0:75465:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986161.603816:0:75465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.603828:0:75465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548044 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54803d expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.603837:0:75465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.603869:0:75465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548044 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54803d expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.603881:0:75465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548044 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54803d expref: 18 pid: 5849 timeout: 2045 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986161.604357:0:75465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75465:1875885993465856:0@lo:104: 00000100:00100000:0.0:1788986161.604417:0:75465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986161.604526:0:75465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788986161.605444:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993465856 00000100:00100000:2.0:1788986161.605453:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993465856 00000100:00100000:0.0:1788986161.605716:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788986161.605727:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:75465:x1875885993465856:12345-0@lo:104: 00010000:00010000:0.0:1788986161.605741:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548044 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986161.605811:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986161.605817:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:75465:x1875885993465856:12345-0@lo:104: Request processed in 94us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986161.605824:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788986161.605919:0:75465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75465:1875885993465856:0@lo:104: 00010000:00010000:3.0:1788986161.605940:0:75465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.605997:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986161.606004:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548044 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606011:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986161.606016:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548044 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606024:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548044 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986161.606031:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548044 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986161.606037:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986161.606077:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548044 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606084:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986161.606124:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548044 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606137:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54803d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548044 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606151:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986161.606153:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986161.606155:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986161.606166:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993465984:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986161.606200:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986161.606246:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993465984 00000100:00100000:1.0:1788986161.606263:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993465984 00010000:00010000:1.0:1788986161.606283:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548044 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54803d expref: 19 pid: 5849 timeout: 2045 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986161.606307:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788986161.606314:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993465984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986161.606323:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986161.606327:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548044 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54803d expref: 19 pid: 5849 timeout: 2045 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606338:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548044 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54803d expref: 19 pid: 5849 timeout: 2045 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606350:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548044 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54803d expref: 19 pid: 5849 timeout: 2045 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606363:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606374:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606388:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606394:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606400:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606406:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606411:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986161.606415:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606422:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606433:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986161.606441:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986161.606469:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993465984:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986161.606475:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788986161.606516:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993465984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986161.608110:0:75465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986161.608125:0:75465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986161.608137:0:75465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf5480de lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986161.665666:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986161.665693:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993466112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986161.665761:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986161.671139:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993466112 00000100:00100000:0.0:1788986161.671153:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993466112 00000100:00100000:0.0:1788986161.671206:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1788986161.671216:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993466112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986161.671363:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986161.671444:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993466112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 230us (5682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986161.671451:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 687 00000100:00100000:0.0:1788986161.671578:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993466112:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986162.115407:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788986162.758314:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967336 is committed 00000001:00080000:2.0:1788986162.758333:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967337 is committed 10000000:01000000:2.0:1788986162.823773:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986162.823782:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986162.823788:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986162.823835:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986162.823848:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986162.823860:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986162.823895:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993466240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986162.825339:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986162.825515:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993466240 00000100:00100000:0.0:1788986162.825524:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993466240 00000100:00100000:0.0:1788986162.825582:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1788986162.825593:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993466240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986162.825609:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986162.825625:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5480ec lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5480e5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986162.825650:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5480ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5480e5 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986162.825667:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5480ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5480e5 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986162.825675:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef000, rc 0) 00000100:00100000:0.0:1788986162.825718:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993466240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986162.825725:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1788986162.825895:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0942afe300 going to sleep for 11 seconds 00000100:00100000:0.0:1788986162.825921:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993466240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986162.825937:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5480ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986162.825945:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5480ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986162.825965:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986162.825970:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5480ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986162.825977:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5480ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986163.137270:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986163.314150:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986163.314207:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971240064 00000100:00100000:2.0:1788986163.314214:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986163.314219:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971240064 00000100:00100000:2.0:1788986163.314250:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986163.314282:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1124 00000100:00100000:3.0:1788986163.314293:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971240064:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986163.314316:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986163.314357:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971240320 00000100:00100000:3.0:1788986163.314359:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971240064:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986163.314364:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971240320 00000100:00100000:3.0:1788986163.314370:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1124 00000100:00100000:3.0:1788986163.314411:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971240192 00000100:00100000:2.0:1788986163.314413:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971240448 00000100:00100000:3.0:1788986163.314416:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971240192 00000100:00100000:2.0:1788986163.314419:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971240448 00000100:00100000:3.0:1788986163.314451:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1358 00000100:00100000:2.0:1788986163.314456:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 964 00000100:00100000:3.0:1788986163.314462:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971240192:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986163.314480:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971240320:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986163.314512:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971240192:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 53us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986163.314520:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971240320:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 53us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986163.314522:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1358 00000100:00100000:2.0:1788986163.314534:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 964 00000100:00100000:2.0:1788986163.314554:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 341 00000100:00100000:2.0:1788986163.314561:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971240448:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:2.0:1788986163.314580:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf547f41 00000100:00080000:2.0:1788986163.314591:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9b0a489e8000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788986163.314629:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967335 00000100:00080000:3.0:1788986163.314646:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986163.314652:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986163.314654:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986163.314677:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986163.317387:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971240448:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 2817us (3062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986163.317400:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 341 00010000:00010000:2.0:1788986164.160895:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986164.323736:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986164.323794:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971240576 00000100:00100000:0.0:1788986164.323803:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971240576 00000100:00100000:0.0:1788986164.323867:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 636 00000100:00100000:0.0:1788986164.323877:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43735:x1875885971240576:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986164.323894:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986164.323916:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5480f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0fcc expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986164.323974:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986164.323987:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986164.323999:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986164.324032:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:0.0:1788986164.324036:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986164.325989:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986164.326028:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5480f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fcc expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986164.326061:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fcc expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986164.326069:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:0.0:1788986164.326072:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986164.326075:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee800, rc 0) 00000100:00100000:0.0:1788986164.326784:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43735:x1875885971240576:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 2906us (3053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986164.326793:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 636 00000100:00100000:3.0:1788986164.329707:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986164.329789:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971240832 00000100:00100000:0.0:1788986164.329798:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971240832 00000100:00100000:0.0:1788986164.329949:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 637 00000100:00100000:0.0:1788986164.329960:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43735:x1875885971240832:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788986164.330005:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986164.330028:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5480fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fcc expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986164.330044:0:5855:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf548060) 00010000:00010000:0.0:1788986164.330048:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:0.0:1788986164.330058:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986164.330079:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548101 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986164.330118:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986164.330129:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986164.330411:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000095b5e73f reply state 0000000041d0c1b2 transno 4294967536 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986164.330421:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788986164.330428:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000100:00100000:0.0:1788986164.330515:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43735:x1875885971240832:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 557us (816us total) trans 4294967536 rc 0/0 00000100:00100000:0.0:1788986164.330523:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 637 00010000:00010000:2.0:1788986164.333050:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548101 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986164.333065:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548101 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986164.333078:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986164.333084:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986164.333106:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548101 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986164.333114:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548101 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986164.333129:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:2.0:1788986164.333132:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986164.333137:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548101 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986164.333143:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548101 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788986165.050553:0:75662:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc842e30f0 20000000:00000080:0.0:1788986165.050569:0:75662:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0943183400 uarg=0000000000000000 00010000:00010000:0.0:1788986165.051002:0:75662:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986165.051018:0:75662:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986165.051029:0:75662:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986165.051046:0:75662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986165.051061:0:75662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5480ec lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5480e5 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986165.051068:0:75662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986165.051122:0:75662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5480ec lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5480e5 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986165.051135:0:75662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5480ec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5480e5 expref: 18 pid: 5848 timeout: 2048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986165.051149:0:75662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75662:1875885993466368:0@lo:104: 00000100:00100000:0.0:1788986165.051209:0:75662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986165.051259:0:75662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eac840 going to sleep for 11 seconds 00000100:00100000:2.0:1788986165.051288:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993466368 00000100:00100000:2.0:1788986165.051296:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993466368 00000100:00100000:2.0:1788986165.051344:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:2.0:1788986165.051353:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:75662:x1875885993466368:12345-0@lo:104: 00010000:00010000:2.0:1788986165.051366:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5480ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986165.051433:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986165.051439:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:75662:x1875885993466368:12345-0@lo:104: Request processed in 88us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986165.051446:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00010000:00010000:3.0:1788986165.051499:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986165.051507:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5480ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986165.051514:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986165.051518:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5480ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986165.051524:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5480ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986165.051531:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5480ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986165.051535:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986165.051569:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5480ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986165.051576:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986165.051601:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5480ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986165.051608:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf5480e5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5480ec expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986165.051624:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986165.051627:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986165.051629:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986165.051636:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986165.051647:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993466496:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986165.051677:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986165.051741:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993466496 00000100:00100000:2.0:1788986165.051746:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993466496 00010000:00010000:2.0:1788986165.051781:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5480ec lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5480e5 expref: 19 pid: 5848 timeout: 2048 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986165.051809:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788986165.051816:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993466496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986165.051826:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986165.051831:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5480ec lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5480e5 expref: 19 pid: 5848 timeout: 2048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986165.051841:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5480ec lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5480e5 expref: 19 pid: 5848 timeout: 2048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986165.051857:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986165.051865:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986165.051878:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986165.051887:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986165.051899:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986165.051905:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986165.051910:0:75662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5480ec lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5480e5 expref: 19 pid: 5848 timeout: 2048 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986165.051913:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986165.051919:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986165.051934:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986165.051934:0:75662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:75662:1875885993466368:0@lo:104: 00010000:00010000:2.0:1788986165.051949:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986165.051954:0:75662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986165.051960:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986165.051967:0:75662:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986165.051974:0:75662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986165.051982:0:75662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548108 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 75662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986165.052002:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993466496:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986165.052009:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788986165.052865:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993466496:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986165.193534:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986165.248436:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986165.248469:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993466624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986165.248539:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986165.248646:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993466624 00000100:00100000:1.0:1788986165.248654:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993466624 00000100:00100000:1.0:1788986165.248714:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 688 00000100:00100000:1.0:1788986165.248724:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993466624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986165.248755:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986165.248801:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993466624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986165.248808:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 688 00000100:00080000:2.0:1788986165.248867:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986165.248900:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967337 gen 2 00000004:00080000:2.0:1788986165.248906:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b09413af480, transno 4294967337 00000100:00100000:2.0:1788986165.248942:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993466624:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986166.209903:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986166.274838:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993467136:0@lo:400:kworker.0 00000100:00100000:3.0:1788986166.274897:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986166.274960:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986166.274967:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993467008:0@lo:400:kworker.0 00000100:00100000:3.0:1788986166.274993:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986166.275022:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993467136 00000100:00100000:3.0:1788986166.275030:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993467136 00000100:00100000:3.0:1788986166.275071:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1788986166.275079:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993467136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986166.275153:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993467136:12345-0@lo:400:kworker.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986166.275160:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1788986166.275180:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993467008 00000100:00100000:3.0:1788986166.275184:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993467008 00000100:00100000:3.0:1788986166.275215:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1788986166.275221:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993467008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986166.275249:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993467008:12345-0@lo:400:kworker.0 Request processed in 28us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986166.275254:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1359 00000100:00100000:3.0:1788986166.275290:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993467008:0@lo:400:kworker.0 00000100:00100000:3.0:1788986166.275301:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993467136:0@lo:400:kworker.0 00000100:00080000:3.0:1788986166.275323:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986166.275425:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993466880:0@lo:400:kworker.0 00000100:00100000:1.0:1788986166.275466:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986166.275501:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993467392:0@lo:400:kworker.0 00000100:00100000:1.0:1788986166.275524:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986166.275543:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788986166.275548:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993466752:0@lo:400:kworker.0 00000100:00100000:1.0:1788986166.275575:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986166.275598:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993467264:0@lo:400:kworker.0 00000100:00100000:1.0:1788986166.275619:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986166.275646:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993467392 00000100:00100000:1.0:1788986166.275650:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993467392 00000100:00100000:1.0:1788986166.275682:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:1.0:1788986166.275689:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993467392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986166.275724:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993467392:12345-0@lo:400:kworker.0 Request processed in 36us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986166.275729:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:1.0:1788986166.275750:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993466752 00000100:00100000:1.0:1788986166.275754:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993466752 00000100:00100000:1.0:1788986166.275779:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1788986166.275785:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993466752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986166.275812:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993466752:12345-0@lo:400:kworker.0 Request processed in 28us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986166.275818:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1788986166.275842:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993466880 00000100:00100000:1.0:1788986166.275846:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993466880 00000100:00100000:1.0:1788986166.275867:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993467264 00000100:00100000:1.0:1788986166.275870:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993467264 00000100:00100000:1.0:1788986166.275888:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1788986166.275894:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993466880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986166.275921:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993466880:12345-0@lo:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986166.275926:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00100000:1.0:1788986166.275937:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:1.0:1788986166.275942:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993467264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986166.275964:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993467264:12345-0@lo:400:kworker.0 Request processed in 22us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986166.275969:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00000100:00080000:1.0:1788986166.275982:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986166.275985:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986166.276014:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993466752:0@lo:400:kworker.0 00000100:00100000:1.0:1788986166.276024:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993467264:0@lo:400:kworker.0 00000100:00100000:1.0:1788986166.276031:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993466880:0@lo:400:kworker.0 00000100:00100000:1.0:1788986166.276039:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993467392:0@lo:400:kworker.0 00000001:00080000:0.0:1788986166.319231:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967536 is committed 10000000:01000000:0.0:1788986166.537388:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986166.537396:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986166.537400:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986166.537448:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986166.537471:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986166.537482:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986166.537508:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993467520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986166.537574:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986166.537672:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09427c4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788986166.542571:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993467520 00000100:00100000:3.0:1788986166.542584:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993467520 00000100:00100000:3.0:1788986166.542641:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1788986166.542651:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993467520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986166.542666:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986166.542685:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548116 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54810f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986166.542711:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548116 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54810f expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986166.542722:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548116 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54810f expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986166.542731:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2600, rc 0) 00000100:00100000:3.0:1788986166.542805:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993467520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (5230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986166.542812:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:3.0:1788986166.542865:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe42a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993467520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986166.542882:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548116 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986166.542891:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548116 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986166.542912:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986166.542917:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548116 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986166.542939:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548116 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986166.786112:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986166.786138:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993467648:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986166.786208:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986166.786273:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993467648 00000100:00100000:3.0:1788986166.786280:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993467648 00000100:00100000:3.0:1788986166.788053:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 689 00000100:00100000:3.0:1788986166.788075:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4515a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993467648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986166.788132:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986166.788219:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4515a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993467648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 154us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986166.788226:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 689 00000100:00100000:0.0:1788986166.789082:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993467648:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986167.232434:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986167.514776:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986167.515275:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971240960 00000100:00100000:2.0:1788986167.515290:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971240960 00000100:00100000:2.0:1788986167.515377:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 638 00000100:00100000:2.0:1788986167.515388:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43820:x1875885971240960:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986167.515503:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43820:x1875885971240960:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 117us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986167.515510:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 638 00000100:00080000:1.0:1788986167.515586:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986167.517275:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986167.517365:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971241088 00000100:00100000:0.0:1788986167.517378:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971241088 00000100:00100000:0.0:1788986167.517466:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 342 00000100:00100000:0.0:1788986167.517478:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43820:x1875885971241088:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986167.517839:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43820:x1875885971241088:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 363us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986167.517848:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 342 00000100:00080000:1.0:1788986167.517994:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986167.525317:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986167.526981:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971241216 00000100:00100000:1.0:1788986167.526994:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971241216 00000100:00100000:1.0:1788986167.527054:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 343 00000100:00100000:1.0:1788986167.527062:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875885971241216:12345-192.168.206.21@tcp:8:lfs.60003 00010000:00080000:1.0:1788986167.527129:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 1951 last 0 00000020:00000080:1.0:1788986167.527162:0:6697:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf54811d 00002000:00100000:1.0:1788986167.527173:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b0a489ed000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788986167.527185:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788986167.527279:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788986167.527310:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b0a489e9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788986167.527377:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971241216:12345-192.168.206.21@tcp:8:lfs.60003 Request processed in 314us (2069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986167.527385:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 343 00000100:00100000:3.0:1788986167.533078:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986167.533532:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971241344 00000100:00100000:0.0:1788986167.533547:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971241344 00000100:00100000:0.0:1788986167.533685:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 344 00000100:00100000:0.0:1788986167.533699:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43820:x1875885971241344:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986167.534189:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43820:x1875885971241344:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 492us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986167.534198:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 344 00000100:00080000:1.0:1788986167.535390:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986167.535910:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986167.536050:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971241472 00000100:00100000:1.0:1788986167.536060:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971241472 00000100:00100000:1.0:1788986167.536200:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 639 00000100:00100000:1.0:1788986167.536213:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43820:x1875885971241472:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986167.536777:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43820:x1875885971241472:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 565us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986167.536786:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 639 00000100:00100000:2.0:1788986167.541623:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986167.541791:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971241600 00000100:00100000:3.0:1788986167.541804:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971241600 00000100:00100000:3.0:1788986167.541911:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 640 00000100:00100000:3.0:1788986167.541934:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43820:x1875885971241600:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986167.542083:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43820:x1875885971241600:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 151us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986167.542137:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 640 00000100:00100000:2.0:1788986167.544754:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986167.544976:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971241728 00000100:00100000:1.0:1788986167.544985:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971241728 00000100:00100000:1.0:1788986167.545067:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 345 00000100:00100000:1.0:1788986167.545085:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43820:x1875885971241728:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986167.545496:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43820:x1875885971241728:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 411us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986167.545504:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 345 00000100:00100000:0.0:1788986167.549710:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986167.549988:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971241856 00000100:00100000:3.0:1788986167.550004:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971241856 00000100:00100000:0.0:1788986167.550128:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 346 00000100:00100000:0.0:1788986167.550148:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43820:x1875885971241856:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986167.550595:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43820:x1875885971241856:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 455us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986167.550603:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 346 00000100:00100000:0.0:1788986167.552621:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986167.556496:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971241984 00000100:00100000:3.0:1788986167.556518:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971241984 00000100:00100000:3.0:1788986167.556741:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 641 00000100:00100000:3.0:1788986167.556755:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43820:x1875885971241984:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986167.557819:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43820:x1875885971241984:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 1062us (5205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986167.557830:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 641 00000100:00100000:2.0:1788986167.605907:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986167.607678:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971242112 00000100:00100000:1.0:1788986167.607695:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971242112 00000100:00100000:0.0:1788986167.608041:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 642 00000100:00100000:0.0:1788986167.608055:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:43824:x1875885971242112:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:0.0:1788986167.608082:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986167.608133:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548124 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0fd3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.608339:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54812b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.608364:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54812b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.608382:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54812b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.608401:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548132 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.608482:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.608492:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609003:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf548139 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609013:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf548139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609021:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf548139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986167.609047:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:0.0:1788986167.609051:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986167.609076:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf548139 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609192:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54812b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609205:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54812b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609212:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54812b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609341:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986167.609347:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54812b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609356:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54812b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609371:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:0.0:1788986167.609374:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986167.609380:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54812b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609387:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54812b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609466:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548132 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609474:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548132 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609480:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548132 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609486:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986167.609490:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548132 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609496:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548132 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609505:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a4823b800) 00010000:00010000:0.0:1788986167.609507:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986167.609510:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548132 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609515:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548132 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609558:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548124 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fd3 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609576:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf548139 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fd3 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986167.609584:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:0.0:1788986167.609587:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986167.609589:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef800, rc 0) 00000100:00100000:0.0:1788986167.609681:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43824:x1875885971242112:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 1628us (3788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986167.609690:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 642 00000100:00100000:0.0:1788986167.612359:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986167.612527:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971242368 00000100:00100000:3.0:1788986167.612540:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971242368 00000100:00100000:3.0:1788986167.612604:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 643 00000100:00100000:3.0:1788986167.612616:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43824:x1875885971242368:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:3.0:1788986167.612641:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986167.612666:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548140 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0fda expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986167.613006:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548147 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986167.613026:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986167.613040:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986167.613059:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54814e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986167.613067:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54814e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986167.613074:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54814e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986167.614942:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x14:0x0], index 1: 0 00010000:00010000:2.0:1788986167.615575:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548155 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.615596:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.615610:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.615658:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548147 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.615667:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548147 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.615674:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548147 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.615681:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986167.615686:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548147 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.615695:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548147 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.615709:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:2.0:1788986167.615712:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986167.615718:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548147 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.615724:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548147 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986167.615764:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000eba4e4aa reply state 000000003de3e999 transno 4294967537 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54814e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986167.615775:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986167.615819:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548140 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fda expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.615838:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fda expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.615847:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986167.615850:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986167.615852:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0200, rc 0) 00000100:00100000:2.0:1788986167.616014:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:43824:x1875885971242368:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 3399us (3666us total) trans 4294967537 rc 0/0 00000100:00100000:2.0:1788986167.616024:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 643 00010000:00010000:3.0:1788986167.618620:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54814e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986167.618642:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54814e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986167.618650:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54814e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986167.618656:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986167.618662:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54814e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986167.618670:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54814e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986167.618688:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a55745500) 00010000:00010000:3.0:1788986167.618692:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986167.618697:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54814e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986167.618704:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54814e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986167.622604:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986167.622801:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971242496 00000100:00100000:2.0:1788986167.622814:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971242496 00000100:00100000:2.0:1788986167.622893:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 347 00000100:00100000:2.0:1788986167.622907:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:43824:x1875885971242496:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:2.0:1788986167.623571:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986167.623603:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf548163 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0fe1 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788986167.623641:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788986167.623672:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=1951s v=(0 0) 00010000:00010000:2.0:1788986167.623678:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986167.623690:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf548163 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fe1 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.623712:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf548163 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fe1 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986167.623729:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788986167.623807:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43824:x1875885971242496:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 904us (1216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986167.623816:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 347 00000100:00100000:2.0:1788986167.641999:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986167.644333:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971242624 00000100:00100000:3.0:1788986167.644347:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971242624 00002000:00100000:2.0:1788986167.644547:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x14:0x0] (0->1048575) req@ffff9b0a79795500 x1875885971242624/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:88/0 lens 488/0 e 0 to 0 dl 1788986178 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1788986167.644559:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a79795500 with x1875885971242624 ext(0->1048575) 00002000:00010000:2.0:1788986167.644565:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a79795500 00000100:00100000:2.0:1788986167.644593:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:2.0:1788986167.644603:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971242624:12345-192.168.206.21@tcp:4:dd.60003 00000001:00100000:0.0:1788986167.700559:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000001:00100000:0.0:1788986167.700575:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:0.0:1788986167.700579:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b0a489ed800/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:3.0:1788986167.700635:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a489ed800/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0001 00000020:00000080:3.0:1788986167.700695:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a489e8000 for lustre-OST0001 00000100:00100000:2.0:1788986167.706619:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971242624:12345-192.168.206.21@tcp:4:dd.60003 Request processed in 62006us (64617us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1788986167.706634:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00002000:00100000:2.0:1788986167.706648:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x14:0x0] (0->1048575) req@ffff9b0a79795500 x1875885971242624/t4294967336(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:88/0 lens 488/448 e 0 to 0 dl 1788986178 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1788986167.706668:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a79795500 with x1875885971242624 ext(0->1048575) 00002000:00010000:2.0:1788986167.706676:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a79795500 00000100:00100000:3.0:1788986167.711643:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986167.712078:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971242752 00000100:00100000:1.0:1788986167.712116:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971242752 00000100:00100000:1.0:1788986167.712168:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 644 00000100:00100000:1.0:1788986167.712178:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:43824:x1875885971242752:12345-192.168.206.21@tcp:44:dd.60003 00000100:00100000:1.0:1788986167.742629:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:43824:x1875885971242752:12345-192.168.206.21@tcp:44:dd.60003 Request processed in 30443us (30984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986167.742643:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 644 00000001:00080000:0.0:1788986167.742940:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967537 is committed 00000100:00100000:0.0:1788986167.748222:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986167.748323:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971242880 00000100:00100000:3.0:1788986167.748333:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971242880 00000100:00100000:3.0:1788986167.748550:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 348 00000100:00100000:3.0:1788986167.748561:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971242880:12345-192.168.206.21@tcp:16:dd.60003 00000001:00080000:3.0:1788986167.778223:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967336 is committed 00000100:00100000:1.0:1788986167.778437:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971242880:12345-192.168.206.21@tcp:16:dd.60003 Request processed in 29873us (30219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986167.778458:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 348 00000100:00100000:3.0:1788986167.781012:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986167.781138:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971243136 00000100:00100000:1.0:1788986167.781154:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971243136 00000100:00100000:1.0:1788986167.781233:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 65 00000100:00100000:1.0:1788986167.781244:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:43824:x1875885971243136:12345-192.168.206.21@tcp:35:dd.60003 00000100:00100000:1.0:1788986167.781695:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:43824:x1875885971243136:12345-192.168.206.21@tcp:35:dd.60003 Request processed in 452us (703us total) trans 4294967538 rc 0/0 00000100:00100000:1.0:1788986167.781703:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 65 00010000:00010000:0.0:1788986168.258342:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986168.434046:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986168.434149:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986168.434201:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971243392 00000100:00100000:3.0:1788986168.434210:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971243392 00000100:00100000:1.0:1788986168.434212:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971243264 00000100:00100000:1.0:1788986168.434215:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971243264 00000100:00100000:3.0:1788986168.434254:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 967 00000100:00100000:1.0:1788986168.434257:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1127 00000100:00100000:3.0:1788986168.434264:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971243392:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986168.434264:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971243264:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986168.434378:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971243264:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 113us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986168.434394:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1127 00000100:00100000:2.0:1788986168.439339:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971243392:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5066us (5178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986168.439354:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 967 00000001:00080000:2.0:1788986168.935471:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967538 is committed 00010000:00010000:0.0:1788986169.280276:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788986170.202989:0:75908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1954105897635ns, next at 1944841591208ns, rc = 0 00000004:00080000:2.0:1788986170.203173:0:75908:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1954106082318ns, next at 1906821904053ns, rc = 0 00000004:00080000:1.0:1788986170.210488:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 53 committed 00000004:00080000:1.0:1788986170.210508:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 53 committed 00010000:00010000:0.0:1788986170.307910:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986170.368257:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986170.368280:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993467776:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986170.368425:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986170.373891:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993467776 00000100:00100000:2.0:1788986170.373905:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993467776 00000100:00100000:2.0:1788986170.373974:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 690 00000100:00100000:2.0:1788986170.373986:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993467776:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986170.374002:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1788986170.374028:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986170.374140:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993467776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (5715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986170.374147:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 690 00000100:00100000:0.0:1788986170.374356:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993467776:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986171.329836:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986171.393233:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993468032:0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.393325:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986171.393387:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993468544:0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.393413:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986171.393452:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788986171.393458:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993467904:0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.393488:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986171.393512:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993468416:0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.393533:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986171.393559:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993468160:0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.393580:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986171.393599:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986171.393605:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993468288:0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.393626:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986171.393656:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993468032 00000100:00100000:3.0:1788986171.393664:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993468032 00000100:00100000:3.0:1788986171.393703:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993468416 00000100:00100000:3.0:1788986171.393708:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993468416 00000100:00100000:3.0:1788986171.393733:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993468160 00000100:00100000:3.0:1788986171.393735:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993468160 00000100:00100000:3.0:1788986171.393751:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:3.0:1788986171.393758:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993468032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.393807:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993468032:12345-0@lo:400:kworker.0 Request processed in 49us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986171.393831:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:3.0:1788986171.393848:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1363 00000100:00100000:3.0:1788986171.393855:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993468416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.393883:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993468416:12345-0@lo:400:kworker.0 Request processed in 30us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986171.393888:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1363 00000100:00100000:3.0:1788986171.393912:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:3.0:1788986171.393918:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993468160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.393949:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993468160:12345-0@lo:400:kworker.0 Request processed in 32us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986171.393955:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00100000:3.0:1788986171.393976:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993468544 00000100:00100000:3.0:1788986171.393979:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993468544 00000100:00100000:3.0:1788986171.394005:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993468288 00000100:00100000:3.0:1788986171.394008:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993468288 00000100:00100000:3.0:1788986171.394024:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1788986171.394030:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993468544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.394059:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993468544:12345-0@lo:400:kworker.0 Request processed in 29us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986171.394068:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1788986171.394080:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1788986171.394086:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993468288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.394148:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993468288:12345-0@lo:400:kworker.0 Request processed in 62us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986171.394153:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1788986171.394171:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993467904 00000100:00100000:3.0:1788986171.394174:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993467904 00000100:00100000:3.0:1788986171.394196:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1788986171.394202:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993467904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.394231:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993467904:12345-0@lo:400:kworker.0 Request processed in 29us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986171.394236:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00080000:3.0:1788986171.394268:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986171.394273:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986171.394297:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993467904:0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.394309:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993468416:0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.394317:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993468032:0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.394325:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993468544:0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.394352:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993468288:0@lo:400:kworker.0 00000100:00100000:3.0:1788986171.394360:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993468160:0@lo:400:kworker.0 00000100:00100000:2.0:1788986171.692022:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986171.692510:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971243520 00000100:00100000:3.0:1788986171.692524:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971243520 00000100:00100000:3.0:1788986171.692727:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 645 00000100:00100000:3.0:1788986171.692737:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:44016:x1875885971243520:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00080000:1.0:1788986171.693031:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986171.693235:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:44016:x1875885971243520:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 497us (1227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986171.693243:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 645 00000100:00100000:0.0:1788986171.704614:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986171.704751:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971243648 00000100:00100000:3.0:1788986171.704764:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971243648 00000100:00100000:3.0:1788986171.704860:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 349 00000100:00100000:3.0:1788986171.704872:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:44016:x1875885971243648:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00080000:1.0:1788986171.705146:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986171.705369:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:44016:x1875885971243648:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 498us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986171.705379:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 349 00000100:00100000:0.0:1788986171.708186:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986171.708277:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971243776 00000100:00100000:3.0:1788986171.708288:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971243776 00000100:00100000:3.0:1788986171.708391:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 350 00000100:00100000:3.0:1788986171.708404:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44016:x1875885971243776:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00080000:0.0:1788986171.708796:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986171.715950:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44016:x1875885971243776:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 7532us (7759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986171.715969:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 350 00000100:00100000:1.0:1788986171.721284:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986171.721379:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971243904 00000100:00100000:3.0:1788986171.721402:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971243904 00000100:00100000:3.0:1788986171.721483:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 646 00000100:00100000:3.0:1788986171.721502:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:44016:x1875885971243904:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986171.722201:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:44016:x1875885971243904:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 707us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986171.722211:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 646 00000100:00100000:0.0:1788986171.726241:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986171.726302:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971244032 00000100:00100000:3.0:1788986171.726315:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971244032 00000100:00100000:3.0:1788986171.726395:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 647 00000100:00100000:3.0:1788986171.726407:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:44016:x1875885971244032:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986171.726567:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:44016:x1875885971244032:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 162us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986171.726575:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 647 00000100:00100000:0.0:1788986171.728840:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986171.728927:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971244160 00000100:00100000:3.0:1788986171.728938:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971244160 00000100:00100000:3.0:1788986171.728998:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 351 00000100:00100000:3.0:1788986171.729014:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:44016:x1875885971244160:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986171.731755:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:44016:x1875885971244160:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 2730us (2912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986171.731772:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 351 00000100:00100000:2.0:1788986171.735060:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986171.735141:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971244288 00000100:00100000:3.0:1788986171.735154:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971244288 00000100:00100000:3.0:1788986171.735226:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 352 00000100:00100000:3.0:1788986171.735238:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44016:x1875885971244288:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986171.735753:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44016:x1875885971244288:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 515us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986171.735763:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 352 00000100:00100000:0.0:1788986171.744572:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986171.752270:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971244416 00000100:00100000:1.0:1788986171.752294:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971244416 00000100:00100000:2.0:1788986171.753757:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 648 00000100:00100000:2.0:1788986171.753773:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:44016:x1875885971244416:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986171.755660:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:44016:x1875885971244416:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 1878us (11087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986171.755676:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 648 00000100:00100000:0.0:1788986171.824857:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986171.825526:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971244672 00000100:00100000:3.0:1788986171.825540:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971244672 00000100:00100000:3.0:1788986171.825610:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 649 00000100:00100000:3.0:1788986171.825623:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:44020:x1875885971244672:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:3.0:1788986171.825702:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986171.825738:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548155 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fda expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.825761:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:3.0:1788986171.825775:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986171.825806:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54816a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.825823:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54816a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.825834:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54816a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.825850:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548171 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.825857:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.825874:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.826458:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548178 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.826470:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548178 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.826477:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548178 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788986171.827707:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].20, 64 off9472 00000004:00080000:0.0:1788986171.827719:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1955730629020ns, next at 1956730625998ns, rc = 0 00010000:00010000:0.0:1788986171.827820:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54817f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.827835:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54817f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.827846:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54817f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.827854:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54817f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.827862:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54817f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.827869:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54817f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.827987:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788986171.828019:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548178 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828025:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548178 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828032:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548178 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828037:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986171.828042:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548178 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828051:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548178 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828063:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:0.0:1788986171.828066:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788986171.828071:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548178 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828077:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548178 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x35:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828259:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54816a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828268:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54816a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828274:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54816a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828279:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986171.828282:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54816a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828288:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54816a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828296:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:0.0:1788986171.828298:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986171.828301:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54816a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986171.828307:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54816a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x30:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986171.828319:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000005553196 reply state 000000001993f50a transno 4294967539 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986171.828328:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986171.828436:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:44020:x1875885971244672:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 2801us (3584us total) trans 4294967539 rc 0/0 00000100:00100000:0.0:1788986171.828445:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 649 00010000:00010000:3.0:1788986171.833249:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986171.833270:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54817f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.833283:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986171.833289:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54817f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.833302:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54817f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.833324:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x35:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986171.833327:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986171.833333:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54817f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.833340:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54817f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x35:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986171.833369:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986171.833371:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986171.833373:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986171.833770:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548171 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986171.833788:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548171 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986171.833796:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548171 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986171.833801:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986171.833806:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548171 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986171.833813:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548171 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986171.833828:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0xa8fa037c (ffff9b0a55745100) 00010000:00010000:2.0:1788986171.833831:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986171.833837:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548171 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986171.833842:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548171 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x30:0x0].0xa8fa037c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986171.908282:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993468672:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986171.908385:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986171.908508:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993468672 00000100:00100000:2.0:1788986171.908523:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993468672 00000100:00100000:2.0:1788986171.908599:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 691 00000100:00100000:2.0:1788986171.908609:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993468672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986171.908645:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788986171.908747:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993468672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986171.908754:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 691 00000100:00100000:0.0:1788986171.908815:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993468672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986172.358509:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986173.376905:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986173.552527:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986173.552566:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986173.552597:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986173.552623:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986173.552654:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971245056 00000100:00100000:1.0:1788986173.552663:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971245056 00000100:00100000:1.0:1788986173.552713:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971245184 00000100:00100000:1.0:1788986173.552716:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971245184 00000100:00100000:1.0:1788986173.552734:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 970 00000100:00100000:1.0:1788986173.552743:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971245056:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986173.552804:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971245056:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 62us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986173.552811:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 970 00000100:00100000:1.0:1788986173.552827:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 971 00000100:00100000:1.0:1788986173.552833:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971245184:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986173.552858:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971245184:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986173.552865:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 971 00000100:00080000:1.0:1788986173.552899:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986173.552903:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986173.553363:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971244800 00000100:00100000:3.0:1788986173.553369:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971244800 00000100:00100000:3.0:1788986173.553400:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1129 00000100:00100000:3.0:1788986173.553407:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971244800:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986173.553448:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971244800:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986173.553454:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1129 00000100:00100000:2.0:1788986173.553558:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971244928 00000100:00100000:2.0:1788986173.553563:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971244928 00000100:00100000:2.0:1788986173.553600:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1365 00000100:00100000:2.0:1788986173.553607:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971244928:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986173.553642:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971244928:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986173.553649:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1365 00000100:00080000:3.0:1788986173.553947:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1788986174.090861:0:76052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 1957993768973ns, next at 1944841591208ns, rc = 0 00000004:00080000:2.0:1788986174.090960:0:76052:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 1957993870265ns, next at 1956730625998ns, rc = 0 00000004:00080000:0.0:1788986174.136571:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 55 committed 00000004:00080000:0.0:1788986174.136592:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 54 committed 00000100:00100000:0.0:1788986174.136735:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993468800:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788986174.136948:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986174.137028:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993468800 00000100:00100000:0.0:1788986174.137035:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993468800 00000100:00100000:0.0:1788986174.137105:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:0.0:1788986174.137114:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993468800:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788986174.137138:0:8478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:20 count 1 00010000:00010000:0.0:1788986174.137162:0:8478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986174.137182:0:8478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf548163 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fe1 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986174.137191:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x14:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1788986174.137196:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986174.137200:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986174.137228:0:8478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf548163 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fe1 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986174.137242:0:8478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf548163 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fe1 expref: 5 pid: 6695 timeout: 2058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986174.137253:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8478:1875885993468928:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986174.137441:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09429d0a80 going to sleep for 11 seconds 00000001:00080000:0.0:1788986174.137581:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967539 is committed 00000004:00080000:0.0:1788986174.137586:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 54 committed 00000100:00080000:3.0:1788986174.138672:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986174.140541:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986174.140620:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8478:1875885993468928:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788986174.140646:0:8478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986174.140885:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971245312 00000100:00100000:3.0:1788986174.140893:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971245312 00010000:00010000:3.0:1788986174.140929:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf548163 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fe1 expref: 6 pid: 6695 timeout: 2058 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986174.141010:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 358 00000100:00100000:3.0:1788986174.141021:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971245312:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986174.141035:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986174.141042:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf548163 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fe1 expref: 6 pid: 6695 timeout: 2058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986174.141054:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf548163 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fe1 expref: 6 pid: 6695 timeout: 2058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986174.141076:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf548163 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fe1 expref: 6 pid: 6695 timeout: 2058 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986174.141132:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986174.141137:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986174.141142:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986174.141151:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986174.141177:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986174.141228:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971245312:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 210us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986174.141240:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 358 00010000:00010000:0.0:1788986174.141422:0:8478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986174.141432:0:8478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986174.141441:0:8478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986174.141449:0:8478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986174.141473:0:8478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788986174.142235:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993468800:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5122us (5287us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1788986174.142244:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000004:00080000:0.0:1788986174.142291:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b09413af480/2, rc 0, transno 4294967337 00000100:00100000:0.0:1788986174.142301:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993468800:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788986174.142376:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986174.142384:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986174.142393:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986174.142397:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986174.142406:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986174.142436:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986174.142448:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf548186 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986174.142468:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986174.142470:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986174.142472:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986174.400298:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986175.424937:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986175.492614:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986175.492636:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993469056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986175.492703:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986175.492865:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993469056 00000100:00100000:0.0:1788986175.492874:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993469056 00000100:00100000:0.0:1788986175.492984:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 692 00000100:00100000:0.0:1788986175.492994:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993469056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986175.493027:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986175.493069:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993469056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986175.493076:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 692 00000100:00080000:2.0:1788986175.493246:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986175.493292:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993469056:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986176.451754:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986176.521696:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993469568:0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.521791:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986176.521879:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788986176.521886:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993469184:0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.521922:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986176.521950:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993469696:0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.521978:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986176.522009:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993469312:0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522035:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986176.522054:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993469824:0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522117:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986176.522140:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986176.522146:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993469440:0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522171:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986176.522204:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993469568 00000100:00100000:1.0:1788986176.522214:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993469568 00000100:00100000:1.0:1788986176.522268:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993469824 00000100:00100000:1.0:1788986176.522271:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993469824 00000100:00100000:1.0:1788986176.522307:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:1.0:1788986176.522318:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993469568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522380:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993469568:12345-0@lo:400:kworker.0 Request processed in 63us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986176.522388:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:1.0:1788986176.522420:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:1.0:1788986176.522428:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993469824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522462:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993469824:12345-0@lo:400:kworker.0 Request processed in 35us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986176.522468:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:1.0:1788986176.522488:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993469184 00000100:00100000:1.0:1788986176.522493:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993469184 00000100:00100000:1.0:1788986176.522521:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1788986176.522528:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993469184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522561:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993469184:12345-0@lo:400:kworker.0 Request processed in 33us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986176.522567:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1788986176.522602:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993469696 00000100:00100000:1.0:1788986176.522606:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993469696 00000100:00100000:1.0:1788986176.522638:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993469312 00000100:00100000:1.0:1788986176.522641:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993469312 00000100:00100000:1.0:1788986176.522657:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993469440 00000100:00100000:1.0:1788986176.522659:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993469440 00000100:00100000:1.0:1788986176.522674:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:1.0:1788986176.522679:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993469696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522707:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993469696:12345-0@lo:400:kworker.0 Request processed in 28us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986176.522713:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:1.0:1788986176.522723:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:1.0:1788986176.522728:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993469312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522752:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993469312:12345-0@lo:400:kworker.0 Request processed in 25us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986176.522758:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:1.0:1788986176.522768:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1368 00000100:00100000:1.0:1788986176.522774:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993469440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522798:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993469440:12345-0@lo:400:kworker.0 Request processed in 25us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986176.522804:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1368 00000100:00080000:1.0:1788986176.522828:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986176.522833:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986176.522872:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993469440:0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522883:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993469312:0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522891:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993469824:0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522932:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993469184:0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522943:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993469696:0@lo:400:kworker.0 00000100:00100000:1.0:1788986176.522952:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993469568:0@lo:400:kworker.0 00000100:00100000:0.0:1788986177.030279:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993469952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986177.030352:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986177.030424:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993469952 00000100:00100000:0.0:1788986177.030431:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993469952 00000100:00100000:0.0:1788986177.030478:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1788986177.030487:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993469952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986177.030515:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986177.030560:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993469952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986177.030567:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 693 00000100:00100000:0.0:1788986177.030616:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993469952:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788986177.132804:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967337 is committed 00010000:00010000:2.0:1788986177.473211:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986178.496542:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986178.675158:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986178.675202:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986178.675435:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971245440 00000100:00100000:1.0:1788986178.675444:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971245440 00000100:00100000:1.0:1788986178.675498:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1131 00000100:00100000:1.0:1788986178.675508:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971245440:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986178.675573:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971245440:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 66us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986178.675583:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1131 00000100:00100000:0.0:1788986178.675662:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971245696 00000100:00100000:0.0:1788986178.675667:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971245696 00000100:00100000:0.0:1788986178.675718:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 974 00000100:00100000:0.0:1788986178.675727:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971245696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986178.675757:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971245696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986178.675763:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 974 00000100:00080000:0.0:1788986178.675780:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986178.677366:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986178.677512:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986178.677660:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971245568 00000100:00100000:2.0:1788986178.677667:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971245568 00000100:00100000:2.0:1788986178.677732:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1369 00000100:00100000:2.0:1788986178.677743:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971245568:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:3.0:1788986178.685987:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986178.686041:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971245824 00000100:00100000:3.0:1788986178.686051:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971245824 00000100:00100000:3.0:1788986178.686135:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 975 00000100:00100000:3.0:1788986178.686146:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971245824:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986178.690798:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971245568:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 13044us (13425us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986178.690813:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1369 00000100:00080000:2.0:1788986178.691063:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986178.692075:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971245824:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5923us (14555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986178.692530:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 975 00010000:00010000:2.0:1788986179.520400:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986180.545372:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986180.611356:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993470080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986180.611430:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986180.611541:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993470080 00000100:00100000:0.0:1788986180.611551:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993470080 00000100:00100000:0.0:1788986180.611617:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1788986180.611628:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993470080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986180.611662:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986180.611710:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993470080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986180.611716:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 694 00000100:00100000:0.0:1788986180.611759:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993470080:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986180.611812:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986181.568777:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986181.632521:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993470208:0@lo:400:kworker.0 00000100:00100000:2.0:1788986181.632627:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986181.632765:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993470208 00000100:00100000:1.0:1788986181.632775:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993470208 00000100:00100000:1.0:1788986181.632856:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1788986181.632867:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993470208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986181.634477:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993470592:0@lo:400:kworker.0 00000100:00100000:3.0:1788986181.634561:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986181.634644:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993470592 00000100:00100000:3.0:1788986181.634651:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993470592 00000100:00100000:3.0:1788986181.634708:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:3.0:1788986181.634717:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993470592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986181.634772:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993470592:12345-0@lo:400:kworker.0 Request processed in 56us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986181.634779:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:3.0:1788986181.634829:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993470592:0@lo:400:kworker.0 00000100:00100000:3.0:1788986181.634887:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993470464:0@lo:400:kworker.0 00000100:00100000:3.0:1788986181.634918:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986181.634944:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986181.634951:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993470336:0@lo:400:kworker.0 00000100:00100000:3.0:1788986181.634973:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986181.635007:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993470464 00000100:00100000:3.0:1788986181.635011:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993470464 00000100:00100000:3.0:1788986181.635058:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993470336 00000100:00100000:3.0:1788986181.635061:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993470336 00000100:00100000:3.0:1788986181.635083:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:3.0:1788986181.635126:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993470464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986181.636303:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993470464:12345-0@lo:400:kworker.0 Request processed in 1207us (1376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986181.637239:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993470208:12345-0@lo:400:kworker.0 Request processed in 4366us (4603us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986181.637255:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1788986181.639454:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1788986181.639618:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00080000:3.0:1788986181.639689:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986181.639760:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993470464:0@lo:400:kworker.0 00000100:00100000:1.0:1788986181.639942:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993470336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986181.640060:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993470336:12345-0@lo:400:kworker.0 Request processed in 590us (5084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986181.640068:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1371 00000100:00100000:3.0:1788986181.640645:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993470848:0@lo:400:kworker.0 00000100:00100000:3.0:1788986181.640700:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986181.640775:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993470336:0@lo:400:kworker.0 00000100:00100000:3.0:1788986181.640797:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986181.640805:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993470720:0@lo:400:kworker.0 00000100:00100000:3.0:1788986181.640835:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986181.640857:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993470848 00000100:00100000:0.0:1788986181.640866:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993470848 00000100:00100000:3.0:1788986181.640894:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993470720 00000100:00100000:3.0:1788986181.640901:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993470720 00000100:00100000:0.0:1788986181.640930:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1788986181.640941:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993470848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986181.640947:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:3.0:1788986181.640958:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993470720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986181.640996:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993470848:12345-0@lo:400:kworker.0 Request processed in 58us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986181.641004:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:3.0:1788986181.641015:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993470720:12345-0@lo:400:kworker.0 Request processed in 57us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986181.641024:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00080000:0.0:1788986181.641025:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986181.641031:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986181.641066:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967337 gen 2 00000004:00080000:3.0:1788986181.641073:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b09413af480, transno 4294967337 00000100:00100000:3.0:1788986181.641117:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993470848:0@lo:400:kworker.0 00000100:00100000:3.0:1788986181.641145:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993470720:0@lo:400:kworker.0 00000100:00100000:2.0:1788986181.643241:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993470208:0@lo:400:kworker.0 00000100:00100000:1.0:1788986182.144703:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986182.144734:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993470976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986182.144825:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986182.144908:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993470976 00000100:00100000:1.0:1788986182.144917:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993470976 00000100:00100000:1.0:1788986182.144977:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1788986182.144988:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993470976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986182.145032:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986182.145119:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993470976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986182.145128:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 695 00000100:00100000:1.0:1788986182.145199:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993470976:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986182.592403:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986183.619164:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986183.792942:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986183.793132:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971245952 00000100:00100000:2.0:1788986183.793143:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971245952 00000100:00100000:2.0:1788986183.793193:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1133 00000100:00100000:2.0:1788986183.793201:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971245952:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986183.793330:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971245952:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 128us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986183.793337:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1133 00000100:00100000:1.0:1788986183.798951:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986183.799083:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971246080 00000100:00100000:3.0:1788986183.799118:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971246080 00000100:00100000:3.0:1788986183.799269:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1373 00000100:00100000:3.0:1788986183.799280:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971246080:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986183.799377:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971246080:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 99us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986183.799385:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1373 00000100:00080000:0.0:1788986183.799556:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986183.800511:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986183.800543:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986183.800775:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971246208 00000100:00100000:2.0:1788986183.800781:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971246208 00000100:00100000:2.0:1788986183.800880:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971246336 00000100:00100000:2.0:1788986183.800884:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971246336 00000100:00100000:3.0:1788986183.801332:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 978 00000100:00100000:3.0:1788986183.801344:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971246208:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986183.801409:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971246208:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986183.801416:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 978 00000100:00080000:0.0:1788986183.803544:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986183.803552:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986183.806041:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 979 00000100:00100000:2.0:1788986183.806064:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971246336:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986183.806171:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971246336:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 112us (5626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986183.806178:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 979 00010000:00010000:0.0:1788986184.640845:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986185.664236:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986185.728317:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993471104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986185.728398:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986185.728505:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993471104 00000100:00100000:1.0:1788986185.728513:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993471104 00000100:00100000:1.0:1788986185.728570:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 696 00000100:00100000:1.0:1788986185.728580:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993471104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986185.728610:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788986185.728612:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986185.728668:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993471104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986185.728675:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 696 00000100:00100000:3.0:1788986185.729009:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993471104:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986186.688465:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986186.752525:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993471360:0@lo:400:kworker.0 00000100:00100000:1.0:1788986186.752531:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993471488:0@lo:400:kworker.0 00000100:00100000:2.0:1788986186.752602:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993471232:0@lo:400:kworker.0 00000100:00100000:3.0:1788986186.752735:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993471616:0@lo:400:kworker.0 00000100:00100000:0.0:1788986186.755726:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986186.755798:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993471872:0@lo:400:kworker.0 00000100:00100000:0.0:1788986186.755828:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986186.755907:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993471360 00000100:00100000:0.0:1788986186.755914:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993471360 00000100:00100000:0.0:1788986186.755958:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:0.0:1788986186.755966:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993471360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986186.756018:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993471360:12345-0@lo:400:kworker.0 Request processed in 53us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986186.756024:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:0.0:1788986186.757260:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993471360:0@lo:400:kworker.0 00000100:00100000:0.0:1788986186.757310:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993471872 00000100:00100000:0.0:1788986186.757315:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993471872 00000100:00100000:0.0:1788986186.757372:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:0.0:1788986186.757382:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993471872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986186.757433:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993471872:12345-0@lo:400:kworker.0 Request processed in 54us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986186.757439:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00080000:0.0:1788986186.757459:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986186.757476:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993471872:0@lo:400:kworker.0 00000100:00100000:2.0:1788986186.759304:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986186.759434:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993471744:0@lo:400:kworker.0 00000100:00100000:2.0:1788986186.759466:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986186.759513:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993471744 00000100:00100000:0.0:1788986186.759516:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993471232 00000100:00100000:2.0:1788986186.759520:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993471744 00000100:00100000:0.0:1788986186.759523:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993471232 00000100:00100000:2.0:1788986186.759568:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1788986186.759578:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993471744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986186.759625:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1788986186.759634:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993471744:12345-0@lo:400:kworker.0 Request processed in 57us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986186.759635:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993471232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986186.759649:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00080000:2.0:1788986186.759675:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986186.759686:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993471232:12345-0@lo:400:kworker.0 Request processed in 53us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986186.759694:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1788986186.759712:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993471232:0@lo:400:kworker.0 00000100:00100000:2.0:1788986186.759728:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993471744:0@lo:400:kworker.0 00000100:00100000:1.0:1788986186.759883:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986186.759895:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986186.763113:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993471616 00000100:00100000:1.0:1788986186.763128:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993471616 00000100:00100000:1.0:1788986186.764147:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:1.0:1788986186.764159:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993471616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986186.764201:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993471488 00000100:00100000:0.0:1788986186.764208:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993471488 00000100:00100000:1.0:1788986186.764237:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993471616:12345-0@lo:400:kworker.0 Request processed in 82us (4343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986186.764245:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1788986186.764262:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1788986186.764271:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993471488:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788986186.764295:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986186.764336:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993471488:12345-0@lo:400:kworker.0 Request processed in 66us (4452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986186.764354:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1376 00000100:00100000:0.0:1788986186.764404:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993471488:0@lo:400:kworker.0 00000100:00100000:3.0:1788986186.766186:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993471616:0@lo:400:kworker.0 00000100:00100000:0.0:1788986187.264490:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986187.264512:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993472000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986187.264580:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986187.264874:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993472000 00000100:00100000:0.0:1788986187.264882:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993472000 00000100:00100000:0.0:1788986187.264933:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 697 00000100:00100000:0.0:1788986187.264944:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993472000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986187.264975:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986187.265032:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993472000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986187.265040:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 697 00000100:00100000:1.0:1788986187.265149:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993472000:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986187.712250:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986188.737300:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986188.912707:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986188.912748:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986188.912786:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986188.912825:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986188.912855:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971246464 00000100:00100000:0.0:1788986188.912865:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971246464 00000100:00100000:0.0:1788986188.912909:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1135 00000100:00100000:0.0:1788986188.912918:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971246464:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986188.912980:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971246464:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 62us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986188.912988:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1135 00000100:00100000:0.0:1788986188.913017:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971246848 00000100:00100000:0.0:1788986188.913021:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971246848 00000100:00100000:0.0:1788986188.913046:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971246720 00000100:00100000:0.0:1788986188.913049:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971246720 00000100:00100000:0.0:1788986188.913067:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 982 00000100:00100000:0.0:1788986188.913073:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971246848:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986188.913126:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971246848:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 53us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986188.913133:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 982 00000100:00100000:0.0:1788986188.913145:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 983 00000100:00100000:0.0:1788986188.913151:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971246720:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986188.913172:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971246720:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 22us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986188.913178:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 983 00000100:00080000:2.0:1788986188.913319:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986188.913324:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986188.914734:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971246592 00000100:00100000:3.0:1788986188.914744:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971246592 00000100:00080000:2.0:1788986188.914957:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986188.915060:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1377 00000100:00100000:3.0:1788986188.915070:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971246592:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986188.915163:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971246592:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 94us (2465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986188.915170:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1377 00010000:00010000:3.0:1788986189.760250:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986190.784304:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986190.850951:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986190.850974:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993472128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986190.851037:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986190.851241:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993472128 00000100:00100000:1.0:1788986190.851249:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993472128 00000100:00100000:1.0:1788986190.851306:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1788986190.851314:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993472128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986190.851353:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986190.851402:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993472128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986190.851421:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:1.0:1788986190.851464:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993472128:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986190.851557:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986191.808540:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986191.872526:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993472256:0@lo:400:kworker.0 00000100:00100000:1.0:1788986191.872611:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986191.872702:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993472768:0@lo:400:kworker.0 00000100:00100000:0.0:1788986191.872702:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993472512:0@lo:400:kworker.0 00000100:00100000:0.0:1788986191.872729:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986191.872746:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993472640:0@lo:400:kworker.0 00000100:00100000:0.0:1788986191.872761:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788986191.872766:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993472384:0@lo:400:kworker.0 00000100:00100000:1.0:1788986191.872769:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986191.872833:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993472512 00000100:00100000:2.0:1788986191.872841:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993472512 00000100:00100000:2.0:1788986191.872896:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:2.0:1788986191.872905:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993472512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986191.872962:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993472640 00000100:00100000:1.0:1788986191.872967:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993472640 00000100:00100000:1.0:1788986191.872997:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1788986191.873004:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993472640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986191.873116:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986191.873136:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993472896:0@lo:400:kworker.0 00000100:00100000:0.0:1788986191.873158:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986191.873182:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993472384 00000100:00100000:0.0:1788986191.873186:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993472384 00000100:00100000:0.0:1788986191.873212:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1379 00000100:00100000:0.0:1788986191.873218:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993472384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986191.873252:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993472384:12345-0@lo:400:kworker.0 Request processed in 33us (135us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986191.873271:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1379 00000100:00100000:0.0:1788986191.873306:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993472384:0@lo:400:kworker.0 00000100:00100000:0.0:1788986191.873345:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986191.873380:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993472896 00000100:00100000:0.0:1788986191.873383:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993472896 00000100:00100000:0.0:1788986191.873406:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:0.0:1788986191.873412:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993472896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986191.873443:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993472896:12345-0@lo:400:kworker.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986191.873449:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:0.0:1788986191.873471:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993472896:0@lo:400:kworker.0 00000100:00100000:0.0:1788986191.873504:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993472768 00000100:00100000:0.0:1788986191.873508:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993472768 00000100:00100000:0.0:1788986191.873529:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:0.0:1788986191.873535:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993472768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986191.873566:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993472768:12345-0@lo:400:kworker.0 Request processed in 32us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986191.873575:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00080000:0.0:1788986191.873590:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986191.873594:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986191.873610:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993472768:0@lo:400:kworker.0 00000100:00100000:3.0:1788986191.875119:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993472256 00000100:00100000:3.0:1788986191.875129:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993472256 00000100:00100000:3.0:1788986191.875193:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1788986191.875202:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993472256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986191.875273:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993472256:12345-0@lo:400:kworker.0 Request processed in 73us (2671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986191.875280:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:3.0:1788986191.875342:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993472256:0@lo:400:kworker.0 00000100:00100000:2.0:1788986191.876226:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993472512:12345-0@lo:400:kworker.0 Request processed in 3320us (3492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986191.876237:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:0.0:1788986191.876260:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993472512:0@lo:400:kworker.0 00000100:00100000:1.0:1788986191.876339:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993472640:12345-0@lo:400:kworker.0 Request processed in 3334us (3567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986191.876348:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:3.0:1788986191.876422:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993472640:0@lo:400:kworker.0 00000100:00100000:2.0:1788986192.385341:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986192.385365:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993473024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986192.385427:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986192.385544:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993473024 00000100:00100000:0.0:1788986192.385552:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993473024 00000100:00100000:0.0:1788986192.385601:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:0.0:1788986192.385621:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993473024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986192.385653:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986192.385708:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993473024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986192.385715:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:1.0:1788986192.385994:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993473024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986192.833057:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986193.723060:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986193.723125:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971246976 00000100:00100000:2.0:1788986193.723135:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971246976 00000100:00100000:2.0:1788986193.723280:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 650 00000100:00100000:2.0:1788986193.723292:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44319:x1875885971246976:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986193.723404:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44319:x1875885971246976:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 115us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986193.723413:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 650 00000100:00080000:0.0:1788986193.723464:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986193.726811:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986193.727062:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971247104 00000100:00100000:2.0:1788986193.727071:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971247104 00000100:00100000:2.0:1788986193.727163:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 354 00000100:00100000:2.0:1788986193.727181:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:44319:x1875885971247104:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00080000:0.0:1788986193.727364:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986193.728128:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:44319:x1875885971247104:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 955us (1323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986193.728137:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 354 00000100:00100000:1.0:1788986193.746977:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986193.747122:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971247232 00000100:00100000:2.0:1788986193.747132:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971247232 00000100:00100000:2.0:1788986193.747206:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 355 00000100:00100000:2.0:1788986193.747217:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:44319:x1875885971247232:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986193.747591:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:44319:x1875885971247232:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 375us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986193.747598:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 355 00000100:00080000:1.0:1788986193.748559:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986193.751801:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986193.751958:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971247360 00000100:00100000:2.0:1788986193.751968:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971247360 00000100:00100000:2.0:1788986193.752024:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 651 00000100:00100000:2.0:1788986193.752034:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44319:x1875885971247360:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986193.752479:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44319:x1875885971247360:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 445us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986193.752488:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 651 00000100:00100000:0.0:1788986193.757163:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986193.757996:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971247488 00000100:00100000:2.0:1788986193.758008:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971247488 00000100:00100000:2.0:1788986193.758071:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 652 00000100:00100000:2.0:1788986193.758081:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44319:x1875885971247488:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986193.758182:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44319:x1875885971247488:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 102us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986193.758189:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 652 00000100:00100000:3.0:1788986193.763923:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986193.763956:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971247616 00000100:00100000:3.0:1788986193.763965:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971247616 00000100:00100000:3.0:1788986193.764009:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 356 00000100:00100000:3.0:1788986193.764019:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:44319:x1875885971247616:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986193.764546:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:44319:x1875885971247616:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 526us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986193.764555:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 356 00000100:00100000:3.0:1788986193.768649:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986193.768688:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971247744 00000100:00100000:3.0:1788986193.768697:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971247744 00000100:00100000:3.0:1788986193.768743:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 357 00000100:00100000:3.0:1788986193.768753:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:44319:x1875885971247744:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986193.769612:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:44319:x1875885971247744:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 856us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986193.769622:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 357 00000100:00100000:3.0:1788986193.774923:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986193.774991:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971247872 00000100:00100000:3.0:1788986193.775000:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971247872 00000100:00100000:3.0:1788986193.775048:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 653 00000100:00100000:3.0:1788986193.775057:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44319:x1875885971247872:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986193.775485:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44319:x1875885971247872:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 428us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986193.775493:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 653 00000100:00100000:2.0:1788986193.810222:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986193.815874:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971248000 00000100:00100000:0.0:1788986193.815889:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971248000 00000100:00100000:0.0:1788986193.817628:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 654 00000100:00100000:0.0:1788986193.817646:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:44320:x1875885971248000:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986193.817667:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986193.817701:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54818d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0fe8 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986193.817772:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548194 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986193.817786:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986193.817799:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986193.817832:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00000004:00200000:0.0:1788986193.817836:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986193.817854:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548194 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986193.817878:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54818d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fe8 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986193.817898:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548194 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fe8 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986193.817906:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:0.0:1788986193.817910:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986193.817913:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efc00, rc 0) 00000100:00100000:0.0:1788986193.817991:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:44320:x1875885971248000:12345-192.168.206.21@tcp:101:rm.0 Request processed in 352us (7776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986193.817999:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 654 00000100:00100000:0.0:1788986193.822024:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986193.822118:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971248256 00000100:00100000:1.0:1788986193.822128:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971248256 00000100:00100000:1.0:1788986193.822179:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 655 00000100:00100000:1.0:1788986193.822188:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:44320:x1875885971248256:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986193.822205:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986193.822226:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54819b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0fef expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986193.822318:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x30:0x0]: returning size 16384 00010000:00010000:1.0:1788986193.822536:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54819b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fef expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.822549:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:1.0:1788986193.822552:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788986193.822558:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54819b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fef expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.822576:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031a00, rc 0) 00000100:00100000:1.0:1788986193.822629:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:44320:x1875885971248256:12345-192.168.206.21@tcp:101:rm.0 Request processed in 442us (613us total) trans 4294967540 rc 301/301 00000100:00100000:1.0:1788986193.822635:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 655 00000100:00100000:0.0:1788986193.830970:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986193.831255:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971248384 00000100:00100000:2.0:1788986193.831264:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971248384 00000100:00100000:2.0:1788986193.831322:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:2.0:1788986193.831333:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:44320:x1875885971248384:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:2.0:1788986193.845478:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:44320:x1875885971248384:12345-192.168.206.21@tcp:37:rm.0 Request processed in 14136us (14506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986193.845492:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 66 00000100:00100000:0.0:1788986193.857820:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986193.857853:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971248640 00000100:00100000:0.0:1788986193.857862:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971248640 00000100:00100000:0.0:1788986193.857906:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 67 00000100:00100000:0.0:1788986193.857915:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:44320:x1875885971248640:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:0.0:1788986193.858202:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:44320:x1875885971248640:12345-192.168.206.21@tcp:35:rm.0 Request processed in 287us (390us total) trans 4294967541 rc 0/0 00000100:00100000:0.0:1788986193.858211:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 67 00010000:00010000:3.0:1788986193.872358:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986193.872569:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986193.872635:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971248896 00000100:00100000:1.0:1788986193.872644:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971248896 00000100:00100000:1.0:1788986193.872704:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 656 00000100:00100000:1.0:1788986193.872715:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:44320:x1875885971248896:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788986193.872769:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788986193.872792:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548194 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fe8 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.872816:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf548139 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x30:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0fd3 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.872833:0:15241:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf547d96) 00010000:00010000:1.0:1788986193.872837:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:1.0:1788986193.872847:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986193.872870:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5481a9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.872883:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5481a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.872892:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5481a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.872906:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5481b0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.872913:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5481b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.872919:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5481b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873391:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5481b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873402:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5481b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873413:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5481b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873447:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5481b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873454:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5481b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873460:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5481b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873465:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986193.873470:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5481b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873478:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5481b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873487:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x30:0x0].0x0 (ffff9b0a45316500) 00010000:00010000:1.0:1788986193.873490:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986193.873494:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5481b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873501:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5481b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x30:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873518:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5481a9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873525:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5481a9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873531:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5481a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873536:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986193.873539:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5481a9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873544:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5481a9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873551:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:1.0:1788986193.873553:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986193.873556:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5481a9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873562:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5481a9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873574:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5481b0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873579:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5481b0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873584:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5481b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873588:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986193.873591:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5481b0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873600:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5481b0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873606:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x92151253 (ffff9b0a45316900) 00010000:00010000:1.0:1788986193.873608:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986193.873611:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5481b0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986193.873616:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5481b0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x92151253 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986193.873835:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:44320:x1875885971248896:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1119us (1268us total) trans 0 rc -13/-13 00000100:00100000:1.0:1788986193.873843:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 656 00000100:00100000:3.0:1788986194.034637:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986194.036421:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971249024 00000100:00100000:2.0:1788986194.036432:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971249024 00000100:00100000:2.0:1788986194.036481:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1137 00000100:00100000:2.0:1788986194.036490:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971249024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986194.036559:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971249024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (1929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986194.036570:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1137 00010000:00010000:1.0:1788986194.884914:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986195.014678:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967541 is committed 00000020:00000080:2.0:1788986195.092383:0:76369:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd6299a460 20000000:00000080:2.0:1788986195.092399:0:76369:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7673dc00 uarg=0000000000000000 00010000:00010000:3.0:1788986195.104372:0:76369:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986195.104392:0:76369:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986195.104431:0:76369:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986195.104447:0:76369:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986195.104463:0:76369:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548116 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54810f expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986195.104471:0:76369:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986195.104508:0:76369:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548116 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54810f expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986195.104522:0:76369:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548116 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54810f expref: 18 pid: 5848 timeout: 2079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986195.104535:0:76369:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76369:1875885993473152:0@lo:104: 00000100:00100000:3.0:1788986195.104595:0:76369:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986195.104706:0:76369:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80e92b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788986195.106549:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788986195.106571:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993473152 00000100:00100000:1.0:1788986195.106579:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993473152 00000100:00100000:1.0:1788986195.106670:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:1.0:1788986195.106681:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f58e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:76369:x1875885993473152:12345-0@lo:104: 00010000:00010000:1.0:1788986195.106697:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548116 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986195.106828:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986195.106836:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f58e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:76369:x1875885993473152:12345-0@lo:104: Request processed in 158us (2241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986195.106843:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:3.0:1788986195.106971:0:76369:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76369:1875885993473152:0@lo:104: 00010000:00010000:3.0:1788986195.107003:0:76369:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107327:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986195.107334:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548116 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107343:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986195.107347:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548116 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107356:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548116 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986195.107364:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548116 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986195.107369:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986195.107440:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548116 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107447:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986195.107477:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548116 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107485:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee800/0xc20d828fcf54810f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548116 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107501:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986195.107503:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986195.107505:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986195.107512:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986195.107524:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993473280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986195.107610:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986195.107654:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993473280 00000100:00100000:0.0:1788986195.107659:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993473280 00010000:00010000:0.0:1788986195.107680:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548116 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54810f expref: 19 pid: 5848 timeout: 2079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986195.107705:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788986195.107712:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993473280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986195.107723:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986195.107728:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548116 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54810f expref: 19 pid: 5848 timeout: 2079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107739:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548116 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54810f expref: 19 pid: 5848 timeout: 2079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107752:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548116 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54810f expref: 19 pid: 5848 timeout: 2079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107778:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107792:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107806:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107813:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107821:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107827:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107833:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986195.107837:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107844:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107858:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.107867:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986195.107895:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993473280:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986195.107901:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788986195.107956:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993473280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986195.109958:0:76369:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986195.109975:0:76369:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986195.109982:0:76369:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf5481be lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76369 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788986195.883315:0:76417:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd39e057d0 20000000:00000080:1.0:1788986195.883331:0:76417:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0943181800 uarg=0000000000000000 00010000:00010000:1.0:1788986195.883542:0:76417:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788986195.883556:0:76417:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788986195.883573:0:76417:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986195.883592:0:76417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5481c5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986195.883607:0:76417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5481c5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986195.883618:0:76417:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5481c5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986195.883624:0:76417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5481c5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986195.883631:0:76417:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5481c5 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986195.883638:0:76417:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5481c5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986195.883644:0:76417:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986195.883649:0:76417:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5481c5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986195.883656:0:76417:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5481c5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986195.883667:0:76417:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5481c5 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986195.883678:0:76417:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5481c5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986195.883684:0:76417:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf5481c5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986195.904430:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986195.969220:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993473408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986195.969285:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986195.969338:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993473408 00000100:00100000:1.0:1788986195.969345:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993473408 00000100:00100000:1.0:1788986195.969405:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:1.0:1788986195.969415:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993473408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986195.969448:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986195.969509:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993473408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986195.969524:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00080000:1.0:1788986195.969544:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986195.969828:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993473408:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788986196.789285:0:76465:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff5f500e70 20000000:00000080:0.0:1788986196.789314:0:76465:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0941d3a400 uarg=0000000000000000 00010000:00010000:0.0:1788986196.789585:0:76465:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986196.789600:0:76465:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986196.789684:0:76465:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986196.789703:0:76465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481cc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.789718:0:76465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481cc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.789728:0:76465:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481cc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.789736:0:76465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481cc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.789744:0:76465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481cc lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.789751:0:76465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481cc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.789756:0:76465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986196.789761:0:76465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481cc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.789768:0:76465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481cc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.789785:0:76465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481cc lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.789792:0:76465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481cc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.789798:0:76465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481cc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986196.865619:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986196.865626:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986196.865631:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986196.865675:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986196.865688:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986196.865700:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986196.865727:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993473536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986196.865791:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986196.865878:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a8214d840 going to sleep for 11 seconds 00000100:00100000:0.0:1788986196.866685:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993473536 00000100:00100000:0.0:1788986196.866693:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993473536 00000100:00100000:0.0:1788986196.866749:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:0.0:1788986196.866758:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993473536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986196.866771:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986196.866785:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481da lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5481d3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.866809:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5481d3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.866819:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5481d3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.866828:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788986196.866920:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993473536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986196.866927:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:3.0:1788986196.868558:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993473536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986196.868582:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5481da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986196.868592:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5481da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986196.868612:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986196.868617:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5481da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986196.868625:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5481da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986196.930380:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986196.993344:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993473792:0@lo:400:kworker.0 00000100:00100000:3.0:1788986196.993410:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986196.993459:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788986196.993465:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993473664:0@lo:400:kworker.0 00000100:00100000:3.0:1788986196.993490:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986196.993505:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993474176:0@lo:400:kworker.0 00000100:00100000:3.0:1788986196.993525:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986196.993666:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993473792 00000100:00100000:1.0:1788986196.993673:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993473792 00000100:00100000:1.0:1788986196.993718:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993473664 00000100:00100000:1.0:1788986196.993721:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993473664 00000100:00100000:1.0:1788986196.993741:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1788986196.993749:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993473792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986196.993795:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993473792:12345-0@lo:400:kworker.0 Request processed in 47us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986196.993802:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1788986196.993817:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1382 00000100:00100000:1.0:1788986196.993823:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993473664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986196.993849:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993473664:12345-0@lo:400:kworker.0 Request processed in 26us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986196.993855:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1382 00000100:00080000:1.0:1788986196.993871:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986196.993944:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993473792:0@lo:400:kworker.0 00000100:00100000:3.0:1788986196.993962:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993473664:0@lo:400:kworker.0 00000100:00100000:3.0:1788986196.993976:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993473920:0@lo:400:kworker.0 00000100:00100000:3.0:1788986196.993998:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986196.994022:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986196.994027:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993474048:0@lo:400:kworker.0 00000100:00100000:3.0:1788986196.994046:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986196.994071:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993474048 00000100:00100000:3.0:1788986196.994075:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993474048 00000100:00100000:3.0:1788986196.994127:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:3.0:1788986196.994133:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993474048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986196.994352:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993474048:12345-0@lo:400:kworker.0 Request processed in 218us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986196.994359:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:3.0:1788986196.994379:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993474176 00000100:00100000:3.0:1788986196.994382:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993474176 00000100:00100000:3.0:1788986196.994409:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993473920 00000100:00100000:3.0:1788986196.994413:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993473920 00000100:00100000:3.0:1788986196.994431:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:3.0:1788986196.994438:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993474176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986196.994471:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993474176:12345-0@lo:400:kworker.0 Request processed in 33us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986196.994476:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:3.0:1788986196.994488:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1788986196.994494:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993473920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986196.994519:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993473920:12345-0@lo:400:kworker.0 Request processed in 26us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986196.994524:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00080000:1.0:1788986196.994853:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986196.994857:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986196.996012:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993474048:0@lo:400:kworker.0 00000100:00100000:3.0:1788986196.996028:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993473920:0@lo:400:kworker.0 00000100:00100000:3.0:1788986196.996061:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993474176:0@lo:400:kworker.0 00000100:00100000:1.0:1788986197.505189:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986197.505208:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993474304:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986197.505262:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986197.505327:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993474304 00000100:00100000:1.0:1788986197.505334:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993474304 00000100:00100000:1.0:1788986197.505376:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1788986197.505384:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993474304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986197.505413:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986197.505453:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993474304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986197.505459:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 701 00000100:00100000:1.0:1788986197.505500:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993474304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986197.953708:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986198.977199:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986199.155532:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986199.155574:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986199.155606:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986199.155648:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971249408 00000100:00100000:0.0:1788986199.155658:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971249408 00000100:00100000:0.0:1788986199.155717:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 988 00000100:00100000:0.0:1788986199.155726:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971249408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986199.155789:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971249408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 64us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986199.155796:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 988 00000100:00100000:1.0:1788986199.155812:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986199.155831:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971249152 00000100:00100000:3.0:1788986199.155836:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971249152 00000100:00100000:3.0:1788986199.155870:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1139 00000100:00100000:3.0:1788986199.155878:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971249152:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986199.155906:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971249152:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986199.155913:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1139 00000100:00100000:3.0:1788986199.155941:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971249536 00000100:00100000:3.0:1788986199.155945:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971249536 00000100:00100000:3.0:1788986199.155971:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 989 00000100:00100000:1.0:1788986199.159407:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971249280 00000100:00100000:1.0:1788986199.159421:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971249280 00000100:00100000:1.0:1788986199.159500:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1384 00000100:00100000:1.0:1788986199.159511:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971249280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986199.159533:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971249536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986199.160290:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971249280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 637us (4538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986199.160300:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1384 00000100:00080000:1.0:1788986199.160330:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986199.160335:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986199.160338:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986199.161655:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971249536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 2117us (6013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986199.161667:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 989 00010000:00010000:2.0:1788986200.001377:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986200.201562:0:76662:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4848e220 20000000:00000080:3.0:1788986200.201580:0:76662:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7663e000 uarg=0000000000000000 00010000:00010000:3.0:1788986200.202635:0:76662:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986200.202650:0:76662:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986200.202666:0:76662:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986200.202682:0:76662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986200.202697:0:76662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5481d3 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986200.202706:0:76662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986200.202751:0:76662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5481d3 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986200.202765:0:76662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481da lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5481d3 expref: 18 pid: 5846 timeout: 2084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986200.202778:0:76662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76662:1875885993474432:0@lo:104: 00000100:00100000:3.0:1788986200.202898:0:76662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986200.202960:0:76662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7600 going to sleep for 11 seconds 00000100:00100000:2.0:1788986200.203026:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993474432 00000100:00100000:2.0:1788986200.203033:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993474432 00000100:00100000:2.0:1788986200.203082:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788986200.203110:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:76662:x1875885993474432:12345-0@lo:104: 00010000:00010000:2.0:1788986200.203121:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5481da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986200.203307:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986200.203313:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:76662:x1875885993474432:12345-0@lo:104: Request processed in 224us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986200.203320:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788986200.203387:0:76662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:76662:1875885993474432:0@lo:104: 00010000:00010000:3.0:1788986200.203403:0:76662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.203511:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986200.203518:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5481da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.203526:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986200.203529:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5481da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.203537:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5481da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986200.203544:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5481da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986200.203551:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986200.203586:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5481da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.203593:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986200.203617:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5481da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.203624:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf5481d3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5481da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.203641:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986200.203643:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986200.203644:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986200.203688:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986200.203701:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993474560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986200.203733:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986200.203866:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993474560 00000100:00100000:1.0:1788986200.203871:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993474560 00010000:00010000:1.0:1788986200.203893:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481da lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5481d3 expref: 19 pid: 5846 timeout: 2084 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986200.203924:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788986200.203930:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993474560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986200.203940:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986200.203945:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481da lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5481d3 expref: 19 pid: 5846 timeout: 2084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.203965:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5481d3 expref: 19 pid: 5846 timeout: 2084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.203977:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5481da lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5481d3 expref: 19 pid: 5846 timeout: 2084 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.203988:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.203996:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.204010:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.204016:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.204022:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.204028:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.204033:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986200.204037:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.204043:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.204054:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986200.204062:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986200.204119:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993474560:12345-0@lo:103:ldlm_bl.0 Request processed in 189us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986200.204126:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788986200.204413:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993474560:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986200.204440:0:76662:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986200.204448:0:76662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986200.204454:0:76662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5481e1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 76662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986201.025416:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986201.089532:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993474688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986201.089611:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986201.090852:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993474688 00000100:00100000:1.0:1788986201.090864:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993474688 00000100:00100000:1.0:1788986201.090941:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:1.0:1788986201.090952:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993474688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986201.090989:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986201.091051:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993474688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (1440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986201.091059:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00080000:3.0:1788986201.091600:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986201.091653:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993474688:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1788986201.984195:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986201.984202:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986201.984206:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986201.984246:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986201.984257:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986201.984277:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986201.984300:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993474816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986201.984360:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986201.984404:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c13c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986201.984812:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993474816 00000100:00100000:2.0:1788986201.984820:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993474816 00000100:00100000:2.0:1788986201.984913:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:2.0:1788986201.984924:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993474816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986201.984937:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986201.984953:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5481ef lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5481e8 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986201.984983:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5481ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5481e8 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986201.984993:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5481ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5481e8 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986201.985002:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1000, rc 0) 00000100:00100000:2.0:1788986201.985067:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993474816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986201.985075:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:0.0:1788986201.985185:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993474816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986201.985201:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5481ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986201.985211:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5481ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986201.985229:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986201.985233:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5481ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986201.985241:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5481ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986202.049454:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986202.116242:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993475072:0@lo:400:kworker.0 00000100:00100000:1.0:1788986202.116312:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986202.116358:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993475584:0@lo:400:kworker.0 00000100:00100000:1.0:1788986202.116382:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986202.116407:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788986202.116413:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993474944:0@lo:400:kworker.0 00000100:00100000:1.0:1788986202.116437:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986202.116459:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993475456:0@lo:400:kworker.0 00000100:00100000:1.0:1788986202.116479:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986202.116502:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993475200:0@lo:400:kworker.0 00000100:00100000:1.0:1788986202.116522:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986202.116537:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986202.116542:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993475328:0@lo:400:kworker.0 00000100:00100000:1.0:1788986202.116559:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986202.116586:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993475072 00000100:00100000:1.0:1788986202.116593:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993475072 00000100:00100000:1.0:1788986202.116626:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993475456 00000100:00100000:1.0:1788986202.116629:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993475456 00000100:00100000:1.0:1788986202.116650:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993475200 00000100:00100000:1.0:1788986202.116653:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993475200 00000100:00100000:1.0:1788986202.116667:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1788986202.116675:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993475072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986202.116721:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993475072:12345-0@lo:400:kworker.0 Request processed in 45us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986202.118349:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00100000:1.0:1788986202.118383:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:1.0:1788986202.118394:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993475456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986202.118448:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993475456:12345-0@lo:400:kworker.0 Request processed in 58us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986202.118458:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:1.0:1788986202.118470:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1387 00000100:00100000:1.0:1788986202.118476:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993475200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986202.118514:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993475200:12345-0@lo:400:kworker.0 Request processed in 38us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986202.118520:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1387 00000100:00100000:1.0:1788986202.118541:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993475584 00000100:00100000:1.0:1788986202.118546:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993475584 00000100:00100000:1.0:1788986202.120998:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993475328 00000100:00100000:1.0:1788986202.121009:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993475328 00000100:00100000:2.0:1788986202.121213:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993475200:0@lo:400:kworker.0 00000100:00100000:3.0:1788986202.121832:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1788986202.121845:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993475584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986202.121914:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993475584:12345-0@lo:400:kworker.0 Request processed in 73us (5531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986202.121921:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1788986202.121940:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:3.0:1788986202.121947:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993475328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986202.121990:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993475328:12345-0@lo:400:kworker.0 Request processed in 44us (5429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986202.121996:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1788986202.122083:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993475328:0@lo:400:kworker.0 00000100:00080000:0.0:1788986202.126390:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986202.126398:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986202.126431:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993474944 00000100:00100000:0.0:1788986202.126440:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993474944 00000100:00100000:0.0:1788986202.126484:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1788986202.126492:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993474944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986202.126568:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993474944:12345-0@lo:400:kworker.0 Request processed in 76us (10130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986202.126576:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:0.0:1788986202.126637:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993474944:0@lo:400:kworker.0 00000100:00100000:0.0:1788986202.126651:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993475456:0@lo:400:kworker.0 00000100:00100000:0.0:1788986202.126662:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993475072:0@lo:400:kworker.0 00000100:00100000:0.0:1788986202.126672:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993475584:0@lo:400:kworker.0 00000100:00100000:3.0:1788986202.624408:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986202.624430:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993475712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986202.624505:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986202.624604:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993475712 00000100:00100000:2.0:1788986202.624613:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993475712 00000100:00100000:2.0:1788986202.624668:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1788986202.624678:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993475712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986202.624712:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986202.624770:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993475712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986202.624778:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:2.0:1788986202.624815:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993475712:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986203.072908:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986204.096914:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986204.274217:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986204.274257:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986204.274288:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986204.274317:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986204.274357:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971249792 00000100:00100000:0.0:1788986204.274365:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971249792 00000100:00100000:0.0:1788986204.274422:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1388 00000100:00100000:0.0:1788986204.274432:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971249792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986204.274453:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971249920 00000100:00100000:3.0:1788986204.274460:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971249920 00000100:00100000:3.0:1788986204.274495:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971250048 00000100:00100000:3.0:1788986204.274498:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971250048 00000100:00100000:0.0:1788986204.274506:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971249792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 74us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986204.274514:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1388 00000100:00100000:3.0:1788986204.274527:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 992 00000100:00100000:3.0:1788986204.274537:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971249920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986204.274550:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 993 00000100:00100000:0.0:1788986204.274560:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971250048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986204.274588:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971249920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 52us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986204.274596:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971250048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986204.274601:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 992 00000100:00100000:0.0:1788986204.274610:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 993 00000100:00080000:0.0:1788986204.274632:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986204.274636:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986204.274638:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986204.274864:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971249664 00000100:00100000:2.0:1788986204.274869:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971249664 00000100:00100000:2.0:1788986204.274903:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1142 00000100:00100000:2.0:1788986204.274911:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971249664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986204.274949:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971249664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986204.274955:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1142 00010000:00010000:2.0:1788986205.121604:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986206.144690:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986206.213061:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993475840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986206.213156:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986206.213338:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993475840 00000100:00100000:3.0:1788986206.213347:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993475840 00000100:00100000:3.0:1788986206.213420:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1788986206.213429:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993475840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986206.213462:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986206.213511:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993475840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986206.213519:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:3.0:1788986206.213565:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993475840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986206.213684:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986207.169210:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986207.234071:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993476224:0@lo:400:kworker.0 00000100:00100000:2.0:1788986207.234193:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986207.234359:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993476096:0@lo:400:kworker.0 00000100:00100000:0.0:1788986207.234395:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986207.234442:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993476224 00000100:00100000:0.0:1788986207.234452:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993476224 00000100:00100000:0.0:1788986207.235020:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993476096 00000100:00100000:0.0:1788986207.235025:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993476096 00000100:00100000:0.0:1788986207.235057:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1788986207.235067:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993476224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986207.235153:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993476224:12345-0@lo:400:kworker.0 Request processed in 87us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986207.235161:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:0.0:1788986207.235180:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:0.0:1788986207.235186:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993476096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986207.235221:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993476096:12345-0@lo:400:kworker.0 Request processed in 35us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986207.235227:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:2.0:1788986207.235405:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993476224:0@lo:400:kworker.0 00000100:00100000:2.0:1788986207.235428:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986207.235437:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993476352:0@lo:400:kworker.0 00000100:00100000:2.0:1788986207.235473:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986207.235866:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993475968:0@lo:400:kworker.0 00000100:00100000:3.0:1788986207.235912:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986207.235953:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993476480:0@lo:400:kworker.0 00000100:00100000:3.0:1788986207.235983:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986207.236020:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993476480 00000100:00100000:3.0:1788986207.236025:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993475968 00000100:00100000:2.0:1788986207.236028:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993476480 00000100:00100000:3.0:1788986207.236031:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993475968 00000100:00100000:3.0:1788986207.236070:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1788986207.236074:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1391 00000100:00100000:3.0:1788986207.236079:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993475968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986207.236085:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993476480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986207.236150:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993475968:12345-0@lo:400:kworker.0 Request processed in 73us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986207.236157:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1143 00000100:00100000:2.0:1788986207.236162:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993476480:12345-0@lo:400:kworker.0 Request processed in 78us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986207.236170:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1391 00000100:00100000:3.0:1788986207.236219:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993475968:0@lo:400:kworker.0 00000100:00100000:3.0:1788986207.236241:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993476480:0@lo:400:kworker.0 00000100:00080000:0.0:1788986207.236344:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986207.236376:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993476352 00000100:00100000:0.0:1788986207.236380:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993476352 00000100:00100000:0.0:1788986207.236422:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1788986207.236431:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993476352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986207.236485:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993476352:12345-0@lo:400:kworker.0 Request processed in 55us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986207.236815:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1788986207.236865:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993476096:0@lo:400:kworker.0 00000100:00100000:0.0:1788986207.236875:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993476608:0@lo:400:kworker.0 00000100:00100000:0.0:1788986207.236908:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986207.236952:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993476608 00000100:00100000:0.0:1788986207.236956:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993476608 00000100:00100000:0.0:1788986207.236993:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:0.0:1788986207.236999:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993476608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986207.237037:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993476608:12345-0@lo:400:kworker.0 Request processed in 38us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986207.237043:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00080000:0.0:1788986207.237058:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986207.237077:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993476608:0@lo:400:kworker.0 00000100:00100000:3.0:1788986207.237391:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993476352:0@lo:400:kworker.0 00000100:00100000:3.0:1788986207.744306:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986207.744327:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993476736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986207.744390:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986207.744443:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993476736 00000100:00100000:3.0:1788986207.744450:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993476736 00000100:00100000:3.0:1788986207.744491:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1788986207.744499:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993476736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986207.744529:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986207.744569:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993476736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986207.744576:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 705 00000100:00100000:3.0:1788986207.744619:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993476736:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986208.192419:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986209.221916:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788986209.341201:0:77005:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 19: test nodemap trusted_admin fileops ========================================================== 16:36:47 (1788986207) 00000100:00100000:3.0:1788986209.410627:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986209.410665:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986209.411061:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971250176 00000100:00100000:2.0:1788986209.411071:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971250176 00000100:00100000:2.0:1788986209.411130:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1144 00000100:00100000:2.0:1788986209.411140:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971250176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986209.411200:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971250176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 62us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986209.411207:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1144 00000100:00100000:0.0:1788986209.411396:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971250432 00000100:00100000:0.0:1788986209.411401:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971250432 00000100:00100000:0.0:1788986209.411446:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 996 00000100:00100000:0.0:1788986209.411453:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971250432:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986209.411498:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971250432:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 45us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986209.411504:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 996 00000100:00080000:2.0:1788986209.411576:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986209.411622:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986209.411656:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986209.411721:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971250304 00000100:00100000:2.0:1788986209.411725:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971250304 00000100:00100000:2.0:1788986209.411762:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1392 00000100:00100000:2.0:1788986209.411768:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971250304:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986209.411800:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971250304:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (1111us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986209.411807:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1392 00000100:00080000:3.0:1788986209.412031:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986209.412173:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971250560 00000100:00100000:0.0:1788986209.412178:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971250560 00000100:00100000:0.0:1788986209.412229:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 997 00000100:00100000:0.0:1788986209.412237:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971250560:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986209.412268:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971250560:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986209.412275:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 997 00000100:00080000:3.0:1788986209.412342:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788986210.243855:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:3.0:1788986210.513460:0:77054:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:3.0:1788986210.529262:0:77054:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:1.0:1788986211.267320:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986211.329537:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993476864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986211.329611:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986211.329737:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993476864 00000100:00100000:0.0:1788986211.329744:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993476864 00000100:00100000:0.0:1788986211.329816:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1788986211.329824:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993476864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986211.329864:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986211.329915:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993476864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986211.329921:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1788986211.329961:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993476864:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986211.330130:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788986211.496515:0:77102:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe82375600 20000000:00000080:3.0:1788986211.496531:0:77102:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094197fc00 uarg=0000000000000000 10000000:01000000:3.0:1788986211.502469:0:77102:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986211.502494:0:77102:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986211.502512:0:77102:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5481ef lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5481e8 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986211.502519:0:77102:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986211.502563:0:77102:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5481ef lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5481e8 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986211.502578:0:77102:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5481ef lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5481e8 expref: 18 pid: 5848 timeout: 2095 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986211.502591:0:77102:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77102:1875885993476992:0@lo:104: 00000100:00100000:3.0:1788986211.503791:0:77102:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986211.503903:0:77102:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a44db3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788986211.504049:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993476992 00000100:00100000:2.0:1788986211.504058:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993476992 00000100:00100000:2.0:1788986211.507268:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788986211.507290:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:77102:x1875885993476992:12345-0@lo:104: 00010000:00010000:2.0:1788986211.507310:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5481ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986211.507422:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986211.507429:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:77102:x1875885993476992:12345-0@lo:104: Request processed in 150us (3640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986211.507435:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00010000:00010000:0.0:1788986211.507478:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986211.507485:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5481ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.507493:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986211.507497:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5481ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.507505:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5481ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986211.507512:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5481ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986211.507518:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986211.507554:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5481ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.507561:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986211.507581:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5481ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.507588:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf5481e8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5481ef expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.507613:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986211.507616:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986211.507617:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986211.507638:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993477120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986211.507675:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986211.507726:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993477120 00000100:00100000:0.0:1788986211.507733:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993477120 00010000:00010000:0.0:1788986211.507759:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5481ef lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5481e8 expref: 19 pid: 5848 timeout: 2095 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986211.507784:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:0.0:1788986211.507791:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993477120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986211.507802:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986211.507807:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5481ef lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5481e8 expref: 19 pid: 5848 timeout: 2095 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.507818:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5481ef lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5481e8 expref: 19 pid: 5848 timeout: 2095 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.507834:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986211.508084:0:77102:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5481ef lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5481e8 expref: 19 pid: 5848 timeout: 2095 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986211.508114:0:77102:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77102:1875885993476992:0@lo:104: 00010000:00010000:0.0:1788986211.508162:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986211.508421:0:77102:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.508463:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.508470:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.508476:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.508483:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.508488:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986211.508493:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.508500:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986211.508659:0:77102:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986211.508667:0:77102:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.508929:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.508938:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf5481f6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77102 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986211.508955:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986211.509054:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993477120:12345-0@lo:103:ldlm_bl.0 Request processed in 1262us (1377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986211.509063:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:1.0:1788986211.514724:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993477120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986212.295403:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986212.353352:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993477504:0@lo:400:kworker.0 00000100:00100000:0.0:1788986212.353410:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986212.353474:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788986212.353479:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993477376:0@lo:400:kworker.0 00000100:00100000:0.0:1788986212.353498:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986212.353512:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993477888:0@lo:400:kworker.0 00000100:00100000:0.0:1788986212.353542:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986212.353569:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993477504 00000100:00100000:0.0:1788986212.353575:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993477504 00000100:00100000:0.0:1788986212.353621:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993477376 00000100:00100000:0.0:1788986212.353624:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993477376 00000100:00100000:0.0:1788986212.353653:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1788986212.353661:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993477504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986212.353719:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993477504:12345-0@lo:400:kworker.0 Request processed in 59us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986212.353726:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:0.0:1788986212.353742:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:0.0:1788986212.353748:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993477376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986212.353774:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993477376:12345-0@lo:400:kworker.0 Request processed in 26us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986212.353779:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:0.0:1788986212.353802:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993477888 00000100:00100000:0.0:1788986212.353805:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993477888 00000100:00100000:0.0:1788986212.353832:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:0.0:1788986212.353839:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993477888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986212.353868:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993477888:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986212.353874:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00080000:0.0:1788986212.353895:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986212.353899:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986212.353932:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993477376:0@lo:400:kworker.0 00000100:00100000:1.0:1788986212.353941:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993477248:0@lo:400:kworker.0 00000100:00100000:0.0:1788986212.353942:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993477888:0@lo:400:kworker.0 00000100:00100000:0.0:1788986212.353949:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993477504:0@lo:400:kworker.0 00000100:00100000:1.0:1788986212.353973:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986212.353999:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993477760:0@lo:400:kworker.0 00000100:00100000:1.0:1788986212.354020:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986212.354021:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993477632:0@lo:400:kworker.0 00000100:00100000:2.0:1788986212.354048:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986212.354057:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993477248 00000100:00100000:1.0:1788986212.354060:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993477248 00000100:00100000:1.0:1788986212.354084:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:1.0:1788986212.354125:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993477248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986212.354269:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993477248:12345-0@lo:400:kworker.0 Request processed in 43us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986212.354279:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1788986212.354601:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993477248:0@lo:400:kworker.0 00000100:00100000:0.0:1788986212.358125:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993477760 00000100:00100000:0.0:1788986212.358138:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993477760 00000100:00100000:0.0:1788986212.358201:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1395 00000100:00100000:0.0:1788986212.358221:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993477760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986212.358302:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993477760:12345-0@lo:400:kworker.0 Request processed in 82us (4279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986212.358309:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1395 00000100:00100000:0.0:1788986212.358332:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993477632 00000100:00100000:0.0:1788986212.358335:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993477632 00000100:00100000:0.0:1788986212.358358:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:0.0:1788986212.358364:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993477632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986212.358399:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993477632:12345-0@lo:400:kworker.0 Request processed in 35us (4350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986212.358405:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:0.0:1788986212.358456:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993477760:0@lo:400:kworker.0 00000100:00100000:0.0:1788986212.358502:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993477632:0@lo:400:kworker.0 00000100:00080000:2.0:1788986212.359577:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1788986212.396801:0:77151:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffabd287d0 20000000:00000080:1.0:1788986212.396817:0:77151:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80827c00 uarg=0000000000000000 10000000:01000000:1.0:1788986212.397062:0:77151:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986212.397080:0:77151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5481fd lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986212.397121:0:77151:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5481fd lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986212.397132:0:77151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5481fd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986212.397139:0:77151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5481fd lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986212.397146:0:77151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5481fd lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986212.397167:0:77151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5481fd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986212.397174:0:77151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986212.397178:0:77151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5481fd lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986212.397185:0:77151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5481fd lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986212.397196:0:77151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5481fd lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986212.397218:0:77151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5481fd lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986212.397225:0:77151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf5481fd lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986212.870364:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986212.870386:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993478016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986212.870457:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986212.870522:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993478016 00000100:00100000:2.0:1788986212.870528:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993478016 00000100:00100000:2.0:1788986212.870568:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1788986212.870577:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993478016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986212.870609:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986212.870653:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993478016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986212.870661:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:2.0:1788986212.870702:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993478016:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1788986213.227656:0:77199:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff359f9e80 20000000:00000080:3.0:1788986213.227685:0:77199:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094197e000 uarg=0000000000000000 10000000:01000000:3.0:1788986213.227891:0:77199:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986213.227913:0:77199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548204 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.227930:0:77199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548204 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.227941:0:77199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548204 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.227948:0:77199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548204 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.227954:0:77199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548204 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.227962:0:77199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548204 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.227969:0:77199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986213.227973:0:77199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548204 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.227981:0:77199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548204 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.227993:0:77199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548204 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.228001:0:77199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548204 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.228007:0:77199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548204 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986213.248279:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986213.248287:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986213.248292:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986213.248344:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986213.248357:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986213.248370:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986213.248396:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993478144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986213.248467:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986213.248517:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788986213.248571:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993478144 00000100:00100000:3.0:1788986213.248579:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993478144 00000100:00100000:3.0:1788986213.248642:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1788986213.248651:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993478144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986213.248663:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986213.248676:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548212 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54820b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.248697:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548212 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54820b expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.248706:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548212 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54820b expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.248713:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3800, rc 0) 00000100:00100000:3.0:1788986213.248754:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993478144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986213.248760:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1788986213.248801:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993478144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986213.248812:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548212 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.248821:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548212 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986213.248839:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986213.248844:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548212 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986213.248851:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548212 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986213.312250:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986214.275965:0:77248:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc81d41740 20000000:00000080:2.0:1788986214.275982:0:77248:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80efa800 uarg=0000000000000000 10000000:01000000:3.0:1788986214.276395:0:77248:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986214.276413:0:77248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986214.276430:0:77248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548212 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54820b expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986214.276439:0:77248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986214.276472:0:77248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548212 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54820b expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986214.276484:0:77248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548212 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54820b expref: 18 pid: 5848 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986214.276497:0:77248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77248:1875885993478272:0@lo:104: 00000100:00100000:3.0:1788986214.276550:0:77248:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986214.276641:0:77248:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51248480 going to sleep for 11 seconds 00000100:00100000:1.0:1788986214.276734:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993478272 00000100:00100000:1.0:1788986214.276741:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993478272 00000100:00100000:1.0:1788986214.276809:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788986214.276818:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:77248:x1875885993478272:12345-0@lo:104: 00010000:00010000:1.0:1788986214.276830:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548212 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986214.276930:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986214.276936:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:77248:x1875885993478272:12345-0@lo:104: Request processed in 120us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986214.276942:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00010000:00010000:0.0:1788986214.276987:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986214.276993:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548212 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277000:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986214.277003:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548212 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277011:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548212 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986214.277018:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548212 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986214.277026:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986214.277057:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548212 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277063:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986214.277080:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548212 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277116:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54820b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548212 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277130:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986214.277132:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986214.277133:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986214.277150:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993478400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986214.277178:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986214.277222:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993478400 00000100:00100000:0.0:1788986214.277226:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993478400 00010000:00010000:0.0:1788986214.277243:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548212 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54820b expref: 19 pid: 5848 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986214.277262:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788986214.277268:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993478400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986214.277277:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986214.277282:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548212 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54820b expref: 19 pid: 5848 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277291:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548212 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54820b expref: 19 pid: 5848 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277304:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277312:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277325:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277333:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277340:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277346:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277351:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986214.277355:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277362:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277371:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986214.277380:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986214.277408:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993478400:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986214.277418:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:0.0:1788986214.277449:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993478400:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986214.277660:0:77248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf548212 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54820b expref: 18 pid: 5848 timeout: 2098 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986214.277672:0:77248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77248:1875885993478272:0@lo:104: 00010000:00010000:3.0:1788986214.277684:0:77248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986214.277693:0:77248:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986214.277704:0:77248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986214.277711:0:77248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548219 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986214.337651:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986214.514606:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986214.514678:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986214.515603:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986214.515633:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986214.515678:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971250944 00000100:00100000:3.0:1788986214.515690:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971250944 00000100:00100000:3.0:1788986214.515764:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971251072 00000100:00100000:3.0:1788986214.515767:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971251072 00000100:00100000:3.0:1788986214.515796:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 358 00000100:00100000:3.0:1788986214.515809:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971250944:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788986214.515848:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf547905 00000100:00080000:3.0:1788986214.515860:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9b0a76051800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788986214.515906:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967337 00000100:00100000:3.0:1788986214.516290:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971250944:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 483us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986214.516299:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 358 00000100:00100000:3.0:1788986214.516318:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 359 00000100:00100000:3.0:1788986214.516325:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971251072:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788986214.516341:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54811d 00000100:00080000:3.0:1788986214.516348:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9b0a489e9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788986214.516374:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967337 00000100:00100000:3.0:1788986214.516524:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971251072:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 198us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986214.516531:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 359 00000100:00080000:3.0:1788986214.516559:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986214.516563:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986214.516580:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986214.516675:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986214.517881:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971250816 00000100:00100000:2.0:1788986214.517895:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971250816 00000100:00080000:3.0:1788986214.517974:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986214.517981:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1396 00000100:00100000:2.0:1788986214.517992:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971250816:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986214.518071:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971250816:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 80us (3392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986214.518078:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1396 00000100:00100000:1.0:1788986214.518200:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971250688 00000100:00100000:1.0:1788986214.518207:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971250688 00000100:00100000:1.0:1788986214.518244:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1147 00000100:00100000:1.0:1788986214.518252:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971250688:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986214.518295:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971250688:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (3702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986214.518302:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1147 00000020:00000080:0.0:1788986215.187997:0:77296:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0abfca80 20000000:00000080:0.0:1788986215.188013:0:77296:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7663ac00 uarg=0000000000000000 10000000:01000000:0.0:1788986215.188766:0:77296:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986215.188858:0:77296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf548220 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986215.188874:0:77296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf548220 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986215.188884:0:77296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf548220 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986215.188891:0:77296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf548220 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986215.188898:0:77296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf548220 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986215.188904:0:77296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf548220 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986215.188911:0:77296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986215.188915:0:77296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf548220 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986215.188922:0:77296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf548220 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986215.188938:0:77296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf548220 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986215.188946:0:77296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf548220 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986215.188952:0:77296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf548220 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986215.361536:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986216.037373:0:77346:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe21f6a2b0 20000000:00000080:2.0:1788986216.037388:0:77346:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80ef9000 uarg=0000000000000000 10000000:01000000:2.0:1788986216.037759:0:77346:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986216.037780:0:77346:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548227 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986216.037795:0:77346:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548227 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986216.037805:0:77346:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548227 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986216.037812:0:77346:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548227 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986216.037820:0:77346:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548227 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986216.037827:0:77346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548227 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986216.037833:0:77346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986216.037837:0:77346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548227 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986216.037845:0:77346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548227 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986216.037857:0:77346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548227 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986216.037865:0:77346:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548227 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986216.037872:0:77346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548227 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77346 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986216.130498:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986216.130505:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986216.130510:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986216.130548:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986216.130560:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986216.130571:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986216.130595:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993478528:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986216.130655:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986216.130707:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993478528 00000100:00100000:0.0:1788986216.130711:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986216.130714:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993478528 00000100:00100000:1.0:1788986216.130758:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:1.0:1788986216.130768:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993478528:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986216.130779:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986216.130793:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548235 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54822e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986216.130814:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548235 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54822e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986216.130825:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548235 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54822e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986216.130833:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788986216.130887:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993478528:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986216.130895:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:0.0:1788986216.132720:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993478528:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986216.132743:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548235 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986216.132759:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548235 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986216.132781:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986216.132785:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548235 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986216.132792:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548235 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986216.384261:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986216.452570:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986216.452593:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993478656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986216.452659:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986216.452726:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993478656 00000100:00100000:0.0:1788986216.452734:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993478656 00000100:00100000:0.0:1788986216.452784:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1788986216.452794:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993478656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986216.452839:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986216.452882:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993478656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986216.452889:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00080000:0.0:1788986216.452909:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986216.452945:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993478656:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986217.410552:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986217.473915:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993478784:0@lo:400:kworker.0 00000100:00100000:2.0:1788986217.473970:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993478912:0@lo:400:kworker.0 00000100:00100000:0.0:1788986217.473979:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986217.474189:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993479168:0@lo:400:kworker.0 00000100:00100000:3.0:1788986217.476562:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993478784 00000100:00100000:3.0:1788986217.476573:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993478784 00000100:00100000:3.0:1788986217.476622:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:3.0:1788986217.476632:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993478784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986217.478173:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986217.478203:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993479296:0@lo:400:kworker.0 00000100:00100000:2.0:1788986217.478218:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993479424:0@lo:400:kworker.0 00000100:00100000:2.0:1788986217.479210:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986217.479268:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993478912 00000100:00100000:2.0:1788986217.479275:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993478912 00000100:00100000:2.0:1788986217.479316:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1788986217.479324:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993478912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986217.479376:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993478912:12345-0@lo:400:kworker.0 Request processed in 52us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986217.479383:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:2.0:1788986217.479627:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993479424 00000100:00100000:2.0:1788986217.479632:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993479424 00000100:00100000:2.0:1788986217.479668:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1788986217.479675:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993479424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986217.479710:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993479424:12345-0@lo:400:kworker.0 Request processed in 35us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986217.479716:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00080000:2.0:1788986217.479735:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986217.479808:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993478784:12345-0@lo:400:kworker.0 Request processed in 3177us (5826us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986217.479817:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:3.0:1788986217.479882:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993479040:0@lo:400:kworker.0 00000100:00100000:3.0:1788986217.479907:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986217.479974:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993478912:0@lo:400:kworker.0 00000100:00100000:2.0:1788986217.480170:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993479424:0@lo:400:kworker.0 00000100:00100000:0.0:1788986217.482757:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986217.482823:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993478784:0@lo:400:kworker.0 00000100:00100000:0.0:1788986217.482874:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993479040 00000100:00100000:0.0:1788986217.482880:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993479040 00000100:00100000:2.0:1788986217.483003:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993479296 00000100:00100000:2.0:1788986217.483008:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993479296 00000100:00100000:0.0:1788986217.483074:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1788986217.483085:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993479040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986217.483200:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993479040:12345-0@lo:400:kworker.0 Request processed in 117us (3291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986217.483207:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:0.0:1788986217.483241:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993479040:0@lo:400:kworker.0 00000100:00100000:1.0:1788986217.484902:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986217.485029:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993479168 00000100:00100000:0.0:1788986217.485036:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993479168 00000100:00100000:0.0:1788986217.485104:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1788986217.485122:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993479168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986217.485195:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993479168:12345-0@lo:400:kworker.0 Request processed in 75us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986217.485201:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:1.0:1788986217.485503:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993479168:0@lo:400:kworker.0 00000100:00080000:3.0:1788986217.486068:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986217.487838:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:2.0:1788986217.487850:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993479296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986217.487949:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993479296:12345-0@lo:400:kworker.0 Request processed in 101us (5197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986217.487955:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:1.0:1788986217.489881:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993479296:0@lo:400:kworker.0 00000100:00100000:2.0:1788986217.988222:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993479552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986217.988282:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986217.988568:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993479552 00000100:00100000:2.0:1788986217.988576:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993479552 00000100:00100000:2.0:1788986217.988618:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1788986217.988627:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993479552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986217.988656:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986217.988701:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993479552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986217.988708:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 709 00000100:00100000:2.0:1788986217.988758:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993479552:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788986218.040940:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788986218.040949:0:6721:0:(genops.c:885:class_export_put()) final put ffff9b0a76050000/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788986218.040973:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a76050000/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0000 00000020:00000080:2.0:1788986218.041014:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a76051800 for lustre-OST0000 00000001:00100000:0.0:1788986218.077804:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:0.0:1788986218.077811:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b0a489ed000/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:0.0:1788986218.077831:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a489ed000/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0001 00000020:00000080:0.0:1788986218.077866:0:489:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a489e9000 for lustre-OST0001 00010000:00010000:1.0:1788986218.441218:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788986218.832816:0:77496:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda20a80e0 20000000:00000080:0.0:1788986218.832833:0:77496:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76002c00 uarg=0000000000000000 10000000:01000000:0.0:1788986218.833020:0:77496:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986218.833040:0:77496:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986218.833058:0:77496:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548235 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54822e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986218.833067:0:77496:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986218.833697:0:77496:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548235 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54822e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986218.833712:0:77496:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548235 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54822e expref: 18 pid: 5846 timeout: 2102 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986218.833726:0:77496:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77496:1875885993479680:0@lo:104: 00000100:00100000:0.0:1788986218.833782:0:77496:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986218.833874:0:77496:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c61540 going to sleep for 11 seconds 00000100:00100000:2.0:1788986218.833944:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993479680 00000100:00100000:2.0:1788986218.833951:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993479680 00000100:00100000:2.0:1788986218.834038:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788986218.834048:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:77496:x1875885993479680:12345-0@lo:104: 00010000:00010000:2.0:1788986218.834060:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548235 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986218.834490:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986218.834499:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:77496:x1875885993479680:12345-0@lo:104: Request processed in 452us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986218.834507:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00010000:00010000:3.0:1788986218.834792:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986218.834800:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548235 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986218.834808:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986218.834813:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548235 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986218.834822:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548235 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986218.834830:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548235 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986218.834836:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986218.834875:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548235 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986218.834881:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986218.834901:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548235 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986218.834908:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf54822e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548235 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986218.834922:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986218.834924:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986218.834925:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986218.834948:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993479808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986218.834981:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986218.835062:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993479808 00000100:00100000:1.0:1788986218.835068:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993479808 00010000:00010000:1.0:1788986218.835116:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548235 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54822e expref: 19 pid: 5846 timeout: 2102 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986218.835143:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788986218.835152:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993479808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986218.835164:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986218.835179:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548235 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54822e expref: 19 pid: 5846 timeout: 2102 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986218.835189:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548235 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54822e expref: 19 pid: 5846 timeout: 2102 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986218.835203:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986218.835211:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986218.835224:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986218.835230:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986218.835236:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986218.835242:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986218.835246:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986218.835250:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986218.835256:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986218.835267:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986218.835274:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986218.835314:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993479808:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986218.835321:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788986218.835547:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993479808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986218.836329:0:77496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548235 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54822e expref: 18 pid: 5846 timeout: 2102 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986218.836344:0:77496:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77496:1875885993479680:0@lo:104: 00010000:00010000:0.0:1788986218.836360:0:77496:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986218.836986:0:77496:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986218.836996:0:77496:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986218.837002:0:77496:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54823c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77496 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986219.457335:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986219.636017:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986219.636071:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986219.636147:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971251328 00000100:00100000:3.0:1788986219.636156:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971251328 00000100:00100000:3.0:1788986219.636230:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1400 00000100:00100000:3.0:1788986219.636242:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971251328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986219.636306:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971251328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986219.636315:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1400 00000100:00080000:3.0:1788986219.636342:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986219.636509:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971251200 00000100:00100000:0.0:1788986219.636514:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971251200 00000100:00100000:0.0:1788986219.636548:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1150 00000100:00100000:0.0:1788986219.636555:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971251200:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986219.636583:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971251200:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986219.636593:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1150 00000020:00000080:1.0:1788986219.675672:0:77545:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd2504db0 20000000:00000080:1.0:1788986219.675687:0:77545:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a797aa000 uarg=0000000000000000 10000000:01000000:1.0:1788986219.675852:0:77545:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986219.675870:0:77545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548243 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986219.675885:0:77545:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548243 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986219.675895:0:77545:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548243 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986219.675902:0:77545:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548243 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986219.675909:0:77545:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548243 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986219.675916:0:77545:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548243 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986219.675923:0:77545:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986219.675928:0:77545:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548243 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986219.675936:0:77545:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548243 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986219.675947:0:77545:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548243 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986219.675954:0:77545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548243 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986219.675960:0:77545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548243 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986220.163311:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986220.163319:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986220.163324:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986220.163368:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986220.163381:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986220.163391:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986220.163416:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993479936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986220.163475:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986220.163526:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a73a2b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788986220.164265:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993479936 00000100:00100000:1.0:1788986220.164276:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993479936 00000100:00100000:1.0:1788986220.164331:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1788986220.164340:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993479936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986220.164354:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986220.164367:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548251 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54824a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986220.164390:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548251 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54824a expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986220.164402:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548251 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54824a expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986220.164410:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00100000:1.0:1788986220.164460:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993479936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986220.164467:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1151 00000100:00100000:1.0:1788986220.164514:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993479936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986220.164530:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548251 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986220.164539:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548251 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986220.164559:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986220.164564:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548251 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986220.164572:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548251 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986220.482211:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986221.510797:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986221.570814:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993480064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986221.570883:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986221.571001:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993480064 00000100:00100000:2.0:1788986221.571009:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993480064 00000100:00100000:2.0:1788986221.571072:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:2.0:1788986221.571082:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993480064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986221.571152:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788986221.571231:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986221.576702:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993480064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5615us (5812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986221.576715:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:2.0:1788986221.578536:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993480064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986222.528294:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986222.604176:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993480576:0@lo:400:kworker.0 00000100:00100000:2.0:1788986222.604237:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986222.604295:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788986222.604303:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993480192:0@lo:400:kworker.0 00000100:00100000:2.0:1788986222.604339:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986222.604365:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993480704:0@lo:400:kworker.0 00000100:00100000:2.0:1788986222.604391:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986222.604422:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993480576 00000100:00100000:2.0:1788986222.604434:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993480576 00000100:00100000:2.0:1788986222.604478:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1788986222.604487:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993480576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986222.604536:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993480576:12345-0@lo:400:kworker.0 Request processed in 49us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986222.604542:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1788986222.604581:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993480576:0@lo:400:kworker.0 00000100:00100000:3.0:1788986222.604724:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993480320:0@lo:400:kworker.0 00000100:00100000:3.0:1788986222.604750:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986222.604764:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993480832:0@lo:400:kworker.0 00000100:00100000:3.0:1788986222.604780:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986222.604796:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986222.604801:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993480448:0@lo:400:kworker.0 00000100:00100000:3.0:1788986222.604817:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986222.604839:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993480192 00000100:00100000:3.0:1788986222.604843:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993480192 00000100:00100000:3.0:1788986222.604879:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1788986222.604885:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993480192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986222.604915:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993480192:12345-0@lo:400:kworker.0 Request processed in 31us (576us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986222.604922:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1788986222.604944:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993480704 00000100:00100000:3.0:1788986222.604947:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993480704 00000100:00100000:3.0:1788986222.604970:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993480320 00000100:00100000:3.0:1788986222.604972:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993480320 00000100:00100000:3.0:1788986222.604985:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993480448 00000100:00100000:3.0:1788986222.604987:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993480448 00000100:00100000:3.0:1788986222.605000:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1788986222.605005:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993480704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986222.605032:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993480704:12345-0@lo:400:kworker.0 Request processed in 27us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986222.605038:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1401 00000100:00100000:3.0:1788986222.605049:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1788986222.605054:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993480320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986222.605083:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993480320:12345-0@lo:400:kworker.0 Request processed in 29us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986222.605110:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1788986222.605124:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1788986222.605129:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993480448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986222.605171:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993480448:12345-0@lo:400:kworker.0 Request processed in 41us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986222.605176:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1788986222.605198:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993480832 00000100:00100000:3.0:1788986222.605201:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993480832 00000100:00100000:3.0:1788986222.605227:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1788986222.605233:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993480832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986222.605263:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993480832:12345-0@lo:400:kworker.0 Request processed in 30us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986222.605268:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1788986222.605301:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993480192:0@lo:400:kworker.0 00000100:00100000:3.0:1788986222.605314:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993480704:0@lo:400:kworker.0 00000100:00080000:3.0:1788986222.605335:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986222.605340:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986222.605364:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993480448:0@lo:400:kworker.0 00000100:00100000:3.0:1788986222.605374:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993480320:0@lo:400:kworker.0 00000100:00100000:3.0:1788986222.605383:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993480832:0@lo:400:kworker.0 00000100:00100000:0.0:1788986223.110477:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986223.110498:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993480960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986223.110559:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986223.110841:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993480960 00000100:00100000:1.0:1788986223.110849:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993480960 00000100:00100000:1.0:1788986223.110900:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1788986223.110909:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993480960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986223.110938:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986223.110994:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993480960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986223.111000:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:1.0:1788986223.111041:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993480960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986223.552258:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986223.554527:0:77741:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd3c9ab8c0 20000000:00000080:2.0:1788986223.554543:0:77741:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a765ae400 uarg=0000000000000000 00010000:00010000:2.0:1788986223.555423:0:77741:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986223.555439:0:77741:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986223.555453:0:77741:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986223.555686:0:77741:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986223.555703:0:77741:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548251 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54824a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986223.555711:0:77741:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986223.555746:0:77741:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548251 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54824a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986223.555761:0:77741:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548251 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54824a expref: 18 pid: 5846 timeout: 2107 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986223.555840:0:77741:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77741:1875885993481088:0@lo:104: 00000100:00100000:2.0:1788986223.555894:0:77741:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986223.556025:0:77741:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09427c4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788986223.556037:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993481088 00000100:00100000:1.0:1788986223.556044:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993481088 00000100:00100000:1.0:1788986223.556131:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788986223.556140:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:77741:x1875885993481088:12345-0@lo:104: 00010000:00010000:1.0:1788986223.556163:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548251 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986223.556213:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986223.556219:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:77741:x1875885993481088:12345-0@lo:104: Request processed in 82us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986223.556226:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00010000:00010000:0.0:1788986223.556378:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986223.556385:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548251 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.556404:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986223.556407:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548251 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.556421:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548251 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986223.556428:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548251 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986223.556434:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1788986223.556534:0:77741:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77741:1875885993481088:0@lo:104: 00010000:00010000:3.0:1788986223.556553:0:77741:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.556793:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548251 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.556800:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986223.556827:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548251 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.556834:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54824a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548251 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.556850:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986223.556852:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986223.556854:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986223.557022:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986223.557035:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993481216:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986223.557066:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986223.557364:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993481216 00000100:00100000:0.0:1788986223.557369:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993481216 00010000:00010000:0.0:1788986223.557390:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548251 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54824a expref: 19 pid: 5846 timeout: 2107 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986223.557420:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788986223.557427:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993481216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986223.557436:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986223.557441:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548251 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54824a expref: 19 pid: 5846 timeout: 2107 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.557451:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548251 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54824a expref: 19 pid: 5846 timeout: 2107 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.557473:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf548251 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54824a expref: 19 pid: 5846 timeout: 2107 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.557488:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.557496:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.557509:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.557516:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.557523:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.557530:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.557535:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986223.557539:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.557546:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.557559:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986223.557569:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986223.557603:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993481216:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (536us total) trans 0 rc 0/0 00010000:00010000:3.0:1788986223.557740:0:77741:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986223.557749:0:77741:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986223.557756:0:77741:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548258 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77741 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986223.558727:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:0.0:1788986223.558777:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993481216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986224.576265:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986224.758066:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986224.758165:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986224.758243:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971251584 00000100:00100000:0.0:1788986224.758252:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971251584 00000100:00100000:0.0:1788986224.758326:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1404 00000100:00100000:0.0:1788986224.758336:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971251584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986224.758400:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971251584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 66us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986224.758406:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1404 00000100:00080000:2.0:1788986224.758474:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986224.758558:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971251456 00000100:00100000:3.0:1788986224.758563:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971251456 00000100:00100000:3.0:1788986224.758595:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1153 00000100:00100000:3.0:1788986224.758601:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971251456:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986224.758723:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971251456:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 121us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986224.758729:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1153 10000000:01000000:1.0:1788986225.344204:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986225.344210:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986225.344215:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986225.344262:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986225.344273:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986225.344285:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986225.344309:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993481344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986225.344372:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986225.344435:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788986225.344544:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993481344 00000100:00100000:3.0:1788986225.344552:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993481344 00000100:00100000:3.0:1788986225.344619:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:3.0:1788986225.344629:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993481344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986225.344641:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986225.344655:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf548266 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54825f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986225.344676:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf548266 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54825f expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986225.344686:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf548266 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54825f expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986225.344694:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2c00, rc 0) 00000100:00100000:3.0:1788986225.344741:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993481344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986225.344747:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:1.0:1788986225.344944:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993481344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986225.344957:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548266 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986225.344965:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548266 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986225.344983:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986225.344988:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548266 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986225.344995:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548266 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986225.602011:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986226.624312:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986226.688326:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986226.688352:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993481472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986226.688419:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986226.688545:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993481472 00000100:00100000:1.0:1788986226.688553:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993481472 00000100:00100000:1.0:1788986226.688622:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:1.0:1788986226.688632:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993481472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986226.688664:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986226.688713:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993481472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986226.688720:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00080000:2.0:1788986226.689075:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986226.689143:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993481472:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788986227.234204:0:77938:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd592612b0 20000000:00000080:0.0:1788986227.234220:0:77938:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76003c00 uarg=0000000000000000 00010000:00010000:0.0:1788986227.234651:0:77938:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986227.234665:0:77938:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986227.234677:0:77938:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986227.234694:0:77938:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986227.234710:0:77938:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf548266 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54825f expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986227.234722:0:77938:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986227.234758:0:77938:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf548266 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54825f expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986227.234772:0:77938:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf548266 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54825f expref: 18 pid: 5848 timeout: 2111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986227.234786:0:77938:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77938:1875885993481600:0@lo:104: 00000100:00100000:0.0:1788986227.234839:0:77938:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986227.234890:0:77938:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76582300 going to sleep for 11 seconds 00000100:00100000:2.0:1788986227.235011:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993481600 00000100:00100000:2.0:1788986227.235018:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993481600 00000100:00100000:2.0:1788986227.235063:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788986227.235072:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:77938:x1875885993481600:12345-0@lo:104: 00010000:00010000:2.0:1788986227.235084:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548266 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986227.235177:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986227.235184:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:77938:x1875885993481600:12345-0@lo:104: Request processed in 113us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986227.235191:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00010000:00010000:3.0:1788986227.235291:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986227.235298:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548266 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235305:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986227.235309:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548266 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235319:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548266 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986227.235326:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548266 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986227.235332:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986227.235364:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548266 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235371:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986227.235396:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548266 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235404:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf54825f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548266 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235421:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986227.235422:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986227.235424:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986227.235431:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986227.235440:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993481728:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986227.235470:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986227.235500:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993481728 00000100:00100000:3.0:1788986227.235504:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993481728 00010000:00010000:3.0:1788986227.235523:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf548266 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54825f expref: 19 pid: 5848 timeout: 2111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986227.235545:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788986227.235551:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993481728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986227.235561:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986227.235566:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf548266 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54825f expref: 19 pid: 5848 timeout: 2111 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235576:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf548266 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54825f expref: 19 pid: 5848 timeout: 2111 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235590:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235597:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235609:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235617:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235623:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235629:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235633:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986227.235637:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235643:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235651:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986227.235659:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986227.235685:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993481728:12345-0@lo:103:ldlm_bl.0 Request processed in 134us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986227.235692:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788986227.235729:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993481728:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986227.235929:0:77938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf548266 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54825f expref: 18 pid: 5848 timeout: 2111 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986227.235940:0:77938:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:77938:1875885993481600:0@lo:104: 00010000:00010000:0.0:1788986227.235952:0:77938:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986227.235960:0:77938:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986227.235967:0:77938:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986227.235974:0:77938:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54826d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77938 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986227.648611:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986227.712827:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993481984:0@lo:400:kworker.0 00000100:00100000:2.0:1788986227.712889:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986227.712949:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986227.712956:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993482112:0@lo:400:kworker.0 00000100:00100000:2.0:1788986227.712980:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986227.713008:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993481984 00000100:00100000:2.0:1788986227.713015:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993481984 00000100:00100000:2.0:1788986227.713062:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:2.0:1788986227.713071:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993481984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986227.713115:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993482240:0@lo:400:kworker.0 00000100:00100000:2.0:1788986227.713152:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993481984:12345-0@lo:400:kworker.0 Request processed in 82us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986227.713161:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:0.0:1788986227.713166:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986227.713193:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788986227.713200:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993481856:0@lo:400:kworker.0 00000100:00100000:0.0:1788986227.713399:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986227.715785:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993482240 00000100:00100000:2.0:1788986227.715797:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993482240 00000100:00100000:2.0:1788986227.715861:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:2.0:1788986227.715870:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993482240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986227.715942:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993482240:12345-0@lo:400:kworker.0 Request processed in 74us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986227.715950:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:2.0:1788986227.715979:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993482112 00000100:00100000:2.0:1788986227.715983:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993482112 00000100:00100000:2.0:1788986227.716024:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1788986227.716031:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993482112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986227.716064:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993482112:12345-0@lo:400:kworker.0 Request processed in 34us (3084us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986227.716070:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00080000:2.0:1788986227.716085:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986227.716151:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993482112:0@lo:400:kworker.0 00000100:00100000:2.0:1788986227.716165:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993481984:0@lo:400:kworker.0 00000100:00100000:0.0:1788986227.716593:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993482368:0@lo:400:kworker.0 00000100:00100000:0.0:1788986227.716628:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986227.716670:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993482240:0@lo:400:kworker.0 00000100:00100000:2.0:1788986227.716757:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993482368 00000100:00100000:2.0:1788986227.716762:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993482368 00000100:00100000:2.0:1788986227.716795:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1788986227.716802:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993482368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986227.716845:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993482368:12345-0@lo:400:kworker.0 Request processed in 43us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986227.716850:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00080000:2.0:1788986227.716868:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986227.716885:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993482368:0@lo:400:kworker.0 00000100:00100000:3.0:1788986227.718836:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993481856 00000100:00100000:3.0:1788986227.718848:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993481856 00000100:00100000:3.0:1788986227.718907:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:3.0:1788986227.718918:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993481856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986227.718994:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993481856:12345-0@lo:400:kworker.0 Request processed in 79us (5595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986227.719001:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:2.0:1788986227.719143:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993481856:0@lo:400:kworker.0 00000020:00000080:2.0:1788986228.092381:0:77986:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe0fbf9550 20000000:00000080:2.0:1788986228.092397:0:77986:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a765af000 uarg=0000000000000000 00010000:00010000:2.0:1788986228.092631:0:77986:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986228.092646:0:77986:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986228.092658:0:77986:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986228.092676:0:77986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf548274 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 77986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986228.092690:0:77986:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf548274 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 77986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986228.092700:0:77986:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf548274 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 77986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986228.092707:0:77986:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf548274 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986228.092715:0:77986:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf548274 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 77986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986228.092723:0:77986:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf548274 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986228.092730:0:77986:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986228.092734:0:77986:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf548274 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 77986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986228.092742:0:77986:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf548274 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 77986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986228.092754:0:77986:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf548274 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986228.092763:0:77986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf548274 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986228.092769:0:77986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf548274 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 77986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986228.233140:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986228.233162:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993482496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986228.233222:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986228.233279:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993482496 00000100:00100000:3.0:1788986228.233286:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993482496 00000100:00100000:3.0:1788986228.233330:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1788986228.233339:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993482496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986228.233372:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986228.233417:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993482496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986228.233423:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 713 00000100:00100000:3.0:1788986228.233499:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993482496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986228.672229:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788986228.930933:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986228.930940:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986228.930945:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986228.930999:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986228.931010:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986228.931021:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986228.931046:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993482624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986228.931136:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986228.931178:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b6a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788986228.931197:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993482624 00000100:00100000:0.0:1788986228.931204:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993482624 00000100:00100000:0.0:1788986228.931245:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1788986228.931253:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993482624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986228.931265:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986228.931277:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548282 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54827b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986228.931300:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548282 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54827b expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986228.931311:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548282 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54827b expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986228.931321:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788986228.931354:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993482624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986228.931361:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1155 00000100:00100000:0.0:1788986228.931402:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993482624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986228.931415:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548282 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986228.931424:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548282 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986228.931440:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986228.931445:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548282 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986228.931452:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548282 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986229.701927:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986229.875716:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986229.875762:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986229.875791:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971251712 00000100:00100000:0.0:1788986229.875800:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971251712 00000100:00100000:0.0:1788986229.875843:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1156 00000100:00100000:0.0:1788986229.875852:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971251712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986229.875918:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971251712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986229.875926:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1156 00000100:00100000:3.0:1788986229.876072:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971251840 00000100:00100000:3.0:1788986229.876077:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971251840 00000100:00100000:3.0:1788986229.876147:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1408 00000100:00100000:3.0:1788986229.876155:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971251840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986229.876199:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971251840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 45us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986229.876206:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1408 00000100:00080000:3.0:1788986229.876224:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986230.721044:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986231.744363:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986231.809698:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986231.809721:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993482752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986231.809786:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986231.809965:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993482752 00000100:00100000:3.0:1788986231.809973:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993482752 00000100:00100000:3.0:1788986231.810037:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:3.0:1788986231.810046:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993482752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986231.810079:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986231.810174:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993482752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986231.810180:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1788986231.810312:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993482752:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986231.810385:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986232.773876:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986232.834318:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993483136:0@lo:400:kworker.0 00000100:00100000:0.0:1788986232.834443:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986232.834491:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986232.834498:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993483264:0@lo:400:kworker.0 00000100:00100000:0.0:1788986232.834522:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986232.834559:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993483264 00000100:00100000:0.0:1788986232.834577:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993483264 00000100:00100000:0.0:1788986232.834623:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1788986232.834631:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993483264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986232.834678:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993483264:12345-0@lo:400:kworker.0 Request processed in 48us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986232.834684:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1788986232.834725:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993483264:0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835021:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993483008:0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835052:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986232.835077:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993483520:0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835135:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986232.835172:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788986232.835178:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993482880:0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835205:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986232.835228:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993483392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835249:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986232.835276:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993483136 00000100:00100000:3.0:1788986232.835280:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993483136 00000100:00100000:3.0:1788986232.835314:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993483008 00000100:00100000:3.0:1788986232.835317:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993483008 00000100:00100000:3.0:1788986232.835331:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993483392 00000100:00100000:3.0:1788986232.835333:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993483392 00000100:00100000:3.0:1788986232.835346:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1788986232.835351:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993483136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835385:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993483136:12345-0@lo:400:kworker.0 Request processed in 34us (944us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986232.835390:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1788986232.835402:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1788986232.835407:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993483008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835434:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993483008:12345-0@lo:400:kworker.0 Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986232.835440:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:3.0:1788986232.835451:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1788986232.835456:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993483392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835480:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993483392:12345-0@lo:400:kworker.0 Request processed in 24us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986232.835486:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:3.0:1788986232.835505:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993483520 00000100:00100000:3.0:1788986232.835508:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993483520 00000100:00100000:3.0:1788986232.835532:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1788986232.835538:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993483520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835580:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993483520:12345-0@lo:400:kworker.0 Request processed in 43us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986232.835586:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1788986232.835603:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993482880 00000100:00100000:3.0:1788986232.835607:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993482880 00000100:00100000:3.0:1788986232.835631:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:3.0:1788986232.835637:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993482880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835663:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993482880:12345-0@lo:400:kworker.0 Request processed in 26us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986232.835669:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00080000:3.0:1788986232.835692:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986232.835697:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986232.835724:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993482880:0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835735:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993483392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835743:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993483008:0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835751:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993483520:0@lo:400:kworker.0 00000100:00100000:3.0:1788986232.835783:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993483136:0@lo:400:kworker.0 00000100:00100000:0.0:1788986233.344345:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986233.344365:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993483648:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986233.344420:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986233.344473:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993483648 00000100:00100000:0.0:1788986233.344480:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993483648 00000100:00100000:0.0:1788986233.344530:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1788986233.344538:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993483648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986233.344568:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986233.344608:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993483648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986233.344615:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:0.0:1788986233.344907:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993483648:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788986233.720925:0:78282:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffb13af620 20000000:00000080:0.0:1788986233.720944:0:78282:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76000c00 uarg=0000000000000000 10000000:01000000:0.0:1788986233.720988:0:78282:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986233.721005:0:78282:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986233.721024:0:78282:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548282 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54827b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986233.721034:0:78282:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986233.721078:0:78282:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548282 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54827b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986233.721143:0:78282:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548282 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54827b expref: 18 pid: 5846 timeout: 2117 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986233.721157:0:78282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78282:1875885993483776:0@lo:104: 00000100:00100000:0.0:1788986233.721221:0:78282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986233.721269:0:78282:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76582b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788986233.721473:0:7642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788986233.721486:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993483776 00000100:00100000:2.0:1788986233.721492:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993483776 00000100:00100000:2.0:1788986233.721544:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788986233.721553:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094295ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:78282:x1875885993483776:12345-0@lo:104: 00010000:00010000:2.0:1788986233.721573:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548282 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986233.721642:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986233.721648:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094295ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:78282:x1875885993483776:12345-0@lo:104: Request processed in 97us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986233.721655:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00010000:00010000:3.0:1788986233.721760:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986233.721767:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548282 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.721774:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986233.721778:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548282 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.721789:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548282 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986233.721795:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548282 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986233.721801:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986233.721839:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548282 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.721845:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986233.721863:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548282 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.721870:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54827b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548282 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.721884:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986233.721887:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986233.721888:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986233.721898:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993483904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986233.721928:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986233.721941:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993483904 00000100:00100000:2.0:1788986233.721945:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993483904 00010000:00010000:2.0:1788986233.721963:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548282 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54827b expref: 19 pid: 5846 timeout: 2117 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986233.722052:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788986233.722061:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993483904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986233.722071:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986233.722077:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548282 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54827b expref: 19 pid: 5846 timeout: 2117 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.722122:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548282 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54827b expref: 19 pid: 5846 timeout: 2117 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.722137:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.722144:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.722158:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.722165:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.722172:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.722178:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.722184:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986233.722188:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.722195:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.722204:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986233.722216:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986233.722254:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993483904:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986233.722260:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00010000:00010000:0.0:1788986233.722413:0:78282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548282 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54827b expref: 18 pid: 5846 timeout: 2117 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986233.722438:0:78282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78282:1875885993483776:0@lo:104: 00010000:00010000:0.0:1788986233.722456:0:78282:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986233.722539:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993483904:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986233.722567:0:78282:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986233.722576:0:78282:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986233.722582:0:78282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf548289 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986233.793901:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986234.714036:0:78330:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc5240c050 20000000:00000080:3.0:1788986234.714052:0:78330:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f9e1000 uarg=0000000000000000 10000000:01000000:3.0:1788986234.714416:0:78330:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986234.714435:0:78330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548290 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986234.714450:0:78330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548290 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986234.714461:0:78330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548290 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986234.714469:0:78330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548290 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986234.714476:0:78330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548290 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986234.714484:0:78330:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548290 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986234.714491:0:78330:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986234.714495:0:78330:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548290 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986234.714503:0:78330:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548290 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986234.714516:0:78330:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548290 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986234.714525:0:78330:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548290 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986234.714532:0:78330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf548290 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78330 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986234.816459:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986234.992069:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986234.992163:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986234.992194:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971252096 00000100:00100000:3.0:1788986234.992202:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971252096 00000100:00100000:3.0:1788986234.992259:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1412 00000100:00100000:3.0:1788986234.992269:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971252096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986234.992337:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971252096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 70us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986234.992345:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1412 00000100:00080000:3.0:1788986234.992366:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986234.994263:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971251968 00000100:00100000:2.0:1788986234.994274:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971251968 00000100:00100000:2.0:1788986234.994369:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1158 00000100:00100000:2.0:1788986234.994379:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971251968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986235.003690:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971251968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 9303us (11619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986235.003704:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1158 10000000:01000000:0.0:1788986235.076514:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986235.076522:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986235.076527:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986235.076580:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986235.076592:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986235.076603:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986235.076626:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993484032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986235.076700:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986235.076743:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a511f8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788986235.076801:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993484032 00000100:00100000:0.0:1788986235.076807:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993484032 00000100:00100000:0.0:1788986235.076850:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1788986235.076858:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993484032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986235.076870:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986235.076881:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54829e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548297 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986235.076902:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54829e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548297 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986235.076912:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54829e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548297 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986235.076921:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee400, rc 0) 00000100:00100000:0.0:1788986235.076955:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993484032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986235.076962:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1159 00000100:00100000:0.0:1788986235.077005:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993484032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986235.077018:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54829e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986235.077027:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54829e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986235.077045:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986235.077049:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54829e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986235.077057:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54829e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986235.840703:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986236.865689:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986236.929129:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986236.929152:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993484160:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986236.929234:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986236.929440:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993484160 00000100:00100000:0.0:1788986236.929448:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993484160 00000100:00080000:3.0:1788986236.929516:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986236.934130:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1788986236.934153:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993484160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986236.934191:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986236.934270:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993484160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (5036us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986236.934277:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1788986236.934340:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993484160:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986237.812372:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986237.812462:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971252224 00000100:00100000:0.0:1788986237.812472:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971252224 00000100:00100000:0.0:1788986237.812547:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 657 00000100:00100000:0.0:1788986237.812559:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:45550:x1875885971252224:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986237.812578:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986237.812653:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ff6 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.812710:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5482ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.812724:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5482ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.812736:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5482ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986237.812767:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788986237.812771:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986237.812792:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5482ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.812813:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ff6 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.812827:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5482ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ff6 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.812834:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986237.812837:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986237.812839:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee000, rc 0) 00000100:00100000:0.0:1788986237.812899:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45550:x1875885971252224:12345-192.168.206.21@tcp:101:rm.0 Request processed in 342us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986237.812906:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 657 00000100:00080000:3.0:1788986237.813318:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986237.822816:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986237.822905:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971252352 00000100:00100000:3.0:1788986237.822914:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971252352 00000100:00100000:3.0:1788986237.822972:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 658 00000100:00100000:3.0:1788986237.822981:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45550:x1875885971252352:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986237.822999:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986237.823018:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5482b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d0ffd expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823134:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5482ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823150:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5482ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823161:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5482ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823176:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5482c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823183:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5482c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823189:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5482c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823380:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5482ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823387:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5482ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823394:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5482ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823400:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986237.823405:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5482ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823412:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5482ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823424:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:3.0:1788986237.823427:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986237.823432:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5482ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823438:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5482ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823451:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5482c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823457:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5482c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823463:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5482c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823468:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986237.823471:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5482c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823476:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5482c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823483:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a55745f00) 00010000:00010000:3.0:1788986237.823485:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986237.823489:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5482c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823495:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5482c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823523:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5482b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ffd expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823533:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:3.0:1788986237.823536:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986237.823539:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5482b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ffd expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.823548:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788986237.823602:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45550:x1875885971252352:12345-192.168.206.21@tcp:101:rm.0 Request processed in 622us (795us total) trans 0 rc 301/301 00000100:00100000:3.0:1788986237.823610:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 658 00000100:00100000:2.0:1788986237.875579:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986237.876043:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971252480 00000100:00100000:3.0:1788986237.876061:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971252480 00000100:00100000:1.0:1788986237.876077:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986237.876200:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971252736 00000100:00100000:0.0:1788986237.876209:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971252736 00000100:00100000:0.0:1788986237.876268:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 659 00000100:00100000:0.0:1788986237.876280:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:45554:x1875885971252736:12345-192.168.206.21@tcp:36:mkdir.0 00000100:00100000:3.0:1788986237.876288:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 660 00000100:00100000:3.0:1788986237.876303:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971252480:12345-192.168.206.21@tcp:41:mkdir.0 00010000:00010000:0.0:1788986237.876334:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000004:00000024:3.0:1788986237.876353:0:15241:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00010000:00010000:0.0:1788986237.876363:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5482ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0ff6 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.876384:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986237.876394:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986237.876452:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971252480:12345-192.168.206.21@tcp:41:mkdir.0 Request processed in 151us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986237.876462:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 660 00010000:00010000:0.0:1788986237.876610:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482c8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.876629:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.876639:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.876650:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5482cf lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.876657:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5482cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.876663:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5482cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986237.877610:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00010000:00010000:0.0:1788986237.877622:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482c8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.877630:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482c8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.877637:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.877643:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986237.877647:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482c8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.877660:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482c8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.877675:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986237.877678:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986237.877682:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482c8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.877687:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482c8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986237.877701:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ac3be3ca reply state 00000000c0a01c85 transno 4294967542 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5482cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986237.877709:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986237.877776:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:45554:x1875885971252736:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 1498us (1710us total) trans 4294967542 rc 0/0 00000100:00100000:0.0:1788986237.877784:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 659 00010000:00010000:3.0:1788986237.879360:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5482cf lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.879383:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5482cf lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.879391:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5482cf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.879397:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986237.879402:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5482cf lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.879411:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5482cf lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.879427:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a4823ba00) 00010000:00010000:3.0:1788986237.879430:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986237.879435:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5482cf lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986237.879442:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5482cf lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986237.888319:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986237.952493:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986237.952636:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971252864 00000100:00100000:0.0:1788986237.952646:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971252864 00000100:00100000:0.0:1788986237.952717:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 661 00000100:00100000:0.0:1788986237.952729:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45558:x1875885971252864:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:0.0:1788986237.952752:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986237.952773:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482d6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1004 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.952831:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5482dd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.952846:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5482dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.952861:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5482dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986237.952895:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788986237.952899:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986237.952917:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5482dd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.952939:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5482d6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1004 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.952957:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5482dd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1004 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.952965:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986237.952968:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986237.952971:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee000, rc 0) 00000100:00100000:0.0:1788986237.953025:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:45558:x1875885971252864:12345-192.168.206.21@tcp:101:chown.0 Request processed in 298us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986237.953034:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 661 00000100:00100000:2.0:1788986237.953215:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993484288:0@lo:400:kworker.0 00000100:00100000:0.0:1788986237.953262:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993484672:0@lo:400:kworker.0 00000100:00100000:2.0:1788986237.953299:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986237.953318:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986237.953399:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993484800:0@lo:400:kworker.0 00000100:00100000:2.0:1788986237.953441:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986237.953442:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993484544:0@lo:400:kworker.0 00000100:00100000:3.0:1788986237.953491:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986237.953495:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993484288 00000100:00100000:2.0:1788986237.953504:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993484288 00000100:00100000:3.0:1788986237.953522:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788986237.953544:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993484416:0@lo:400:kworker.0 00000100:00100000:2.0:1788986237.953574:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1788986237.953576:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986237.953589:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993484288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986237.953603:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993484928:0@lo:400:kworker.0 00000100:00100000:3.0:1788986237.953647:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986237.953665:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993484288:12345-0@lo:400:kworker.0 Request processed in 77us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986237.953675:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:3.0:1788986237.953714:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993484800 00000100:00100000:3.0:1788986237.953722:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993484800 00000100:00100000:2.0:1788986237.953744:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993484288:0@lo:400:kworker.0 00000100:00100000:3.0:1788986237.953777:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993484544 00000100:00100000:3.0:1788986237.953785:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993484544 00000100:00080000:2.0:1788986237.953803:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986237.953813:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993484416 00000100:00100000:3.0:1788986237.953818:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993484416 00000100:00100000:3.0:1788986237.953841:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1788986237.953849:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993484800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986237.953907:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993484800:12345-0@lo:400:kworker.0 Request processed in 57us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986237.953961:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993484672 00000100:00100000:0.0:1788986237.953965:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993484672 00000100:00100000:0.0:1788986237.953987:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993484928 00000100:00100000:0.0:1788986237.953989:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993484928 00000100:00100000:0.0:1788986237.954011:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1788986237.954017:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993484672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986237.954054:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993484672:12345-0@lo:400:kworker.0 Request processed in 38us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986237.954060:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1788986237.954086:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1788986237.954116:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993484928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986237.954149:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993484928:12345-0@lo:400:kworker.0 Request processed in 35us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986237.954154:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00080000:0.0:1788986237.954700:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986237.954732:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993484928:0@lo:400:kworker.0 00000100:00100000:2.0:1788986237.958294:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:2.0:1788986237.958332:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993484544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986237.958484:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993484544:12345-0@lo:400:kworker.0 Request processed in 174us (4996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986237.958497:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:2.0:1788986237.959018:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1788986237.959031:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993484416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986237.959120:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993484416:12345-0@lo:400:kworker.0 Request processed in 94us (5546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986237.959127:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1788986237.959224:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993484800:0@lo:400:kworker.0 00000100:00100000:2.0:1788986237.959286:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993484672:0@lo:400:kworker.0 00000100:00100000:2.0:1788986237.959325:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993484416:0@lo:400:kworker.0 00000100:00100000:2.0:1788986237.959337:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993484544:0@lo:400:kworker.0 00000100:00100000:3.0:1788986237.970914:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:3.0:1788986237.971192:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986237.971271:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971252992 00000100:00100000:1.0:1788986237.971290:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971252992 00000100:00100000:1.0:1788986237.974865:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 662 00000100:00100000:1.0:1788986237.974914:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:45558:x1875885971252992:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:1.0:1788986237.974952:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986237.974981:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5482e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d100b expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975059:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5482eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975118:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5482eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975134:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5482eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975155:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5482f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975162:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5482f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975173:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5482f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975451:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5482f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975474:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5482f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975488:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5482f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986237.975534:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:1.0:1788986237.975538:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986237.975562:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5482f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975651:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5482eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975725:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5482eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975733:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5482eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975739:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986237.975743:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5482eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975751:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5482eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975763:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:1.0:1788986237.975766:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986237.975771:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5482eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975777:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5482eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975794:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5482f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975800:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5482f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975806:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5482f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975811:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986237.975814:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5482f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975820:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5482f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975827:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a45316a00) 00010000:00010000:1.0:1788986237.975829:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986237.975832:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5482f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975838:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5482f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975879:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5482e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d100b expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975893:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5482f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d100b expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986237.975900:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:1.0:1788986237.975902:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986237.975905:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00100000:1.0:1788986237.975981:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:45558:x1875885971252992:12345-192.168.206.21@tcp:101:chown.0 Request processed in 1099us (4790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986237.975989:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 662 00000100:00100000:2.0:1788986237.986011:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986237.986242:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971253248 00000100:00100000:3.0:1788986237.986253:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971253248 00000100:00100000:2.0:1788986237.986442:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 663 00000100:00100000:2.0:1788986237.986453:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:45558:x1875885971253248:12345-192.168.206.21@tcp:36:chown.0 00010000:00010000:2.0:1788986237.986498:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986237.986522:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5482f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d100b expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986237.986866:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:2.0:1788986237.986877:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986237.986900:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548300 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986237.986913:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986237.986927:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986237.987303:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e677e6ca reply state 000000001a52f4e8 transno 4294967543 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986237.987313:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986237.987321:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000100:00100000:2.0:1788986237.987457:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:45558:x1875885971253248:12345-192.168.206.21@tcp:36:chown.0 Request processed in 1005us (1933us total) trans 4294967543 rc 0/0 00000100:00100000:2.0:1788986237.987465:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 663 00010000:00010000:0.0:1788986237.993236:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548300 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.993260:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548300 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.993270:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548300 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.993278:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986237.993285:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548300 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.993295:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548300 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.993316:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:0.0:1788986237.993320:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788986237.993327:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548300 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986237.993335:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548300 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986238.467916:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993485056:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986238.467991:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986238.468058:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993485056 00000100:00100000:1.0:1788986238.468077:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993485056 00000100:00100000:1.0:1788986238.468135:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 717 00000100:00100000:1.0:1788986238.468144:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993485056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986238.468178:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986238.468233:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993485056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986238.468240:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 717 00000100:00100000:3.0:1788986238.468402:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993485056:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788986238.875137:0:78526:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeab1e8e00 20000000:00000080:0.0:1788986238.875153:0:78526:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76001800 uarg=0000000000000000 10000000:01000000:0.0:1788986238.875194:0:78526:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986238.875212:0:78526:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986238.875229:0:78526:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54829e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548297 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986238.875237:0:78526:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986238.875272:0:78526:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54829e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548297 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986238.875286:0:78526:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54829e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548297 expref: 18 pid: 5849 timeout: 2122 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986238.875299:0:78526:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78526:1875885993485184:0@lo:104: 00000100:00100000:0.0:1788986238.875356:0:78526:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986238.875413:0:78526:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a511f8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788986238.875966:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993485184 00000100:00100000:2.0:1788986238.875974:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993485184 00000100:00100000:2.0:1788986238.876029:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788986238.876039:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:78526:x1875885993485184:12345-0@lo:104: 00010000:00010000:2.0:1788986238.876051:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54829e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986238.876155:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986238.876162:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:78526:x1875885993485184:12345-0@lo:104: Request processed in 125us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986238.876169:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00010000:00010000:1.0:1788986238.876388:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986238.876396:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54829e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986238.876407:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986238.876411:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54829e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986238.876418:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54829e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986238.876424:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54829e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986238.876430:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986238.876467:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54829e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986238.876475:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986238.876490:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54829e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986238.876497:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf548297 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54829e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986238.876514:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986238.876516:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986238.876518:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986238.876626:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993485312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986238.876659:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986238.876852:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993485312 00000100:00100000:3.0:1788986238.876857:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993485312 00010000:00010000:3.0:1788986238.876880:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54829e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548297 expref: 19 pid: 5849 timeout: 2122 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986238.876912:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:3.0:1788986238.876919:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993485312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986238.876930:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986238.876935:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54829e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548297 expref: 19 pid: 5849 timeout: 2122 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986238.876945:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54829e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548297 expref: 19 pid: 5849 timeout: 2122 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986238.876961:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986238.876969:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986238.876984:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986238.876990:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986238.876997:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986238.877002:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986238.877007:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986238.877011:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986238.877018:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986238.877039:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986238.877048:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986238.877117:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993485312:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986238.877124:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00000100:00100000:2.0:1788986238.877220:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993485312:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986238.878141:0:78526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54829e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548297 expref: 18 pid: 5849 timeout: 2122 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986238.878154:0:78526:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:78526:1875885993485184:0@lo:104: 00010000:00010000:0.0:1788986238.878168:0:78526:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986238.878189:0:78526:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986238.878195:0:78526:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986238.878202:0:78526:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf548307 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78526 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986238.918985:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788986239.676899:0:78574:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff5bc925a0 20000000:00000080:0.0:1788986239.676915:0:78574:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76001800 uarg=0000000000000000 10000000:01000000:0.0:1788986239.676960:0:78574:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986239.676980:0:78574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54830e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 78574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986239.676994:0:78574:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54830e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 78574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986239.677003:0:78574:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54830e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 78574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986239.677010:0:78574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54830e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986239.677016:0:78574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54830e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 78574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986239.677023:0:78574:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54830e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986239.677033:0:78574:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986239.677037:0:78574:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54830e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 78574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986239.677043:0:78574:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54830e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 78574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986239.677065:0:78574:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54830e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986239.677073:0:78574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54830e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986239.677079:0:78574:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54830e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 78574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986239.936211:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986240.134432:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986240.134484:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986240.134654:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971253376 00000100:00100000:1.0:1788986240.134663:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971253376 00000100:00100000:1.0:1788986240.134722:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1161 00000100:00100000:1.0:1788986240.134732:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971253376:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986240.134799:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971253376:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986240.134806:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1161 00000100:00100000:2.0:1788986240.135127:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971253504 00000100:00100000:2.0:1788986240.135132:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971253504 00000100:00100000:2.0:1788986240.135178:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1416 00000100:00100000:2.0:1788986240.135186:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971253504:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986240.135234:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971253504:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 49us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986240.135242:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1416 00000100:00080000:1.0:1788986240.135354:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1788986240.386725:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986240.386733:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986240.386739:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986240.386781:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986240.386794:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986240.386806:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986240.386829:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993485440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986240.386888:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986240.386941:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788986240.386996:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993485440 00000100:00100000:1.0:1788986240.387002:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993485440 00000100:00100000:1.0:1788986240.387064:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:1.0:1788986240.387072:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993485440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986240.387085:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986240.387120:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf54831c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548315 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986240.387143:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf54831c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548315 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986240.387155:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf54831c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548315 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986240.387163:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986240.387201:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993485440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986240.387208:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:1.0:1788986240.387247:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993485440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986240.387260:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54831c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986240.387269:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54831c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986240.387289:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986240.387294:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54831c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986240.387302:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54831c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986240.961300:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788986241.112159:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967542 is committed 00000001:00080000:1.0:1788986241.112181:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967543 is committed 00010000:00010000:0.0:1788986241.986953:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986242.048277:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986242.048300:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993485568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986242.048363:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986242.048423:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993485568 00000100:00100000:0.0:1788986242.048430:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993485568 00000100:00100000:0.0:1788986242.048481:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 718 00000100:00100000:0.0:1788986242.048491:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993485568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986242.048759:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986242.049060:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993485568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 569us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986242.049069:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 718 00000100:00100000:2.0:1788986242.051035:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993485568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986242.052770:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986242.800299:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986242.802485:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971253632 00000100:00100000:3.0:1788986242.802498:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971253632 00000100:00100000:3.0:1788986242.802563:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00100000:3.0:1788986242.802573:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:5589:x1875885971253632:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986242.802588:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986242.802614:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5482dd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1004 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986242.802630:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:3.0:1788986242.802641:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986242.802776:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5589:x1875885971253632:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 203us (2486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986242.802784:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 11 00000100:00080000:0.0:1788986242.802987:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788986243.008586:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986243.075293:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993485696:0@lo:400:kworker.0 00000100:00100000:0.0:1788986243.075427:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986243.075666:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993485696 00000100:00100000:3.0:1788986243.075674:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993485696 00000100:00100000:3.0:1788986243.075729:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1163 00000100:00100000:3.0:1788986243.075737:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993485696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986243.076453:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993485696:12345-0@lo:400:kworker.0 Request processed in 713us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986243.076461:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1163 00000100:00100000:1.0:1788986243.077587:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993485824:0@lo:400:kworker.0 00000100:00100000:1.0:1788986243.077635:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986243.077665:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993486336:0@lo:400:kworker.0 00000100:00100000:1.0:1788986243.077690:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986243.077713:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986243.077719:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993486208:0@lo:400:kworker.0 00000100:00100000:1.0:1788986243.077736:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986243.077760:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993485824 00000100:00100000:1.0:1788986243.077765:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993485824 00000100:00100000:1.0:1788986243.077798:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993486208 00000100:00100000:1.0:1788986243.077800:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993486208 00000100:00100000:1.0:1788986243.077823:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1788986243.077831:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993485824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986243.077872:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993485824:12345-0@lo:400:kworker.0 Request processed in 41us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986243.077878:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:1.0:1788986243.077893:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1788986243.077900:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993486208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986243.077925:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993486208:12345-0@lo:400:kworker.0 Request processed in 26us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986243.077930:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1788986243.077948:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993486336 00000100:00100000:1.0:1788986243.077951:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993486336 00000100:00100000:1.0:1788986243.077977:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:1.0:1788986243.077982:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993486336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986243.078007:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993486336:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986243.078012:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00080000:1.0:1788986243.078029:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986243.078033:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986243.078072:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993486208:0@lo:400:kworker.0 00000100:00100000:1.0:1788986243.078080:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993485824:0@lo:400:kworker.0 00000100:00100000:1.0:1788986243.078106:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993486336:0@lo:400:kworker.0 00000100:00100000:3.0:1788986243.078424:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993486080:0@lo:400:kworker.0 00000100:00100000:3.0:1788986243.078456:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986243.078485:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986243.078491:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993485952:0@lo:400:kworker.0 00000100:00100000:3.0:1788986243.078526:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986243.078553:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993485952 00000100:00100000:3.0:1788986243.078557:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993485952 00000100:00100000:3.0:1788986243.078587:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1788986243.078594:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993485952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986243.078627:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993485952:12345-0@lo:400:kworker.0 Request processed in 34us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986243.078632:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:3.0:1788986243.078658:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993485952:0@lo:400:kworker.0 00000100:00100000:1.0:1788986243.080238:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993486080 00000100:00100000:1.0:1788986243.080246:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993486080 00000100:00100000:1.0:1788986243.080293:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1788986243.080313:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993486080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986243.080383:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993486080:12345-0@lo:400:kworker.0 Request processed in 82us (1926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986243.080389:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00080000:1.0:1788986243.080409:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986243.080557:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993486080:0@lo:400:kworker.0 00000100:00100000:0.0:1788986243.083444:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993485696:0@lo:400:kworker.0 00000100:00100000:2.0:1788986243.584412:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993486464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986243.584469:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986243.584629:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993486464 00000100:00100000:1.0:1788986243.584638:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993486464 00000100:00100000:1.0:1788986243.584695:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1788986243.584704:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993486464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986243.584735:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986243.584785:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993486464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986243.584792:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 719 00000100:00100000:1.0:1788986243.584835:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993486464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986243.703012:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986243.703122:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971253760 00000100:00100000:3.0:1788986243.703132:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971253760 00000100:00100000:3.0:1788986243.703182:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 664 00000100:00100000:3.0:1788986243.703362:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:45662:x1875885971253760:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986243.703381:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986243.703403:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548323 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1012 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.703464:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54832a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.703478:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54832a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.703490:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54832a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986243.703522:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788986243.703525:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986243.703544:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54832a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.703565:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548323 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1012 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.703581:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54832a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1012 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.703589:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:3.0:1788986243.703592:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986243.703596:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3800, rc 0) 00000100:00100000:3.0:1788986243.706124:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45662:x1875885971253760:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 2922us (3107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986243.706136:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 664 00000100:00100000:1.0:1788986243.724653:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986243.724744:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971253888 00000100:00100000:3.0:1788986243.724754:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971253888 00000100:00100000:3.0:1788986243.724809:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 665 00000100:00100000:3.0:1788986243.724820:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45662:x1875885971253888:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986243.724838:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986243.724856:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548331 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1019 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.724910:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548338 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.724924:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548338 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.724934:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548338 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.724949:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54833f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.724955:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54833f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.724961:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54833f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733320:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548346 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733343:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733355:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986243.733401:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:3.0:1788986243.733405:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986243.733426:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548346 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733438:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548338 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733444:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548338 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733451:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548338 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733457:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986243.733461:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548338 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733468:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548338 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733480:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:3.0:1788986243.733483:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986243.733488:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548338 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733494:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548338 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733507:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54833f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733517:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54833f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733523:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54833f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733528:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986243.733531:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54833f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733537:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54833f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733544:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a55745400) 00010000:00010000:3.0:1788986243.733547:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986243.733549:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54833f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733555:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54833f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733593:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548331 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1019 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733608:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548346 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1019 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.733615:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745b00) 00010000:00010000:3.0:1788986243.733617:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986243.733619:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2800, rc 0) 00000100:00100000:3.0:1788986243.733699:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:45662:x1875885971253888:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 8881us (9054us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986243.733709:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 665 00000100:00100000:0.0:1788986243.745330:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986243.745416:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971254144 00000100:00100000:1.0:1788986243.745425:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971254144 00000100:00100000:1.0:1788986243.745482:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 666 00000100:00100000:1.0:1788986243.745492:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:45662:x1875885971254144:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986243.745541:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986243.745568:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548346 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1019 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.745588:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745b00) 00010000:00010000:1.0:1788986243.745599:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986243.745623:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54834d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.745636:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54834d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.745645:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54834d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788986243.815535:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967544 is committed 00000004:00010000:3.0:1788986243.815572:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006bd80bd6 reply state 00000000508ccd5f transno 4294967544 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54834d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986243.815585:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986243.815600:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00010000:00080000:3.0:1788986243.815698:0:15241:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788986243.815715:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:45662:x1875885971254144:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 70221us (70390us total) trans 4294967544 rc 0/0 00000100:00100000:3.0:1788986243.815724:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 666 00010000:00010000:3.0:1788986243.815759:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54834d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.815768:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54834d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.815776:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54834d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.815783:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986243.815788:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54834d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.815795:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54834d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.815810:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45316600) 00010000:00010000:3.0:1788986243.815813:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986243.815819:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54834d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.815825:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54834d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986243.869906:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986243.869949:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971254272 00000100:00100000:2.0:1788986243.869957:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971254272 00000100:00100000:2.0:1788986243.870006:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 667 00000100:00100000:2.0:1788986243.870016:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45667:x1875885971254272:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986243.870050:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986243.870071:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548354 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1020 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.870167:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54835b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.870181:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54835b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.870195:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54835b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.870210:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548362 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.870217:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.871767:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872060:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548369 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872073:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872080:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986243.872126:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:2.0:1788986243.872130:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986243.872150:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548369 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872162:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54835b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872169:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54835b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872181:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54835b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872187:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986243.872191:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54835b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872209:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54835b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872220:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:2.0:1788986243.872223:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986243.872227:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54835b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872233:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54835b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872246:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548362 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872252:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548362 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872258:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548362 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872263:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986243.872266:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548362 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872276:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548362 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872283:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a45aca200) 00010000:00010000:2.0:1788986243.872286:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986243.872289:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548362 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872295:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548362 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872327:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548354 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1020 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872341:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548369 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1020 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.872348:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986243.872350:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986243.872352:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788986243.872431:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:45667:x1875885971254272:12345-192.168.206.21@tcp:101:touch.0 Request processed in 2415us (2533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986243.872440:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 667 00000100:00100000:2.0:1788986243.880663:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986243.884211:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971254528 00000100:00100000:1.0:1788986243.884291:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971254528 00000100:00100000:1.0:1788986243.884593:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 668 00000100:00100000:1.0:1788986243.884604:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:45667:x1875885971254528:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986243.884624:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986243.884646:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548370 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1027 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.884881:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548377 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.884896:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548377 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.884907:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548377 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.884957:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54837e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.884965:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54837e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.884972:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54837e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788986243.887255:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x15:0x0], index 0: 0 00010000:00010000:1.0:1788986243.889846:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548385 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.889868:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.889881:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548385 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.889934:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548377 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.889942:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548377 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.889949:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548377 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.889955:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986243.889960:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548377 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.889967:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548377 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.889978:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:1.0:1788986243.889981:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986243.889985:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548377 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.889991:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548377 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986243.890004:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d62270f2 reply state 00000000e30f3518 transno 4294967545 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54837e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986243.890012:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986243.890060:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548370 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1027 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.890074:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548385 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1027 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986243.890082:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:1.0:1788986243.890084:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986243.890100:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788986243.890167:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:45667:x1875885971254528:12345-192.168.206.21@tcp:101:touch.0 Request processed in 5564us (9512us total) trans 4294967545 rc 0/0 00000100:00100000:1.0:1788986243.890175:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 668 00000100:00100000:1.0:1788986243.897066:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986243.897167:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971254784 00000100:00100000:2.0:1788986243.897176:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971254784 00000100:00100000:2.0:1788986243.897234:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 669 00000100:00100000:2.0:1788986243.897243:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:45667:x1875885971254784:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:2.0:1788986243.897288:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986243.897310:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548385 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1027 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.897327:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:2.0:1788986243.897336:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986243.897371:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548393 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.897384:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.897404:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986243.897685:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d1581929 reply state 00000000691a6d24 transno 4294967546 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986243.897695:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986243.897781:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45667:x1875885971254784:12345-192.168.206.21@tcp:36:touch.0 Request processed in 538us (722us total) trans 4294967546 rc 0/0 00000100:00100000:2.0:1788986243.897788:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 669 00010000:00010000:3.0:1788986243.899708:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54837e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.899724:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54837e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.899731:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54837e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.899738:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986243.899743:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54837e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.899751:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54837e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.899766:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a45316400) 00010000:00010000:3.0:1788986243.899769:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986243.899774:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54837e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986243.899780:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54837e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986243.899927:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548393 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986243.899936:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548393 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986243.899942:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548393 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986243.899948:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986243.899951:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548393 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986243.899958:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548393 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986243.899966:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9b0a45aca200) 00010000:00010000:0.0:1788986243.899969:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986243.899972:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548393 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986243.899982:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548393 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986243.901235:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986243.901381:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971254912 00000100:00100000:2.0:1788986243.901402:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971254912 00000100:00100000:2.0:1788986243.901466:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 670 00000100:00100000:2.0:1788986243.901477:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:45667:x1875885971254912:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986243.901499:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986243.901518:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54839a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d102e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.901581:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54839a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d102e expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.901594:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54839a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d102e expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986243.901611:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:2.0:1788986243.901613:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788986243.901617:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1800, rc 0) 00000100:00100000:2.0:1788986243.901662:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:45667:x1875885971254912:12345-192.168.206.21@tcp:101:touch.0 Request processed in 188us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986243.901669:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 670 00000100:00100000:2.0:1788986243.904335:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986243.904417:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971255040 00000100:00100000:1.0:1788986243.904425:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971255040 00000100:00100000:1.0:1788986243.904472:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 360 00000100:00100000:1.0:1788986243.904481:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2345:x1875885971255040:12345-192.168.206.21@tcp:8:touch.0 00010000:00080000:1.0:1788986243.904521:0:6695:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 2027 last 0 00000020:00000080:1.0:1788986243.904553:0:6695:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf5483a1 00002000:00100000:1.0:1788986243.904564:0:6695:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b0a489e9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788986243.904585:0:6695:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788986243.904873:0:6695:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788986243.904900:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9b0a489ef000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788986243.905022:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971255040:12345-192.168.206.21@tcp:8:touch.0 Request processed in 540us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986243.905030:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 360 00000100:00100000:1.0:1788986243.908797:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986243.908925:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971255168 00000100:00100000:0.0:1788986243.908935:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971255168 00000100:00100000:0.0:1788986243.909049:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 361 00000100:00100000:0.0:1788986243.909059:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:0:x1875885971255168:12345-192.168.206.21@tcp:2:touch.0 00000100:00080000:1.0:1788986243.912062:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788986243.962597:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967338 is committed 00000001:00100000:3.0:1788986243.962724:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:0.0:1788986243.962878:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:0:x1875885971255168:12345-192.168.206.21@tcp:2:touch.0 Request processed in 53816us (54086us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788986243.962894:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 361 00000100:00100000:2.0:1788986243.970927:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986243.971711:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971255424 00000100:00100000:0.0:1788986243.971721:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971255424 00000100:00100000:0.0:1788986243.971768:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 68 00000100:00100000:0.0:1788986243.971778:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:45667:x1875885971255424:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:0.0:1788986243.972152:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45667:x1875885971255424:12345-192.168.206.21@tcp:35:touch.0 Request processed in 373us (1232us total) trans 4294967547 rc 0/0 00000100:00100000:0.0:1788986243.972160:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 68 00010000:00010000:0.0:1788986244.032353:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986244.055288:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986244.055442:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971255552 00000100:00100000:1.0:1788986244.055451:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971255552 00000100:00100000:1.0:1788986244.055527:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 671 00000100:00100000:1.0:1788986244.055538:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45671:x1875885971255552:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986244.055564:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986244.055584:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5483a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1035 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055644:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5483af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055658:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5483af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055669:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5483af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055682:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5483b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055688:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5483b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055694:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5483b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055778:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5483bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055786:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5483bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055793:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5483bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986244.055827:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x37:0x0]: returning size 0 00000004:00200000:1.0:1788986244.055831:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986244.055848:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5483bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055859:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5483bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055867:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5483af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055874:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5483af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055880:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5483af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055886:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986244.055890:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5483af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055898:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5483af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055920:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:1.0:1788986244.055922:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986244.055927:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5483af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055938:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5483af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055953:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5483b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055959:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5483b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055965:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5483b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055970:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986244.055972:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5483b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055977:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5483b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055984:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a45316300) 00010000:00010000:1.0:1788986244.055986:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986244.055989:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5483b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.055994:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5483b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.056022:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5483a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1035 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.056052:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5483bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1035 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.056059:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:1.0:1788986244.056062:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986244.056064:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00080000:2.0:1788986244.056397:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986244.056548:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45671:x1875885971255552:12345-192.168.206.21@tcp:101:rm.0 Request processed in 1010us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986244.056557:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 671 00000100:00100000:3.0:1788986244.063370:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986244.063640:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971255680 00000100:00100000:0.0:1788986244.063650:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971255680 00000100:00100000:0.0:1788986244.063776:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 362 00000100:00100000:0.0:1788986244.063786:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971255680:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986244.063805:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986244.063824:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf5483c4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d103c expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986244.063848:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x6aa1c383, atime: 0x6aa1c383, ctime: 0x6aa1c383, blocks: 0x1 00010000:00010000:0.0:1788986244.063866:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=2027s v=(0 0) 00010000:00010000:0.0:1788986244.063870:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986244.063879:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf5483c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d103c expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.063909:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf5483c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d103c expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.063921:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef800, rc 0) 00000100:00100000:0.0:1788986244.063975:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971255680:12345-192.168.206.21@tcp:101:rm.0 Request processed in 191us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986244.063982:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 362 00000100:00100000:2.0:1788986244.068290:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986244.068398:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971255936 00000100:00100000:0.0:1788986244.068407:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971255936 00000100:00100000:0.0:1788986244.068491:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 672 00000100:00100000:0.0:1788986244.068502:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45671:x1875885971255936:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1788986244.068574:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986244.068601:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5483bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1035 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.068625:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54839a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x37:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d102e expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.068636:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:0.0:1788986244.068646:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986244.068676:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5483cb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.068688:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5483cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.068698:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5483cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.068713:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5483d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.068720:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5483d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.068727:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5483d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.068823:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483d9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.068832:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.068839:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788986244.069449:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].21, 64 off9536 00000004:00080000:0.0:1788986244.069459:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2027972369183ns, next at 2028972367133ns, rc = 0 00010000:00010000:0.0:1788986244.069511:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5483e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069521:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5483e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069530:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5483e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069537:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5483e0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069543:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5483e0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069549:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5483e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069565:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788986244.069581:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483d9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069589:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483d9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069595:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069602:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986244.069606:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483d9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069614:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483d9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069624:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9b0a4823b800) 00010000:00010000:0.0:1788986244.069626:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788986244.069630:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483d9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069637:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483d9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x37:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069651:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5483cb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069658:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5483cb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069664:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5483cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069669:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986244.069672:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5483cb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069678:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5483cb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069684:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:0.0:1788986244.069686:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986244.069689:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5483cb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986244.069696:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5483cb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986244.069709:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000078048a2b reply state 00000000ecc5b358 transno 4294967548 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5483d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986244.069718:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986244.069786:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45671:x1875885971255936:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1283us (1501us total) trans 4294967548 rc 0/0 00000100:00100000:0.0:1788986244.069794:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 672 00010000:00010000:1.0:1788986244.070115:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986244.070123:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5483e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.070129:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986244.070133:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5483e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.070139:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5483e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.070148:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x37:0x0].0x0 (ffff9b0a4823b800) 00010000:00010000:1.0:1788986244.070150:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788986244.070153:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5483e0 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.070158:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5483e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x37:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986244.070173:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986244.070174:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986244.070176:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986244.081814:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5483d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986244.081831:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5483d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986244.081839:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5483d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986244.081846:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986244.081850:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5483d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986244.081859:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5483d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986244.081875:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a4823bc00) 00010000:00010000:3.0:1788986244.081878:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986244.081883:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5483d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986244.081889:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5483d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986245.060181:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986245.222339:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986245.222624:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971256064 00000100:00100000:0.0:1788986245.222637:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971256064 00000100:00100000:0.0:1788986245.222710:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 673 00000100:00100000:0.0:1788986245.222723:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45686:x1875885971256064:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986245.222766:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986245.222793:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5483e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1043 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.222883:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.222902:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.222918:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986245.222974:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:0.0:1788986245.222978:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986245.223007:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.223051:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5483e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1043 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.223072:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1043 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.223081:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:0.0:1788986245.223084:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986245.223287:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eee00, rc 0) 00000100:00100000:0.0:1788986245.223354:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45686:x1875885971256064:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 633us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986245.223363:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 673 00000100:00100000:1.0:1788986245.228698:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986245.228789:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971256320 00000100:00100000:3.0:1788986245.228802:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971256320 00000100:00100000:3.0:1788986245.228886:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 674 00000100:00100000:3.0:1788986245.228898:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45686:x1875885971256320:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986245.228960:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986245.228994:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5483ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1043 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.229037:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548369 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1020 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.229050:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:3.0:1788986245.229063:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986245.229119:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5483f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.229134:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5483f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.229146:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5483f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986245.232423:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986245.232487:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986245.232543:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971256448 00000100:00100000:1.0:1788986245.232554:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971256448 00000100:00100000:1.0:1788986245.232612:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1164 00000100:00100000:1.0:1788986245.232623:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971256448:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986245.232706:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971256448:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986245.232714:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1164 00000100:00100000:3.0:1788986245.233085:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971256576 00000100:00100000:3.0:1788986245.233121:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971256576 00000100:00100000:3.0:1788986245.233190:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1012 00000100:00100000:3.0:1788986245.233199:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971256576:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986245.233242:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971256576:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986245.233249:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1012 00000100:00080000:1.0:1788986245.233466:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00010000:3.0:1788986245.338108:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008ddeadc1 reply state 00000000c6e5363d transno 4294967549 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5483f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986245.338133:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986245.338154:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000100:00100000:3.0:1788986245.338301:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45686:x1875885971256320:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 109399us (109613us total) trans 4294967549 rc 0/0 00000100:00100000:3.0:1788986245.338315:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 674 00000001:00080000:1.0:1788986245.340386:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967548 is committed 00000004:00080000:1.0:1788986245.340402:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 55 committed 00000001:00080000:1.0:1788986245.340602:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967549 is committed 00010000:00010000:2.0:1788986245.340670:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5483f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.340686:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5483f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.340695:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5483f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.340702:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986245.340707:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5483f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.340717:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5483f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.340737:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:2.0:1788986245.340741:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986245.340747:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5483f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.340754:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5483f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986245.340765:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986245.340798:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993486592:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788986245.340872:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986245.340975:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993486592 00000100:00100000:2.0:1788986245.340984:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993486592 00000100:00100000:2.0:1788986245.341134:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:2.0:1788986245.341144:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993486592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788986245.341176:0:8478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:21 count 1 00010000:00010000:2.0:1788986245.341206:0:8478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.341229:0:8478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf5483c4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d103c expref: 5 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.341238:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788986245.341243:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986245.341248:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.341277:0:8478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf5483c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d103c expref: 5 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.341292:0:8478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf5483c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d103c expref: 5 pid: 8478 timeout: 2129 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986245.341304:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8478:1875885993486720:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986245.341364:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a457dccc0 going to sleep for 11 seconds 00000100:00080000:1.0:1788986245.341646:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986245.343368:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8478:1875885993486720:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788986245.343402:0:8478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986245.347454:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986245.347507:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971256704 00000100:00100000:3.0:1788986245.347519:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971256704 00010000:00010000:3.0:1788986245.347568:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf5483c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d103c expref: 6 pid: 8478 timeout: 2129 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986245.347615:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 368 00000100:00100000:3.0:1788986245.347625:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971256704:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986245.347643:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986245.347651:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf5483c4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d103c expref: 6 pid: 8478 timeout: 2129 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.347666:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf5483c4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d103c expref: 6 pid: 8478 timeout: 2129 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.347696:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2ac2044/0xc20d828fcf5483c4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d103c expref: 6 pid: 8478 timeout: 2129 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.347714:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986245.347719:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986245.347726:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.347737:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.347768:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986245.347836:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971256704:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 211us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986245.347844:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 368 00010000:00010000:3.0:1788986245.347881:0:8478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.347892:0:8478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.347918:0:8478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.347926:0:8478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.347946:0:8478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788986245.348774:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993486592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7627us (7898us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1788986245.348786:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00010000:00010000:3.0:1788986245.348821:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986245.348828:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.348839:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986245.348845:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.348855:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.348873:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.348882:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001bbddf59/0xc20d828fcf5483fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.348906:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986245.348908:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986245.348910:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788986245.352325:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7988ea00/2, rc 0, transno 4294967339 00000100:00100000:0.0:1788986245.352342:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993486592:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788986245.407142:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986245.407257:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971256832 00000100:00100000:2.0:1788986245.407270:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971256832 00000100:00100000:2.0:1788986245.407340:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 675 00000100:00100000:2.0:1788986245.407353:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45690:x1875885971256832:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986245.407386:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986245.407415:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548403 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d104a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.407512:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54840a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.407530:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54840a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.407545:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54840a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.407562:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548411 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.407569:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.407581:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408225:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548418 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408237:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408246:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986245.408279:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:2.0:1788986245.408283:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986245.408305:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548418 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408320:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54840a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408327:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54840a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408335:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54840a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408342:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986245.408347:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54840a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408355:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54840a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408370:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:2.0:1788986245.408374:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986245.408380:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54840a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408387:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54840a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408401:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548411 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408408:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548411 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408414:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548411 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408420:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986245.408423:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548411 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408429:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548411 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408802:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a45aca600) 00010000:00010000:2.0:1788986245.408806:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986245.408810:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548411 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.408817:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548411 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.409164:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548403 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d104a expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.409183:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548418 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d104a expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.409191:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986245.409194:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986245.409197:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1800, rc 0) 00000100:00100000:3.0:1788986245.409820:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:45690:x1875885971256832:12345-192.168.206.21@tcp:101:touch.0 Request processed in 2463us (2728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986245.409832:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 675 00000100:00100000:2.0:1788986245.414951:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986245.416740:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971257088 00000100:00100000:0.0:1788986245.416757:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971257088 00000100:00100000:0.0:1788986245.416825:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 676 00000100:00100000:0.0:1788986245.416836:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:45690:x1875885971257088:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788986245.416860:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986245.416887:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54841f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1051 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.417295:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548426 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.417314:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548426 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.417328:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548426 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.417343:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54842d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.417350:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54842d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.417357:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54842d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986245.419481:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x15:0x0], index 1: 0 00010000:00010000:0.0:1788986245.419974:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf548434 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.419993:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf548434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.420007:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf548434 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.420063:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548426 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.420076:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548426 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.420084:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548426 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.420129:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986245.420135:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548426 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.420144:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548426 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.420159:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:0.0:1788986245.420162:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986245.420168:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548426 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.420175:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548426 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986245.420191:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000086f48d9d reply state 00000000c75f9b67 transno 4294967550 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54842d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986245.420202:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788986245.420245:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54841f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1051 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.420261:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf548434 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1051 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.420276:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:0.0:1788986245.420278:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986245.420281:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef000, rc 0) 00000100:00100000:0.0:1788986245.420367:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:45690:x1875885971257088:12345-192.168.206.21@tcp:101:touch.0 Request processed in 3532us (5431us total) trans 4294967550 rc 0/0 00000100:00100000:0.0:1788986245.420379:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 676 00010000:00010000:2.0:1788986245.422654:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54842d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.422674:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54842d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.422683:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54842d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.422689:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986245.422695:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54842d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.422703:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54842d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.422720:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a4823bc00) 00010000:00010000:2.0:1788986245.422723:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986245.422729:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54842d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.422736:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54842d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986245.430572:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986245.430777:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971257344 00000100:00100000:3.0:1788986245.430790:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971257344 00000100:00100000:3.0:1788986245.430855:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 677 00000100:00100000:3.0:1788986245.430867:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:45690:x1875885971257344:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:3.0:1788986245.430947:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986245.430981:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf548434 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1051 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.431004:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:3.0:1788986245.431018:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986245.431082:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548442 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.431148:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.431161:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986245.431330:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000258df0f3 reply state 0000000042e0ab97 transno 4294967551 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986245.431340:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986245.432824:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:45690:x1875885971257344:12345-192.168.206.21@tcp:36:touch.0 Request processed in 1944us (2250us total) trans 4294967551 rc 0/0 00000100:00100000:3.0:1788986245.432838:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 677 00010000:00010000:2.0:1788986245.434680:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548442 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.434699:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548442 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.434708:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548442 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986245.434948:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:2.0:1788986245.435159:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986245.435165:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548442 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.435175:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548442 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.435194:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9b0a55745400) 00010000:00010000:2.0:1788986245.435197:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986245.435203:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548442 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.435211:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548442 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986245.435524:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971257472 00000100:00100000:3.0:1788986245.435536:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971257472 00000100:00100000:3.0:1788986245.435601:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 678 00000100:00100000:3.0:1788986245.435612:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:45690:x1875885971257472:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:3.0:1788986245.435642:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986245.435665:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548449 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1058 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.435731:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548449 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1058 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.435746:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548449 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1058 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.436353:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986245.436358:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788986245.436362:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3c00, rc 0) 00000100:00100000:3.0:1788986245.436543:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:45690:x1875885971257472:12345-192.168.206.21@tcp:101:touch.0 Request processed in 930us (1597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986245.436551:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 678 00000100:00100000:3.0:1788986245.446831:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986245.446972:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971257600 00000100:00100000:0.0:1788986245.446985:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971257600 00000100:00100000:0.0:1788986245.447064:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 364 00000100:00100000:0.0:1788986245.447073:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875885971257600:12345-192.168.206.21@tcp:8:touch.0 00010000:00080000:0.0:1788986245.447174:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 2029 last 0 00000020:00000080:0.0:1788986245.447217:0:6697:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf548450 00002000:00100000:0.0:1788986245.447233:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b094371f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788986245.447264:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788986245.447547:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788986245.447585:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b0943718000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788986245.447665:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971257600:12345-192.168.206.21@tcp:8:touch.0 Request processed in 590us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986245.447673:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 364 00000100:00100000:1.0:1788986245.450411:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986245.450810:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971257728 00000100:00100000:2.0:1788986245.450822:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971257728 00000100:00080000:1.0:1788986245.450884:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986245.451012:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 365 00000100:00100000:2.0:1788986245.451037:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:0:x1875885971257728:12345-192.168.206.21@tcp:2:touch.0 00000100:00100000:2.0:1788986245.491476:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:0:x1875885971257728:12345-192.168.206.21@tcp:2:touch.0 Request processed in 40440us (41064us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788986245.491500:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 365 00000001:00100000:0.0:1788986245.493433:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000001:00080000:0.0:1788986245.493462:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967338 is committed 00000100:00100000:1.0:1788986245.498580:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986245.498795:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971257984 00000100:00100000:0.0:1788986245.498807:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971257984 00000100:00100000:0.0:1788986245.498918:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:0.0:1788986245.498931:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:45690:x1875885971257984:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:0.0:1788986245.499751:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45690:x1875885971257984:12345-192.168.206.21@tcp:35:touch.0 Request processed in 560us (983us total) trans 4294967552 rc 0/0 00000100:00100000:0.0:1788986245.499763:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 69 00000100:00100000:1.0:1788986245.551630:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986245.551756:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971258112 00000100:00100000:0.0:1788986245.551768:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971258112 00000100:00100000:0.0:1788986245.551839:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 679 00000100:00100000:0.0:1788986245.551850:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45694:x1875885971258112:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986245.551889:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986245.551926:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548457 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d105f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.552004:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54845e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.552021:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54845e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.552044:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54845e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.552061:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548465 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.552068:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.552074:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554171:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54846c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554196:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54846c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554212:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54846c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986245.554262:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x38:0x0]: returning size 0 00000004:00200000:2.0:1788986245.554267:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986245.554292:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54846c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554306:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54846c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554317:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54845e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554325:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54845e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554334:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54845e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554341:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986245.554347:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54845e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554357:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54845e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554371:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986245.554374:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986245.554380:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54845e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554387:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54845e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554404:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548465 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554409:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548465 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554415:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554420:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986245.554423:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548465 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554429:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548465 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554436:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a4823bf00) 00010000:00010000:2.0:1788986245.554438:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986245.554442:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548465 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554447:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548465 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554489:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548457 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d105f expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554662:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54846c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d105f expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.554670:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:2.0:1788986245.554673:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986245.554676:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788986245.554988:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45694:x1875885971258112:12345-192.168.206.21@tcp:101:rm.0 Request processed in 3137us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986245.554999:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 679 00000100:00100000:2.0:1788986245.559796:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986245.559947:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971258240 00000100:00100000:0.0:1788986245.559959:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971258240 00000100:00100000:0.0:1788986245.560038:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 366 00000100:00100000:0.0:1788986245.560050:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971258240:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986245.560072:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986245.560140:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf548473 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1066 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986245.560176:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x6aa1c385, atime: 0x6aa1c385, ctime: 0x6aa1c385, blocks: 0x1 00010000:00010000:0.0:1788986245.560200:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=2029s v=(0 0) 00010000:00010000:0.0:1788986245.560205:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986245.560217:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf548473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1066 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.560239:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf548473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1066 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.560255:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef200, rc 0) 00000100:00100000:0.0:1788986245.560314:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971258240:12345-192.168.206.21@tcp:101:rm.0 Request processed in 267us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986245.560322:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 366 00000100:00100000:1.0:1788986245.564624:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986245.564796:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971258496 00000100:00100000:3.0:1788986245.564808:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971258496 00000100:00100000:3.0:1788986245.564919:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 680 00000100:00100000:3.0:1788986245.564932:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45694:x1875885971258496:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788986245.564998:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986245.565044:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54846c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d105f expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.565083:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548449 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x38:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1058 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.565168:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986245.565182:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986245.565210:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54847a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.565226:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54847a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.565238:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54847a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.565256:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548481 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.565264:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.565271:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.565386:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548488 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.565395:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.565403:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788986245.566259:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].21, 64 off9536 00000004:00080000:3.0:1788986245.566275:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2029469184896ns, next at 2030469181834ns, rc = 0 00010000:00010000:3.0:1788986245.566351:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54848f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566363:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54848f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566373:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54848f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566381:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54848f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566392:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54848f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566398:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54848f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566419:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986245.566445:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548488 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566452:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548488 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566460:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548488 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566466:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986245.566472:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548488 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566481:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548488 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566492:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:3.0:1788986245.566495:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986245.566501:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548488 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566508:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548488 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x38:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566526:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54847a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566533:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54847a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566539:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54847a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566544:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986245.566548:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54847a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566554:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54847a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566562:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:3.0:1788986245.566564:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986245.566567:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54847a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986245.566573:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54847a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986245.566586:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000085f15c1d reply state 00000000c6a038fe transno 4294967553 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986245.566596:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986245.566704:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45694:x1875885971258496:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1772us (2090us total) trans 4294967553 rc 0/0 00000100:00100000:3.0:1788986245.566723:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 680 00010000:00010000:0.0:1788986245.566828:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986245.566837:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54848f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.566843:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986245.566848:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54848f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.566854:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54848f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.566864:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x38:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:0.0:1788986245.566866:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788986245.566869:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54848f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.566874:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54848f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x38:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986245.566893:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986245.566895:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986245.566897:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986245.574847:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548481 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.574873:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548481 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.574883:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.574889:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986245.574895:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548481 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.574970:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548481 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.574992:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a55745a00) 00010000:00010000:2.0:1788986245.574995:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986245.575001:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548481 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986245.575007:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548481 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986246.082482:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986246.608701:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.609432:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971258624 00000100:00100000:3.0:1788986246.609446:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971258624 00000100:00100000:3.0:1788986246.609557:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 681 00000100:00100000:3.0:1788986246.609570:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45708:x1875885971258624:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986246.609603:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986246.609630:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548496 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d106d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.609713:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54849d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.609731:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54849d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.609747:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54849d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986246.609790:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:3.0:1788986246.609794:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986246.609818:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54849d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.609846:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548496 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d106d expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.609885:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54849d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d106d expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788986246.610032:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986246.610170:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:3.0:1788986246.610174:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986246.610178:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2a00, rc 0) 00000100:00100000:3.0:1788986246.610288:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45708:x1875885971258624:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 720us (1599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986246.610297:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 681 00000100:00100000:1.0:1788986246.620417:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986246.625055:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971258880 00000100:00100000:2.0:1788986246.625072:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971258880 00000100:00100000:2.0:1788986246.625222:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 682 00000100:00100000:2.0:1788986246.625234:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45708:x1875885971258880:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986246.625305:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986246.625338:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54849d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d106d expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986246.625361:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548418 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d104a expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986246.625375:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986246.625387:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986246.625416:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5484a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986246.625432:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5484a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986246.625442:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5484a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986246.625729:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f9f08fd4 reply state 00000000c15049cb transno 4294967554 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5484a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986246.625739:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986246.625747:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000100:00100000:2.0:1788986246.625857:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45708:x1875885971258880:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 624us (5453us total) trans 4294967554 rc 0/0 00000100:00100000:2.0:1788986246.625879:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 682 00010000:00010000:1.0:1788986246.631342:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5484a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986246.631365:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5484a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986246.631373:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5484a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986246.631380:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986246.631386:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5484a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986246.631394:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5484a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986246.631413:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:1.0:1788986246.631416:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986246.631422:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5484a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986246.631487:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5484a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986246.758368:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.758484:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971259008 00000100:00100000:3.0:1788986246.758496:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971259008 00000100:00100000:3.0:1788986246.758571:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 683 00000100:00100000:3.0:1788986246.758583:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45720:x1875885971259008:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986246.758745:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45720:x1875885971259008:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 163us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986246.758753:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 683 00000100:00100000:1.0:1788986246.760792:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.760883:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971259136 00000100:00100000:3.0:1788986246.760894:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971259136 00000100:00100000:3.0:1788986246.761000:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 367 00000100:00100000:3.0:1788986246.761012:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:45720:x1875885971259136:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986246.761502:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:45720:x1875885971259136:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 478us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986246.761512:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 367 00000100:00100000:3.0:1788986246.767967:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.768025:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971259264 00000100:00100000:3.0:1788986246.768038:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971259264 00000100:00100000:3.0:1788986246.768123:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 368 00000100:00100000:3.0:1788986246.768137:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45720:x1875885971259264:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986246.768568:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45720:x1875885971259264:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 433us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986246.768576:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 368 00000100:00100000:3.0:1788986246.773404:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.773449:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971259392 00000100:00100000:3.0:1788986246.773462:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971259392 00000100:00100000:3.0:1788986246.773598:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 684 00000100:00100000:3.0:1788986246.773611:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45720:x1875885971259392:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986246.774282:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45720:x1875885971259392:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 670us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986246.774291:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 684 00000100:00100000:3.0:1788986246.778416:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.778460:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971259520 00000100:00100000:3.0:1788986246.778471:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971259520 00000100:00100000:3.0:1788986246.778533:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 685 00000100:00100000:3.0:1788986246.778545:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45720:x1875885971259520:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986246.778654:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45720:x1875885971259520:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 112us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986246.778662:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 685 00000100:00100000:0.0:1788986246.782747:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.782838:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971259648 00000100:00100000:3.0:1788986246.782849:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971259648 00000100:00100000:3.0:1788986246.783338:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 369 00000100:00100000:3.0:1788986246.783353:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:45720:x1875885971259648:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986246.783818:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:45720:x1875885971259648:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 466us (1080us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986246.783828:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 369 00000100:00100000:0.0:1788986246.789729:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.789821:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971259776 00000100:00100000:3.0:1788986246.789833:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971259776 00000100:00100000:3.0:1788986246.789929:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 370 00000100:00100000:3.0:1788986246.789942:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45720:x1875885971259776:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986246.790441:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45720:x1875885971259776:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 499us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986246.790451:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 370 00000100:00100000:0.0:1788986246.795293:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986246.795340:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971259904 00000100:00100000:0.0:1788986246.795351:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971259904 00000100:00100000:0.0:1788986246.795415:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 686 00000100:00100000:0.0:1788986246.795425:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45720:x1875885971259904:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986246.795928:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45720:x1875885971259904:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 502us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986246.795937:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 686 00000100:00100000:1.0:1788986246.849413:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.849503:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971260032 00000100:00100000:3.0:1788986246.849516:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971260032 00000100:00100000:3.0:1788986246.849596:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 687 00000100:00100000:3.0:1788986246.849608:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:45724:x1875885971260032:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:3.0:1788986246.849634:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986246.849659:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5484ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1074 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.849736:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5484b2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.849752:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5484b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.849765:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5484b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.849782:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5484b9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.849788:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5484b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.849795:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5484b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.851740:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5484c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.851770:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5484c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.851782:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5484c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986246.851826:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:3.0:1788986246.851831:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986246.851855:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5484c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.851978:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5484b2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.851986:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5484b2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.851993:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5484b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.851999:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986246.852004:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5484b2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852012:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5484b2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852040:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:3.0:1788986246.852043:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986246.852049:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5484b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852060:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5484b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852241:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5484b9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852249:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5484b9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852256:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5484b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852261:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986246.852265:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5484b9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852271:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5484b9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852280:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a55745100) 00010000:00010000:3.0:1788986246.852282:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986246.852285:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5484b9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852292:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5484b9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852339:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5484ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1074 expref: 13 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852357:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5484c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1074 expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.852366:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986246.852368:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986246.852371:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986246.852515:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45724:x1875885971260032:12345-192.168.206.21@tcp:101:dd.0 Request processed in 2909us (3116us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986246.852525:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 687 00000100:00100000:2.0:1788986246.855901:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.856152:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971260288 00000100:00100000:3.0:1788986246.856164:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971260288 00000100:00100000:3.0:1788986246.856226:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 688 00000100:00100000:3.0:1788986246.856237:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:45724:x1875885971260288:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:3.0:1788986246.856994:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986246.857038:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5484c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d107b expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.857896:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5484ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.857919:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5484ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.857934:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5484ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.857953:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5484d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.857961:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5484d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.857973:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5484d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788986246.858613:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x16:0x0], index 0: 0 00010000:00010000:3.0:1788986246.864865:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5484dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.864895:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5484dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.864910:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5484dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.864959:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5484ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.864967:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5484ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.864975:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5484ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.864981:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986246.864986:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5484ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.864994:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5484ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.865009:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986246.865012:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986246.865030:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5484ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.865038:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5484ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986246.865053:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fd881724 reply state 00000000042848f6 transno 4294967555 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5484d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986246.865069:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788986246.865149:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5484c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d107b expref: 15 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.865167:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5484dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d107b expref: 14 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.865174:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986246.865177:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788986246.865180:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788986246.865274:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+15:45724:x1875885971260288:12345-192.168.206.21@tcp:101:dd.0 Request processed in 9038us (9387us total) trans 4294967555 rc 0/0 00000100:00100000:3.0:1788986246.865284:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 688 00010000:00010000:2.0:1788986246.872767:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5484d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986246.872791:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5484d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986246.872801:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5484d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986246.872809:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986246.872815:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5484d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986246.872824:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5484d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986246.872850:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a55745000) 00010000:00010000:2.0:1788986246.872853:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986246.872859:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5484d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986246.872867:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5484d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986246.880282:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986246.880757:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971260416 00000100:00100000:0.0:1788986246.880770:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971260416 00000100:00100000:0.0:1788986246.880850:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 371 00000100:00100000:0.0:1788986246.880864:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:45724:x1875885971260416:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1788986246.880953:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986246.880980:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf5484ea lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1082 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986246.881013:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788986246.881053:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=2030s v=(0 0) 00010000:00010000:0.0:1788986246.881058:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986246.881071:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf5484ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1082 expref: 6 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986246.881187:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf5484ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1082 expref: 6 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986246.881202:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efc00, rc 0) 00000100:00100000:0.0:1788986246.881434:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45724:x1875885971260416:12345-192.168.206.21@tcp:101:dd.0 Request processed in 571us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986246.881444:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 371 00000100:00100000:0.0:1788986246.901675:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986246.901813:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971260544 00000100:00100000:2.0:1788986246.901822:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971260544 00002000:00100000:2.0:1788986246.901870:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (0->1048575) req@ffff9b0942bb3100 x1875885971260544/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:167/0 lens 488/0 e 0 to 0 dl 1788986257 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788986246.901881:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0942bb3100 with x1875885971260544 ext(0->1048575) 00002000:00010000:2.0:1788986246.901887:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0942bb3100 00000100:00100000:2.0:1788986246.901921:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:2.0:1788986246.901934:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971260544:12345-192.168.206.21@tcp:4:dd.0 00000100:00100000:2.0:1788986246.932260:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971260544:12345-192.168.206.21@tcp:4:dd.0 Request processed in 30314us (30579us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788986246.932278:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00002000:00100000:2.0:1788986246.932294:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x16:0x0] (0->1048575) req@ffff9b0942bb3100 x1875885971260544/t4294967340(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:167/0 lens 488/448 e 0 to 0 dl 1788986257 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788986246.932307:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0942bb3100 with x1875885971260544 ext(0->1048575) 00002000:00010000:2.0:1788986246.932314:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0942bb3100 00000100:00100000:0.0:1788986246.935881:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.936047:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971260672 00000100:00100000:3.0:1788986246.936058:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971260672 00000100:00100000:3.0:1788986246.936143:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 689 00000100:00100000:3.0:1788986246.936156:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+14:45724:x1875885971260672:12345-192.168.206.21@tcp:44:dd.0 00000100:00100000:3.0:1788986246.981384:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+14:45724:x1875885971260672:12345-192.168.206.21@tcp:44:dd.0 Request processed in 45215us (45501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986246.981401:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 689 00000001:00080000:1.0:1788986246.981597:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967552 is committed 00000001:00080000:1.0:1788986246.981615:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967554 is committed 00000001:00080000:1.0:1788986246.981622:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967555 is committed 00000004:00080000:1.0:1788986246.981631:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 56 committed 00000100:00100000:1.0:1788986246.981876:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993486848:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788986246.981958:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986246.982160:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993486848 00000100:00100000:0.0:1788986246.982169:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993486848 00000100:00100000:0.0:1788986246.982234:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:0.0:1788986246.982245:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993486848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788986246.982277:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:21 count 1 00010000:00010000:0.0:1788986246.982308:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986246.982333:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf548473 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1066 expref: 5 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986246.982343:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788986246.982348:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986246.982353:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986246.982385:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf548473 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1066 expref: 5 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986246.982403:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf548473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1066 expref: 5 pid: 6697 timeout: 2130 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986246.982415:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993486976:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986246.982464:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5ab753c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788986246.982636:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986246.986589:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.987056:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971260800 00000100:00100000:3.0:1788986246.987069:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971260800 00000100:00100000:3.0:1788986246.987226:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 373 00000100:00100000:3.0:1788986246.987238:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971260800:12345-192.168.206.21@tcp:16:dd.0 00000100:00100000:3.0:1788986246.987553:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986246.987580:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971260928 00000100:00100000:3.0:1788986246.987585:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971260928 00010000:00010000:3.0:1788986246.987767:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf548473 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1066 expref: 6 pid: 6697 timeout: 2130 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986246.987808:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 369 00000100:00100000:3.0:1788986246.987816:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971260928:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986246.987828:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986246.987835:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf548473 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1066 expref: 6 pid: 6697 timeout: 2130 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.987851:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf548473 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1066 expref: 6 pid: 6697 timeout: 2130 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.987896:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986246.987901:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986246.987908:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.987919:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.987951:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986246.988008:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971260928:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 192us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986246.988027:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 369 00010000:00010000:3.0:1788986246.988086:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf548473 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x15:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1066 expref: 5 pid: 6697 timeout: 2130 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986246.988127:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993486976:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788986246.988153:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.988164:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.988172:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.988183:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.988192:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.988212:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788986246.988933:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993486848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6686us (6972us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1788986246.988943:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00010000:00010000:3.0:1788986246.988974:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986246.988982:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.988992:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986246.988998:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.989009:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.989039:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.989049:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ad6f6dc/0xc20d828fcf5484f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986246.989072:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986246.989074:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986246.989076:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986246.989150:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0942bb1180/2, rc 0, transno 4294967339 00000100:00100000:3.0:1788986246.989158:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993486848:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788986247.048404:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971260800:12345-192.168.206.21@tcp:16:dd.0 Request processed in 61157us (61820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986247.048418:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 373 00000001:00080000:0.0:1788986247.048456:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967340 is committed 00000001:00080000:0.0:1788986247.048469:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967339 is committed 00000100:00100000:3.0:1788986247.060157:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986247.060430:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971261184 00000100:00100000:1.0:1788986247.060439:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971261184 00000100:00100000:1.0:1788986247.060481:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 70 00000100:00100000:1.0:1788986247.060859:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:45724:x1875885971261184:12345-192.168.206.21@tcp:35:dd.0 00000100:00100000:0.0:1788986247.066452:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:45724:x1875885971261184:12345-192.168.206.21@tcp:35:dd.0 Request processed in 5954us (6295us total) trans 4294967556 rc 0/0 00000100:00100000:0.0:1788986247.066464:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 70 00010000:00010000:2.0:1788986247.104713:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986247.170037:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986247.170059:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993487104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986247.170150:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986247.170299:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993487104 00000100:00100000:0.0:1788986247.170307:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993487104 00000100:00100000:0.0:1788986247.170380:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 720 00000100:00100000:0.0:1788986247.170389:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993487104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986247.170410:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1788986247.170465:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993487104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986247.170473:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 720 00000100:00100000:3.0:1788986247.170710:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967339 gen 2 00000004:00080000:3.0:1788986247.170717:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7988ea00, transno 4294967339 00000100:00100000:3.0:1788986247.170743:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993487104:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986247.170856:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986248.129186:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986248.194360:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993487488:0@lo:400:kworker.0 00000100:00100000:3.0:1788986248.194420:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986248.194469:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986248.194476:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993487616:0@lo:400:kworker.0 00000100:00100000:3.0:1788986248.194500:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986248.194533:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993487488 00000100:00100000:3.0:1788986248.194541:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993487488 00000100:00100000:3.0:1788986248.194597:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1788986248.194605:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993487488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986248.194664:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993487488:12345-0@lo:400:kworker.0 Request processed in 59us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986248.194670:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1788986248.194694:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993487616 00000100:00100000:3.0:1788986248.194698:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993487616 00000100:00100000:3.0:1788986248.194721:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1788986248.194727:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993487616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986248.194755:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993487616:12345-0@lo:400:kworker.0 Request processed in 29us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986248.194761:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00080000:3.0:1788986248.194776:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986248.194808:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993487616:0@lo:400:kworker.0 00000100:00100000:3.0:1788986248.194819:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993487488:0@lo:400:kworker.0 00000100:00100000:2.0:1788986248.194892:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993487360:0@lo:400:kworker.0 00000100:00100000:2.0:1788986248.194922:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986248.194958:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993487872:0@lo:400:kworker.0 00000100:00100000:2.0:1788986248.194980:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986248.195001:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788986248.195016:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993487232:0@lo:400:kworker.0 00000100:00100000:2.0:1788986248.195044:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986248.195067:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993487744:0@lo:400:kworker.0 00000100:00100000:2.0:1788986248.195117:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986248.195143:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993487872 00000100:00100000:2.0:1788986248.195147:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993487872 00000100:00100000:2.0:1788986248.195180:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1788986248.195186:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993487872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986248.195223:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993487872:12345-0@lo:400:kworker.0 Request processed in 37us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986248.195229:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1788986248.195248:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993487232 00000100:00100000:2.0:1788986248.195251:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993487232 00000100:00100000:2.0:1788986248.195274:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1788986248.195280:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993487232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986248.195309:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993487232:12345-0@lo:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986248.195314:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1788986248.195339:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993487360 00000100:00100000:2.0:1788986248.195342:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993487360 00000100:00100000:2.0:1788986248.195363:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993487744 00000100:00100000:2.0:1788986248.195366:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993487744 00000100:00100000:2.0:1788986248.195386:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:2.0:1788986248.195391:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993487360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986248.195420:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993487360:12345-0@lo:400:kworker.0 Request processed in 29us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986248.195426:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00100000:2.0:1788986248.195437:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1788986248.195442:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993487744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986248.195467:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993487744:12345-0@lo:400:kworker.0 Request processed in 25us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986248.195472:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00080000:2.0:1788986248.195495:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986248.195499:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986248.195518:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993487232:0@lo:400:kworker.0 00000100:00100000:2.0:1788986248.195528:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993487744:0@lo:400:kworker.0 00000100:00100000:2.0:1788986248.195536:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993487360:0@lo:400:kworker.0 00000100:00100000:2.0:1788986248.195544:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993487872:0@lo:400:kworker.0 00000001:00080000:1.0:1788986248.519848:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967556 is committed 00000100:00100000:3.0:1788986248.704286:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993488000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986248.704347:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986248.704493:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993488000 00000100:00100000:2.0:1788986248.704499:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993488000 00000100:00100000:2.0:1788986248.704543:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 721 00000100:00100000:2.0:1788986248.704552:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993488000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986248.704583:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986248.711859:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993488000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7301us (7504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986248.711872:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 721 00000100:00100000:3.0:1788986248.712024:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993488000:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986249.152298:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788986249.856051:0:78965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2033758950147ns, next at 2028972367133ns, rc = 0 00000004:00080000:2.0:1788986249.859890:0:78965:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2033762798207ns, next at 2030469181834ns, rc = 0 00000004:00080000:1.0:1788986249.862623:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 57 committed 00000004:00080000:1.0:1788986249.862647:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 56 committed 00010000:00010000:3.0:1788986250.176649:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986250.364120:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986250.364163:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986250.364206:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986250.364233:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986250.364299:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971261440 00000100:00100000:3.0:1788986250.364308:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971261440 00000100:00100000:3.0:1788986250.364376:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1423 00000100:00100000:3.0:1788986250.364386:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971261440:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986250.364456:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971261440:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986250.364463:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1423 00000100:00100000:3.0:1788986250.364488:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971261696 00000100:00100000:3.0:1788986250.364491:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971261696 00000100:00100000:3.0:1788986250.364515:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971261568 00000100:00100000:3.0:1788986250.364518:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971261568 00000100:00100000:3.0:1788986250.364538:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1015 00000100:00100000:3.0:1788986250.364544:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971261696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986250.364570:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971261696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986250.364576:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1015 00000100:00100000:3.0:1788986250.364588:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1016 00000100:00100000:3.0:1788986250.364594:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971261568:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986250.364617:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971261568:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986250.364623:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1016 00000100:00080000:0.0:1788986250.364852:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986250.364857:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986250.364859:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986250.365018:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971261312 00000100:00100000:2.0:1788986250.365023:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971261312 00000100:00100000:2.0:1788986250.365062:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1166 00000100:00100000:2.0:1788986250.365069:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971261312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986250.365127:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971261312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 58us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986250.365133:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1166 00000001:00080000:1.0:1788986250.811059:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967339 is committed 00010000:00010000:2.0:1788986251.202456:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986251.239418:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986251.241585:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971261824 00000100:00100000:3.0:1788986251.241600:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971261824 00000100:00100000:3.0:1788986251.241669:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 690 00000100:00100000:3.0:1788986251.241679:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:45917:x1875885971261824:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986251.241773:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:45917:x1875885971261824:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 95us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986251.241780:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 690 00000100:00100000:3.0:1788986251.245082:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986251.245325:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971261952 00000100:00100000:2.0:1788986251.245335:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971261952 00000100:00100000:2.0:1788986251.245386:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 374 00000100:00100000:2.0:1788986251.245396:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45917:x1875885971261952:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986251.245760:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45917:x1875885971261952:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 364us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986251.245767:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 374 00000100:00100000:1.0:1788986251.254428:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986251.254683:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971262080 00000100:00100000:2.0:1788986251.254693:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971262080 00000100:00100000:2.0:1788986251.254788:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 375 00000100:00100000:2.0:1788986251.254798:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:45917:x1875885971262080:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986251.255230:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:45917:x1875885971262080:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 431us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986251.255240:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 375 00000100:00100000:2.0:1788986251.257401:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986251.257481:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971262208 00000100:00100000:3.0:1788986251.257489:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971262208 00000100:00100000:3.0:1788986251.257543:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 691 00000100:00100000:3.0:1788986251.257554:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:45917:x1875885971262208:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986251.258007:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:45917:x1875885971262208:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 454us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986251.258014:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 691 00000100:00100000:3.0:1788986251.264515:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986251.264590:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971262336 00000100:00100000:2.0:1788986251.264599:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971262336 00000100:00100000:2.0:1788986251.264653:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 692 00000100:00100000:2.0:1788986251.264663:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:45917:x1875885971262336:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986251.264759:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:45917:x1875885971262336:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 97us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986251.264766:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 692 00000100:00100000:3.0:1788986251.273571:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986251.273608:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971262464 00000100:00100000:3.0:1788986251.273617:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971262464 00000100:00100000:3.0:1788986251.273665:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 376 00000100:00100000:3.0:1788986251.273674:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45917:x1875885971262464:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986251.274259:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:45917:x1875885971262464:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 584us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986251.274267:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 376 00000100:00100000:3.0:1788986251.276132:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986251.280172:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971262592 00000100:00100000:2.0:1788986251.280185:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971262592 00000100:00100000:2.0:1788986251.280241:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 377 00000100:00100000:2.0:1788986251.280249:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:45917:x1875885971262592:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986251.281176:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:45917:x1875885971262592:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 923us (5048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986251.281185:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 377 00000100:00100000:2.0:1788986251.293208:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986251.293287:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971262720 00000100:00100000:3.0:1788986251.293296:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971262720 00000100:00100000:3.0:1788986251.293352:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 693 00000100:00100000:3.0:1788986251.293362:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:45917:x1875885971262720:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986251.293799:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:45917:x1875885971262720:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 437us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986251.293807:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 693 00000100:00100000:2.0:1788986251.387930:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986251.388044:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971262976 00000100:00100000:1.0:1788986251.388053:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971262976 00000100:00100000:1.0:1788986251.388138:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 694 00000100:00100000:1.0:1788986251.388148:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:45921:x1875885971262976:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788986251.388199:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986251.388223:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5484dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d107b expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.388243:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:1.0:1788986251.388254:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986251.388275:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5484f8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.388287:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5484f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.388296:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5484f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.388311:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5484ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.388317:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5484ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.388323:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5484ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.388618:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548506 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.388627:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548506 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.388634:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548506 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986251.389509:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].22, 64 off9600 00000004:00080000:1.0:1788986251.389520:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2035292430414ns, next at 2036292428059ns, rc = 0 00010000:00010000:1.0:1788986251.389613:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54850d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389624:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54850d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389634:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54850d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389646:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54850d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389652:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54850d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389657:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54850d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389683:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986251.389704:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548506 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389710:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548506 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389715:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548506 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389721:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986251.389725:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548506 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389732:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548506 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389741:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:1.0:1788986251.389744:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986251.389747:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548506 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389758:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548506 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x39:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389774:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5484f8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389780:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5484f8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389786:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5484f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389791:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986251.389794:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5484f8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389799:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5484f8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389806:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:1.0:1788986251.389808:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986251.389810:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5484f8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.389815:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5484f8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986251.389825:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000586f920a reply state 00000000e453d5f8 transno 4294967557 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5484ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986251.389833:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986251.389911:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:45921:x1875885971262976:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1762us (1988us total) trans 4294967557 rc 0/0 00000100:00100000:1.0:1788986251.389919:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 694 00010000:00010000:3.0:1788986251.390425:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986251.390433:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54850d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986251.390440:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986251.390443:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54850d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986251.390450:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54850d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986251.390467:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x39:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:3.0:1788986251.390470:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986251.390473:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54850d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986251.390480:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54850d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x39:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986251.390495:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986251.390496:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986251.390498:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986251.394049:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5484ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.394065:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5484ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.394073:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5484ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.394080:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986251.394085:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5484ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.394136:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5484ff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.394152:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a45316300) 00010000:00010000:1.0:1788986251.394155:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986251.394161:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5484ff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986251.394168:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5484ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986252.224291:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986252.294344:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986252.301543:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993488128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986252.301611:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986252.301704:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993488128 00000100:00100000:2.0:1788986252.301712:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993488128 00000100:00100000:2.0:1788986252.301772:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 722 00000100:00100000:2.0:1788986252.301781:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993488128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986252.301814:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788986252.301861:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993488128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986252.301869:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 722 00000100:00080000:3.0:1788986252.302008:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986252.302046:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993488128:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986253.249171:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986253.314602:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993488256:0@lo:400:kworker.0 00000100:00100000:3.0:1788986253.314647:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993488512:0@lo:400:kworker.0 00000100:00100000:3.0:1788986253.321790:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986253.321854:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986253.321866:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993488640:0@lo:400:kworker.0 00000100:00100000:3.0:1788986253.321897:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986253.322458:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993488512 00000100:00100000:3.0:1788986253.322467:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993488512 00000100:00100000:3.0:1788986253.322519:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1788986253.322529:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993488512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986253.322586:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993488512:12345-0@lo:400:kworker.0 Request processed in 59us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986253.322593:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:3.0:1788986253.322617:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993488640 00000100:00100000:3.0:1788986253.322620:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993488640 00000100:00100000:3.0:1788986253.322643:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:3.0:1788986253.322649:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993488640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986253.322691:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993488640:12345-0@lo:400:kworker.0 Request processed in 41us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986253.322696:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00080000:3.0:1788986253.322711:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986253.322744:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993488640:0@lo:400:kworker.0 00000100:00100000:3.0:1788986253.322754:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993488512:0@lo:400:kworker.0 00000100:00100000:0.0:1788986253.323191:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993488384:0@lo:400:kworker.0 00000100:00100000:0.0:1788986253.323227:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986253.323253:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993488896:0@lo:400:kworker.0 00000100:00100000:0.0:1788986253.323273:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986253.324700:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993488384 00000100:00100000:2.0:1788986253.324712:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993488384 00000100:00100000:2.0:1788986253.324766:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1788986253.324775:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993488384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986253.324862:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993488384:12345-0@lo:400:kworker.0 Request processed in 77us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986253.324869:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1788986253.324895:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993488896 00000100:00100000:2.0:1788986253.324899:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993488896 00000100:00100000:2.0:1788986253.324941:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1788986253.324948:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993488896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986253.324958:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986253.325183:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993488896:12345-0@lo:400:kworker.0 Request processed in 235us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986253.325190:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00080000:2.0:1788986253.325206:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986253.325218:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993488256 00000100:00100000:2.0:1788986253.325222:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993488256 00000100:00100000:2.0:1788986253.325249:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1167 00000100:00100000:2.0:1788986253.325255:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993488256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986253.325285:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993488256:12345-0@lo:400:kworker.0 Request processed in 31us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986253.325291:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1167 00000100:00100000:0.0:1788986253.325508:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993488384:0@lo:400:kworker.0 00000100:00100000:0.0:1788986253.325519:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967339 gen 2 00000004:00080000:0.0:1788986253.325524:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0942bb1180, transno 4294967339 00000100:00100000:0.0:1788986253.325579:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993488896:0@lo:400:kworker.0 00000100:00100000:0.0:1788986253.325630:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993488256:0@lo:400:kworker.0 00000100:00100000:0.0:1788986253.325640:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993488768:0@lo:400:kworker.0 00000100:00100000:0.0:1788986253.325684:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986253.332125:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993488768 00000100:00100000:1.0:1788986253.332141:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993488768 00000100:00100000:1.0:1788986253.332205:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1788986253.332214:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993488768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986253.332303:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993488768:12345-0@lo:400:kworker.0 Request processed in 90us (6617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986253.332310:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00100000:1.0:1788986253.332374:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993488768:0@lo:400:kworker.0 00000100:00080000:1.0:1788986253.332401:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:3.0:1788986253.487317:0:79112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2037390224710ns, next at 2036292428059ns, rc = 0 00000001:00080000:1.0:1788986253.539191:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967557 is committed 00000004:00080000:1.0:1788986253.539203:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 57 committed 00000004:00080000:1.0:1788986253.539218:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 58 committed 00000100:00100000:1.0:1788986253.539327:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993489024:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788986253.539388:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986253.539624:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993489024 00000100:00100000:1.0:1788986253.539632:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993489024 00000100:00100000:1.0:1788986253.539717:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788986253.539726:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993489024:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788986253.539752:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:22 count 1 00010000:00010000:1.0:1788986253.539776:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.539796:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf5484ea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1082 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.539804:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x16:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1788986253.539808:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986253.539812:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.539838:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf5484ea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1082 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.539852:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf5484ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1082 expref: 5 pid: 8478 timeout: 2137 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986253.539864:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993489152:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986253.539934:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a554e0600 going to sleep for 11 seconds 00000100:00100000:1.0:1788986253.543483:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986253.543516:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971263104 00000100:00100000:1.0:1788986253.543525:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971263104 00010000:00010000:1.0:1788986253.544527:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf5484ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1082 expref: 6 pid: 8478 timeout: 2137 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986253.544567:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 370 00000100:00100000:1.0:1788986253.544577:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971263104:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986253.544593:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986253.544599:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf5484ea lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1082 expref: 6 pid: 8478 timeout: 2137 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.544612:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf5484ea lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1082 expref: 6 pid: 8478 timeout: 2137 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.544638:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986253.544644:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986253.544650:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.544660:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.544681:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986253.544733:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971263104:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 156us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986253.544740:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 370 00000100:00080000:1.0:1788986253.544764:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986253.546752:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf5484ea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1082 expref: 5 pid: 8478 timeout: 2137 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986253.546774:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993489152:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788986253.546797:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986253.546808:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986253.546816:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986253.546827:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986253.546835:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986253.546871:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986253.547668:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986253.547678:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.547687:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986253.547691:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.547699:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.547717:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.547724:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf548514 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986253.547746:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986253.547748:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986253.547749:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986253.548674:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993489024:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8946us (9283us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788986253.548685:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000004:00080000:1.0:1788986253.548789:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b094268dc00/2, rc 0, transno 4294967341 00000100:00100000:1.0:1788986253.548807:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993489024:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788986253.549364:0:79112:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2037452274064ns, next at 2030469181834ns, rc = 0 00000004:00080000:1.0:1788986253.554510:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 58 committed 00000100:00100000:1.0:1788986253.825271:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993489280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986253.825449:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986253.825531:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993489280 00000100:00100000:1.0:1788986253.825539:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993489280 00000100:00100000:1.0:1788986253.825586:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 723 00000100:00100000:1.0:1788986253.825595:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993489280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986253.825627:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986253.825674:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993489280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986253.825680:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 723 00000100:00100000:1.0:1788986253.825723:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993489280:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986254.272206:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986255.298005:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986255.485825:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986255.485872:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986255.485907:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986255.485928:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986255.485962:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971263616 00000100:00100000:0.0:1788986255.485962:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971263488 00000100:00100000:1.0:1788986255.485981:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971263616 00000100:00100000:0.0:1788986255.485984:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971263488 00000100:00080000:2.0:1788986255.486167:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986255.486171:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986255.486240:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971263232 00000100:00100000:3.0:1788986255.486246:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971263232 00000100:00100000:3.0:1788986255.486288:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1168 00000100:00100000:3.0:1788986255.486298:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971263232:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986255.486362:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971263232:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986255.486370:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1168 00000100:00100000:3.0:1788986255.486402:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971263360 00000100:00100000:3.0:1788986255.486406:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971263360 00000100:00100000:3.0:1788986255.486441:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1427 00000100:00100000:3.0:1788986255.486449:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971263360:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986255.486482:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971263360:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986255.486488:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1427 00000100:00080000:3.0:1788986255.486615:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986255.487003:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1019 00000100:00100000:1.0:1788986255.487014:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971263616:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986255.487054:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971263616:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 43us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986255.487060:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1019 00000100:00100000:0.0:1788986255.489392:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1020 00000100:00100000:0.0:1788986255.489409:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971263488:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986255.489487:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971263488:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (3614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986255.489495:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1020 00010000:00010000:3.0:1788986256.320224:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788986256.473865:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967341 is committed 00010000:00010000:1.0:1788986257.344242:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986257.408786:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993489408:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986257.408852:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986257.409000:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993489408 00000100:00100000:3.0:1788986257.409008:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993489408 00000100:00100000:3.0:1788986257.409085:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 724 00000100:00100000:3.0:1788986257.409115:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993489408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986257.409148:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986257.409199:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993489408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986257.409206:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 724 00000100:00100000:3.0:1788986257.409243:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:3.0:1788986257.409248:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b094268dc00, transno 4294967341 00000100:00100000:3.0:1788986257.409267:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993489408:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986257.409842:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986258.369034:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986258.434459:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993489792:0@lo:400:kworker.0 00000100:00100000:1.0:1788986258.434525:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986258.434589:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788986258.434596:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993489664:0@lo:400:kworker.0 00000100:00100000:1.0:1788986258.434620:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986258.434638:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993490176:0@lo:400:kworker.0 00000100:00100000:1.0:1788986258.434663:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986258.434695:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993489792 00000100:00100000:1.0:1788986258.434702:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993489792 00000100:00100000:1.0:1788986258.434749:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993489664 00000100:00100000:1.0:1788986258.434753:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993489664 00000100:00100000:1.0:1788986258.434774:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1788986258.434782:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993489792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986258.434822:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993490176 00000100:00100000:0.0:1788986258.434826:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993490176 00000100:00100000:1.0:1788986258.434828:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993489792:12345-0@lo:400:kworker.0 Request processed in 47us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986258.434834:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1428 00000100:00100000:1.0:1788986258.434849:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1788986258.434855:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993489664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986258.434855:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1788986258.434861:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993490176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986258.434880:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993489664:12345-0@lo:400:kworker.0 Request processed in 26us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986258.434886:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:0.0:1788986258.434886:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993490176:12345-0@lo:400:kworker.0 Request processed in 27us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986258.434891:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:1.0:1788986258.434922:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993489664:0@lo:400:kworker.0 00000100:00100000:1.0:1788986258.434931:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993490176:0@lo:400:kworker.0 00000100:00100000:1.0:1788986258.434938:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993489792:0@lo:400:kworker.0 00000100:00080000:1.0:1788986258.434980:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986258.434985:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986258.435073:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993489920:0@lo:400:kworker.0 00000100:00100000:3.0:1788986258.435123:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986258.435159:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788986258.435164:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993489536:0@lo:400:kworker.0 00000100:00100000:3.0:1788986258.435191:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986258.435224:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993490048:0@lo:400:kworker.0 00000100:00100000:3.0:1788986258.435247:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986258.435272:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993490048 00000100:00100000:3.0:1788986258.435275:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993490048 00000100:00100000:3.0:1788986258.435301:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1788986258.435308:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993490048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986258.435340:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993490048:12345-0@lo:400:kworker.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986258.435345:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00100000:3.0:1788986258.435370:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993490048:0@lo:400:kworker.0 00000100:00100000:1.0:1788986258.435433:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993489920 00000100:00100000:1.0:1788986258.435437:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993489920 00000100:00100000:1.0:1788986258.435470:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:1.0:1788986258.435477:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993489920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986258.435514:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993489920:12345-0@lo:400:kworker.0 Request processed in 37us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986258.435520:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00080000:1.0:1788986258.435534:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986258.435552:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993489920:0@lo:400:kworker.0 00000100:00100000:0.0:1788986258.435768:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993489536 00000100:00100000:0.0:1788986258.435773:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993489536 00000100:00100000:0.0:1788986258.435807:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:0.0:1788986258.435815:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993489536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986258.435859:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993489536:12345-0@lo:400:kworker.0 Request processed in 46us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986258.435866:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:1.0:1788986258.435983:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993489536:0@lo:400:kworker.0 00000100:00100000:0.0:1788986258.946254:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986258.946283:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993490304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986258.946371:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986258.948348:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993490304 00000100:00100000:3.0:1788986258.948368:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993490304 00000100:00100000:3.0:1788986258.948438:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1788986258.948450:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993490304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986258.948497:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986258.948604:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993490304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 157us (2233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986258.948612:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 725 00000100:00100000:3.0:1788986258.948685:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993490304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986259.393374:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986260.416307:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986260.592391:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986260.592447:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986260.592899:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986260.593120:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971263872 00000100:00100000:0.0:1788986260.593134:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971263872 00000100:00100000:0.0:1788986260.593207:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1431 00000100:00100000:0.0:1788986260.593220:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971263872:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986260.593320:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971263872:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 103us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986260.593328:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1431 00000100:00100000:3.0:1788986260.593450:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986260.593613:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971263744 00000100:00100000:2.0:1788986260.593619:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971263744 00000100:00100000:2.0:1788986260.593659:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1170 00000100:00100000:2.0:1788986260.593667:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971263744:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986260.593700:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971263744:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986260.593708:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1170 00000100:00100000:1.0:1788986260.594029:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971264000 00000100:00100000:1.0:1788986260.594036:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971264000 00000100:00100000:1.0:1788986260.594081:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971264128 00000100:00100000:1.0:1788986260.594085:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971264128 00000100:00100000:1.0:1788986260.594150:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1023 00000100:00100000:1.0:1788986260.594157:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971264000:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986260.594193:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971264000:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (1745us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986260.594200:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1023 00000100:00100000:1.0:1788986260.594212:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1024 00000100:00100000:1.0:1788986260.594219:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971264128:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986260.594246:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971264128:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986260.594251:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1024 00000100:00080000:1.0:1788986260.594267:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986260.594271:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986260.594274:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788986261.440442:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986262.465222:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986262.529228:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986262.529256:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993490432:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986262.529362:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986262.530055:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993490432 00000100:00100000:3.0:1788986262.530067:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993490432 00000100:00100000:3.0:1788986262.530180:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 726 00000100:00100000:3.0:1788986262.530192:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993490432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986262.530237:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986262.530318:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993490432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986262.530325:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 726 00000100:00100000:2.0:1788986262.530902:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993490432:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986262.533790:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986263.489578:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986263.552412:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993490688:0@lo:400:kworker.0 00000100:00100000:3.0:1788986263.552477:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986263.552540:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993491200:0@lo:400:kworker.0 00000100:00100000:3.0:1788986263.552568:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986263.552589:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986263.552595:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993490816:0@lo:400:kworker.0 00000100:00100000:3.0:1788986263.552614:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986263.552643:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993490688 00000100:00100000:3.0:1788986263.552650:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993490688 00000100:00100000:3.0:1788986263.552690:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993490816 00000100:00100000:3.0:1788986263.552693:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993490816 00000100:00100000:3.0:1788986263.552717:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1788986263.552724:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993490688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986263.552770:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993490688:12345-0@lo:400:kworker.0 Request processed in 46us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986263.552780:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1788986263.552796:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1788986263.552802:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993490816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986263.552825:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993490816:12345-0@lo:400:kworker.0 Request processed in 24us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986263.552831:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:3.0:1788986263.552862:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993490816:0@lo:400:kworker.0 00000100:00100000:3.0:1788986263.552872:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993490688:0@lo:400:kworker.0 00000100:00100000:1.0:1788986263.553124:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993490944:0@lo:400:kworker.0 00000100:00100000:1.0:1788986263.553154:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986263.553188:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788986263.553195:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993490560:0@lo:400:kworker.0 00000100:00100000:1.0:1788986263.553221:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986263.553251:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993491072:0@lo:400:kworker.0 00000100:00100000:1.0:1788986263.553270:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986263.553292:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993491072 00000100:00100000:1.0:1788986263.553295:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993491072 00000100:00100000:1.0:1788986263.553323:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:1.0:1788986263.553329:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993491072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986263.553362:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993491072:12345-0@lo:400:kworker.0 Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986263.553369:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00080000:1.0:1788986263.553384:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986263.553475:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993490560 00000100:00100000:0.0:1788986263.553480:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993490560 00000100:00100000:0.0:1788986263.553507:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1171 00000100:00100000:0.0:1788986263.553514:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993490560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986263.553546:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993490560:12345-0@lo:400:kworker.0 Request processed in 33us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986263.553553:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1171 00000100:00100000:0.0:1788986263.553593:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993491200 00000100:00100000:0.0:1788986263.553597:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993491200 00000100:00100000:0.0:1788986263.553624:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993490944 00000100:00100000:0.0:1788986263.553627:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993490944 00000100:00100000:0.0:1788986263.553643:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1788986263.553649:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993491200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986263.553683:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993491200:12345-0@lo:400:kworker.0 Request processed in 34us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986263.553689:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1788986263.553701:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1788986263.553707:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993490944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986263.553733:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993490944:12345-0@lo:400:kworker.0 Request processed in 27us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986263.553739:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00080000:0.0:1788986263.553767:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986263.553812:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993491072:0@lo:400:kworker.0 00000100:00100000:1.0:1788986263.553821:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993490944:0@lo:400:kworker.0 00000100:00100000:1.0:1788986263.553839:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993490560:0@lo:400:kworker.0 00000100:00100000:3.0:1788986263.554256:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993491200:0@lo:400:kworker.0 00000100:00100000:2.0:1788986264.064908:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986264.064940:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993491328:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986264.065010:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986264.065111:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993491328 00000100:00100000:2.0:1788986264.065118:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993491328 00000100:00100000:2.0:1788986264.065159:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1788986264.065173:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993491328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986264.065204:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986264.065251:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993491328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986264.065258:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 727 00000100:00100000:2.0:1788986264.065303:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993491328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986264.512621:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986265.536302:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986265.712693:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986265.712734:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986265.712766:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986265.712801:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986265.712830:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971264512 00000100:00100000:2.0:1788986265.712838:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971264512 00000100:00100000:2.0:1788986265.712888:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971264640 00000100:00100000:2.0:1788986265.712891:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971264640 00000100:00100000:2.0:1788986265.712911:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1027 00000100:00100000:2.0:1788986265.712933:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971264512:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986265.712991:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971264512:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 60us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986265.712997:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1027 00000100:00100000:2.0:1788986265.713013:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1028 00000100:00100000:2.0:1788986265.713019:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971264640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986265.713040:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971264640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 22us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986265.713045:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1028 00000100:00080000:2.0:1788986265.713065:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986265.713069:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986265.713140:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971264384 00000100:00100000:1.0:1788986265.713144:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971264384 00000100:00100000:1.0:1788986265.713192:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1435 00000100:00100000:1.0:1788986265.713200:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971264384:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986265.713231:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971264384:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986265.713236:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1435 00000100:00100000:3.0:1788986265.713344:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971264256 00000100:00100000:3.0:1788986265.713348:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971264256 00000100:00100000:3.0:1788986265.713384:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1172 00000100:00100000:3.0:1788986265.713392:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971264256:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986265.713418:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971264256:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986265.713425:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1172 00000100:00080000:2.0:1788986265.713744:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986266.560795:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986267.584327:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986267.649179:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986267.649202:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993491456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986267.649293:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986267.649584:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993491456 00000100:00100000:3.0:1788986267.649592:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993491456 00000100:00100000:3.0:1788986267.649665:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 728 00000100:00100000:3.0:1788986267.649673:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993491456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986267.649718:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986267.649762:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993491456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986267.649769:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 728 00000100:00080000:3.0:1788986267.649801:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986267.650115:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993491456:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986268.608275:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986268.672295:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993491584:0@lo:400:kworker.0 00000100:00100000:3.0:1788986268.672375:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993491712:0@lo:400:kworker.0 00000100:00100000:2.0:1788986268.672387:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986268.672408:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986268.672476:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993491712 00000100:00100000:1.0:1788986268.672484:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993491712 00000100:00100000:1.0:1788986268.672533:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1436 00000100:00100000:1.0:1788986268.672542:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993491712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986268.672611:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993492096:0@lo:400:kworker.0 00000100:00100000:3.0:1788986268.672642:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993491712:0@lo:400:kworker.0 00000100:00100000:0.0:1788986268.672660:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993491584 00000100:00100000:0.0:1788986268.672664:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993491584 00000100:00100000:0.0:1788986268.672694:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1788986268.672701:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993491584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986268.672737:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993492224:0@lo:400:kworker.0 00000100:00100000:2.0:1788986268.676617:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986268.676681:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986268.676693:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993491968:0@lo:400:kworker.0 00000100:00100000:2.0:1788986268.676731:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986268.676771:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993491968 00000100:00100000:2.0:1788986268.676778:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993491968 00000100:00100000:2.0:1788986268.676822:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1788986268.676830:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993491968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986268.676881:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993491968:12345-0@lo:400:kworker.0 Request processed in 51us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986268.676888:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:2.0:1788986268.676929:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993491840:0@lo:400:kworker.0 00000100:00100000:2.0:1788986268.676956:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986268.677003:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993491968:0@lo:400:kworker.0 00000100:00100000:2.0:1788986268.677038:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993492096 00000100:00100000:2.0:1788986268.677042:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993492096 00000100:00100000:2.0:1788986268.677076:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993491840 00000100:00100000:2.0:1788986268.677079:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993491840 00000100:00100000:2.0:1788986268.677110:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1788986268.677117:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993492096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986268.677152:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993492096:12345-0@lo:400:kworker.0 Request processed in 36us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986268.677157:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1788986268.677168:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1788986268.677174:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993491840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986268.677204:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993491840:12345-0@lo:400:kworker.0 Request processed in 30us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986268.677210:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1788986268.677237:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993491840:0@lo:400:kworker.0 00000100:00100000:2.0:1788986268.677257:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993492096:0@lo:400:kworker.0 00000100:00080000:2.0:1788986268.677291:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986268.685229:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993491712:12345-0@lo:400:kworker.0 Request processed in 12678us (12810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986268.685242:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1436 00000100:00100000:0.0:1788986268.690117:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993491584:12345-0@lo:400:kworker.0 Request processed in 17408us (17721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986268.690131:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:2.0:1788986268.690171:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993491584:0@lo:400:kworker.0 00000100:00100000:3.0:1788986268.691000:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986268.699578:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993492224 00000100:00100000:0.0:1788986268.699593:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993492224 00000100:00100000:0.0:1788986268.699685:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:0.0:1788986268.699696:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993492224:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788986268.699834:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986268.699868:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993492224:12345-0@lo:400:kworker.0 Request processed in 174us (8868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986268.699875:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1788986268.703720:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993492224:0@lo:400:kworker.0 00000100:00100000:3.0:1788986269.185519:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993492352:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986269.185622:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986269.186513:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993492352 00000100:00100000:0.0:1788986269.186522:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993492352 00000100:00100000:0.0:1788986269.186574:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 729 00000100:00100000:0.0:1788986269.186583:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993492352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986269.186618:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986269.186678:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993492352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986269.186741:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 729 00000100:00100000:3.0:1788986269.186822:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993492352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986269.431177:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986269.431281:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971264768 00000100:00100000:2.0:1788986269.431291:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971264768 00000100:00100000:2.0:1788986269.431357:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 695 00000100:00100000:2.0:1788986269.431366:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46139:x1875885971264768:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986269.431466:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46139:x1875885971264768:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 100us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986269.431473:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 695 00000100:00080000:3.0:1788986269.431653:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986269.436688:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986269.437181:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971264896 00000100:00100000:2.0:1788986269.437194:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971264896 00000100:00100000:2.0:1788986269.437344:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 379 00000100:00100000:2.0:1788986269.437355:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46139:x1875885971264896:12345-192.168.206.21@tcp:19:lfs.0 00000100:00080000:3.0:1788986269.437970:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986269.438290:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46139:x1875885971264896:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 934us (1613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986269.438299:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 379 00000100:00100000:0.0:1788986269.440209:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986269.440303:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971265024 00000100:00100000:1.0:1788986269.440312:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971265024 00000100:00100000:1.0:1788986269.440385:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 380 00000100:00100000:1.0:1788986269.440395:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46139:x1875885971265024:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986269.440764:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46139:x1875885971265024:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 369us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986269.440772:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 380 00000100:00080000:3.0:1788986269.441675:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986269.450027:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986269.450113:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971265152 00000100:00100000:2.0:1788986269.450122:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971265152 00000100:00100000:2.0:1788986269.450177:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 696 00000100:00100000:2.0:1788986269.450187:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46139:x1875885971265152:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986269.450791:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46139:x1875885971265152:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 605us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986269.450800:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 696 00000100:00100000:0.0:1788986269.453504:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986269.453670:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971265280 00000100:00100000:1.0:1788986269.453800:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971265280 00000100:00100000:1.0:1788986269.453879:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 697 00000100:00100000:1.0:1788986269.453902:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46139:x1875885971265280:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986269.454000:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46139:x1875885971265280:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 111us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986269.454007:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 697 00000100:00100000:0.0:1788986269.456251:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986269.460011:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971265408 00000100:00100000:2.0:1788986269.460026:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971265408 00000100:00100000:2.0:1788986269.460130:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 381 00000100:00100000:2.0:1788986269.460145:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46139:x1875885971265408:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986269.460494:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46139:x1875885971265408:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 353us (4254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986269.460502:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 381 00000100:00100000:3.0:1788986269.462445:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986269.465659:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971265536 00000100:00100000:1.0:1788986269.465671:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971265536 00000100:00100000:1.0:1788986269.465747:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 382 00000100:00100000:1.0:1788986269.465756:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46139:x1875885971265536:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986269.466081:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46139:x1875885971265536:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 324us (3649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986269.466120:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 382 00000100:00100000:0.0:1788986269.476452:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986269.478534:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971265664 00000100:00100000:1.0:1788986269.478550:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971265664 00000100:00100000:1.0:1788986269.478663:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 698 00000100:00100000:1.0:1788986269.478674:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46139:x1875885971265664:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986269.479162:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46139:x1875885971265664:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 489us (2723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986269.479174:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 698 00010000:00010000:1.0:1788986269.633955:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986270.668464:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986270.834961:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986270.835006:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986270.835033:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986270.835059:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986270.835120:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971266048 00000100:00100000:2.0:1788986270.835129:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971266048 00000100:00100000:2.0:1788986270.835172:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971266176 00000100:00100000:2.0:1788986270.835175:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971266176 00000100:00100000:2.0:1788986270.835194:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1031 00000100:00100000:2.0:1788986270.835202:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971266048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986270.835266:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971266048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986270.835273:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1031 00000100:00100000:2.0:1788986270.835288:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1032 00000100:00100000:2.0:1788986270.835295:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971266176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986270.835318:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971266176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986270.835324:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1032 00000100:00100000:2.0:1788986270.835343:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971265920 00000100:00100000:2.0:1788986270.835346:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971265920 00000100:00100000:2.0:1788986270.835370:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1439 00000100:00100000:2.0:1788986270.835375:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971265920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986270.835404:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971265920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986270.835427:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1439 00000100:00100000:1.0:1788986270.835947:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971265792 00000100:00100000:1.0:1788986270.835953:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971265792 00000100:00100000:1.0:1788986270.835983:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1174 00000100:00100000:1.0:1788986270.835990:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971265792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986270.836030:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971265792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 41us (1080us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986270.836037:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1174 00000100:00100000:1.0:1788986271.201410:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986271.201843:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971266304 00000100:00100000:3.0:1788986271.201852:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971266304 00000100:00100000:3.0:1788986271.201931:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 699 00000100:00100000:3.0:1788986271.201941:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46153:x1875885971266304:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986271.201958:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986271.201977:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54851b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1089 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.202037:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548522 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.202051:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.202064:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986271.202152:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:3.0:1788986271.202156:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986271.202175:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548522 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.202200:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54851b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1089 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.202218:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548522 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1089 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.202226:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986271.202229:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986271.202233:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2600, rc 0) 00000100:00100000:3.0:1788986271.202280:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46153:x1875885971266304:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 341us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986271.202287:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 699 00000100:00080000:2.0:1788986271.202561:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986271.210432:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986271.210524:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971266560 00000100:00100000:1.0:1788986271.210533:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971266560 00000100:00100000:1.0:1788986271.210593:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 700 00000100:00100000:1.0:1788986271.210603:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46153:x1875885971266560:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986271.210649:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986271.210672:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548522 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1089 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.210693:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf5484c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1074 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.210704:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:1.0:1788986271.210714:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986271.210737:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548529 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.210749:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.210770:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986271.274900:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007c57d271 reply state 00000000ad61a47a transno 4294967558 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986271.274918:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788986271.274934:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000100:00100000:0.0:1788986271.275039:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46153:x1875885971266560:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 64432us (64610us total) trans 4294967558 rc 0/0 00000100:00100000:0.0:1788986271.275049:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 700 00000001:00080000:2.0:1788986271.281153:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967558 is committed 00010000:00010000:0.0:1788986271.281224:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548529 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986271.281237:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548529 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986271.281320:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548529 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986271.281325:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986271.281330:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548529 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986271.281337:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548529 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986271.281421:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45316600) 00010000:00010000:0.0:1788986271.281425:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788986271.281431:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548529 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986271.281438:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548529 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986271.366483:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986271.366526:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971266688 00000100:00100000:3.0:1788986271.366535:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971266688 00000100:00100000:3.0:1788986271.366588:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 701 00000100:00100000:3.0:1788986271.366598:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46157:x1875885971266688:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:3.0:1788986271.366625:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986271.366645:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548530 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1090 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.366708:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548537 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.366722:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.366733:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.366748:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54853e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.366755:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54853e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.366761:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54853e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367064:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548545 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367073:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367083:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986271.367123:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:3.0:1788986271.367126:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986271.367142:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548545 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367152:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548537 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367159:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548537 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367165:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548537 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367170:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986271.367174:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548537 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367182:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548537 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367192:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:3.0:1788986271.367195:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986271.367199:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548537 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367205:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548537 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367220:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54853e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367226:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54853e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367231:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54853e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367237:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986271.367239:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54853e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367245:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54853e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367251:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a55745800) 00010000:00010000:3.0:1788986271.367254:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986271.367256:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54853e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367261:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54853e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367290:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548530 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1090 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367303:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548545 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1090 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.367315:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:3.0:1788986271.367317:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986271.367320:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2800, rc 0) 00000100:00100000:3.0:1788986271.367372:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46157:x1875885971266688:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 775us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986271.367379:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 701 00000100:00100000:0.0:1788986271.372017:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986271.372184:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971266944 00000100:00100000:3.0:1788986271.372193:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971266944 00000100:00100000:3.0:1788986271.372237:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 702 00000100:00100000:3.0:1788986271.372247:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46157:x1875885971266944:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:3.0:1788986271.372269:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986271.372290:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54854c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1097 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.372539:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548553 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.372554:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548553 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.372564:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548553 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.372590:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54855a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.372598:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54855a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.372606:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54855a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788986271.373735:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x16:0x0], index 1: 0 00010000:00010000:3.0:1788986271.374168:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548561 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.374181:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.374190:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548561 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.374221:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548553 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.374228:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548553 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.374235:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548553 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.374241:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986271.374246:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548553 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.374252:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548553 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.374263:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:3.0:1788986271.374266:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986271.374271:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548553 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.374277:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548553 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986271.374289:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008973d009 reply state 000000005d5a2972 transno 4294967559 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54855a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986271.374296:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788986271.374324:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54854c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1097 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.374336:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548561 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1097 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.374343:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:3.0:1788986271.374345:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788986271.374348:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788986271.375170:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46157:x1875885971266944:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 2921us (3157us total) trans 4294967559 rc 0/0 00000100:00100000:3.0:1788986271.375179:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 702 00010000:00010000:3.0:1788986271.389115:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54855a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.389134:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54855a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.389142:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54855a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.389152:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986271.389157:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54855a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.389163:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54855a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.389180:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a55745400) 00010000:00010000:3.0:1788986271.389183:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986271.389188:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54855a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.389194:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54855a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986271.391275:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986271.391510:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971267200 00000100:00100000:3.0:1788986271.391520:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971267200 00000100:00100000:3.0:1788986271.391583:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 703 00000100:00100000:3.0:1788986271.391593:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46157:x1875885971267200:12345-192.168.206.21@tcp:36:touch.60003 00010000:00010000:3.0:1788986271.391638:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986271.391661:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548561 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1097 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.391681:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:3.0:1788986271.391690:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986271.391728:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54856f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.391740:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54856f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.391751:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54856f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986271.391874:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000090f9e4ad reply state 00000000f7287fab transno 4294967560 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54856f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986271.391894:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986271.391983:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46157:x1875885971267200:12345-192.168.206.21@tcp:36:touch.60003 Request processed in 383us (708us total) trans 4294967560 rc 0/0 00000100:00100000:3.0:1788986271.391990:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 703 00010000:00010000:3.0:1788986271.395171:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54856f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.395187:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54856f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.395195:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54856f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.395200:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986271.395205:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54856f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.395212:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54856f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.395226:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986271.395230:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986271.395235:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54856f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.395244:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54856f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986271.400425:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986271.400458:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971267328 00000100:00100000:0.0:1788986271.400467:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971267328 00000100:00100000:0.0:1788986271.400516:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 704 00000100:00100000:0.0:1788986271.400946:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46157:x1875885971267328:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788986271.400972:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986271.401003:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548576 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d109e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986271.401065:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548576 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d109e expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986271.401080:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548576 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d109e expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986271.401132:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:0.0:1788986271.401136:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788986271.401139:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788986271.401202:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46157:x1875885971267328:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 677us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986271.407388:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 704 00000100:00100000:1.0:1788986271.407534:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986271.407609:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971267456 00000100:00100000:0.0:1788986271.407618:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971267456 00000100:00080000:1.0:1788986271.407664:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986271.407671:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 383 00000100:00100000:0.0:1788986271.407680:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971267456:12345-192.168.206.21@tcp:2:touch.60003 00000100:00100000:0.0:1788986271.408161:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971267456:12345-192.168.206.21@tcp:2:touch.60003 Request processed in 481us (627us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788986271.408169:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 383 00000100:00100000:3.0:1788986271.420796:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986271.420957:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971267712 00000100:00100000:0.0:1788986271.420967:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971267712 00000100:00100000:0.0:1788986271.421032:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 71 00000100:00100000:0.0:1788986271.421042:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46157:x1875885971267712:12345-192.168.206.21@tcp:35:touch.60003 00000100:00100000:0.0:1788986271.421395:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46157:x1875885971267712:12345-192.168.206.21@tcp:35:touch.60003 Request processed in 353us (608us total) trans 4294967561 rc 0/0 00000100:00100000:0.0:1788986271.421403:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 71 00000100:00100000:1.0:1788986271.522648:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986271.522963:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971267840 00000100:00100000:3.0:1788986271.523030:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971267840 00000100:00100000:3.0:1788986271.523177:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 705 00000100:00100000:3.0:1788986271.523189:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46161:x1875885971267840:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:3.0:1788986271.523213:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986271.523232:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54857d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10a5 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523295:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548584 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523308:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548584 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523321:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548584 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523334:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54858b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523341:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54858b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523347:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54858b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523441:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548592 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523451:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523458:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986271.523489:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3a:0x0]: returning size 0 00000004:00200000:3.0:1788986271.523493:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986271.523512:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523524:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548592 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523533:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548584 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523540:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548584 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523547:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548584 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523554:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986271.523559:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548584 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523567:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548584 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523579:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:3.0:1788986271.523581:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986271.523588:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548584 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523594:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548584 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523609:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54858b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523615:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54858b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523621:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54858b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523626:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986271.523629:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54858b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523634:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54858b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523641:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a55745800) 00010000:00010000:3.0:1788986271.523643:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986271.523646:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54858b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523652:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54858b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523819:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54857d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10a5 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523835:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548592 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10a5 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.523842:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:3.0:1788986271.523845:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788986271.523847:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986271.523923:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46161:x1875885971267840:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 735us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986271.523931:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 705 00000100:00100000:1.0:1788986271.529473:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986271.529563:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971267968 00000100:00100000:2.0:1788986271.529573:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971267968 00000100:00100000:2.0:1788986271.529636:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 384 00000100:00100000:2.0:1788986271.529647:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971267968:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:2.0:1788986271.529665:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986271.529692:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000270b3612/0xc20d828fcf548599 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10ac expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788986271.529719:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x6aa1c39f, atime: 0x6aa1c39f, ctime: 0x6aa1c39f, blocks: 0x1 00010000:00010000:2.0:1788986271.529738:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=2055s v=(0 0) 00010000:00010000:2.0:1788986271.529742:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986271.529869:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000270b3612/0xc20d828fcf548599 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10ac expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.529900:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000270b3612/0xc20d828fcf548599 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10ac expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.529914:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986271.529967:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971267968:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 321us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986271.530561:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 384 00000100:00100000:1.0:1788986271.536201:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986271.536732:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971268224 00000100:00100000:2.0:1788986271.536742:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971268224 00000100:00100000:2.0:1788986271.536805:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 706 00000100:00100000:2.0:1788986271.536815:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46161:x1875885971268224:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:2.0:1788986271.536861:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986271.536898:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548592 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10a5 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.536919:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548576 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d109e expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.536928:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:2.0:1788986271.536937:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986271.536956:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5485a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.536969:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5485a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.536989:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5485a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.537011:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5485a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.537018:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5485a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.537028:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5485a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.537171:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5485ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.537180:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5485ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.537186:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5485ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986271.537927:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].22, 64 off9600 00000004:00080000:2.0:1788986271.537938:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2055440848101ns, next at 2056440845351ns, rc = 0 00010000:00010000:2.0:1788986271.538009:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5485b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538021:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5485b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538029:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5485b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538037:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5485b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538043:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5485b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538049:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5485b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538141:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986271.538162:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5485ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538169:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5485ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538175:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5485ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538181:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986271.538185:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5485ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538192:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5485ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538203:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:2.0:1788986271.538206:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986271.538210:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5485ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538216:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5485ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538232:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5485a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538238:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5485a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538248:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5485a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538253:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986271.538256:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5485a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538261:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5485a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538268:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:2.0:1788986271.538271:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986271.538274:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5485a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986271.538279:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5485a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986271.538290:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004ffb2558 reply state 00000000dac193d7 transno 4294967562 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5485a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986271.538298:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986271.538553:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46161:x1875885971268224:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 1736us (2358us total) trans 4294967562 rc 0/0 00000100:00100000:2.0:1788986271.538561:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 706 00010000:00010000:1.0:1788986271.541602:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986271.541617:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5485b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.541628:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986271.541633:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5485b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.541642:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5485b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.541660:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3a:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:1.0:1788986271.541663:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788986271.541669:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5485b5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.541733:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5485b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.541820:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986271.541823:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986271.541825:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986271.548066:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5485a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.548085:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5485a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.548120:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5485a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.548127:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986271.548132:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5485a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.548139:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5485a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.548154:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a45aca500) 00010000:00010000:1.0:1788986271.548157:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986271.548162:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5485a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986271.548169:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5485a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986271.680238:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986271.893768:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967340 is committed 00010000:00010000:2.0:1788986272.704299:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986272.768303:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993492480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986272.768377:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986272.768537:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993492480 00000100:00100000:2.0:1788986272.768545:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993492480 00000100:00100000:2.0:1788986272.768603:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 730 00000100:00100000:2.0:1788986272.768613:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993492480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986272.768645:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986272.768691:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993492480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986272.768699:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 730 00000100:00080000:1.0:1788986272.768763:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986272.768795:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993492480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986272.783924:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986272.787184:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971268352 00000100:00100000:0.0:1788986272.787195:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971268352 00000100:00100000:0.0:1788986272.787256:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 707 00000100:00100000:0.0:1788986272.787266:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46177:x1875885971268352:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986272.787288:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986272.787308:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5485bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10b3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.787458:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5485c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.787473:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5485c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.787486:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5485c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986272.787519:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:0.0:1788986272.787522:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986272.787539:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5485c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.787563:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5485bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10b3 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.787578:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5485c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10b3 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.787586:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:0.0:1788986272.787589:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986272.787592:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee800, rc 0) 00000100:00100000:0.0:1788986272.789739:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46177:x1875885971268352:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 2466us (5817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986272.789761:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 707 00000100:00100000:1.0:1788986272.795336:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986272.795550:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971268608 00000100:00100000:0.0:1788986272.795559:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971268608 00000100:00100000:0.0:1788986272.795612:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 708 00000100:00100000:0.0:1788986272.795622:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46177:x1875885971268608:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788986272.795671:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986272.795695:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5485c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10b3 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.795720:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548545 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1090 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.795730:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:0.0:1788986272.795740:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986272.795823:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5485ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.795836:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5485ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.795845:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5485ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986272.877358:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000046b1a269 reply state 00000000c5925f7a transno 4294967563 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5485ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986272.877375:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788986272.877389:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000100:00100000:0.0:1788986272.877479:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46177:x1875885971268608:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 81855us (82148us total) trans 4294967563 rc 0/0 00000100:00100000:0.0:1788986272.877488:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 708 00000001:00080000:2.0:1788986272.877674:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967563 is committed 00000004:00080000:2.0:1788986272.877691:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 59 committed 00000100:00100000:2.0:1788986272.877805:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986272.877818:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993492608:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788986272.877867:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986272.877935:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993492608 00000100:00100000:2.0:1788986272.877943:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993492608 00000100:00100000:2.0:1788986272.877989:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788986272.877998:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993492608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788986272.878020:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:22 count 1 00010000:00010000:2.0:1788986272.878040:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.878056:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000270b3612/0xc20d828fcf548599 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10ac expref: 5 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.878064:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788986272.878069:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986272.878073:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.878119:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000270b3612/0xc20d828fcf548599 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10ac expref: 5 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.878140:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000270b3612/0xc20d828fcf548599 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10ac expref: 5 pid: 6695 timeout: 2156 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986272.878152:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875885993492736:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986272.878187:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a45b97480 going to sleep for 11 seconds 00000100:00080000:2.0:1788986272.878203:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788986272.880213:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5485ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.880228:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5485ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.880236:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5485ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.880243:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986272.880251:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5485ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.880259:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5485ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.880274:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a4823be00) 00010000:00010000:0.0:1788986272.880277:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788986272.880281:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5485ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986272.880287:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5485ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986272.889777:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986272.889898:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875885993492736:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788986272.889923:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986272.898809:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971268736 00000100:00100000:3.0:1788986272.898822:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971268736 00010000:00010000:3.0:1788986272.898862:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000270b3612/0xc20d828fcf548599 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10ac expref: 6 pid: 6695 timeout: 2156 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986272.898905:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 371 00000100:00100000:3.0:1788986272.898915:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971268736:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986272.898929:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986272.898935:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000270b3612/0xc20d828fcf548599 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10ac expref: 6 pid: 6695 timeout: 2156 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986272.898950:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000270b3612/0xc20d828fcf548599 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10ac expref: 6 pid: 6695 timeout: 2156 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986272.898986:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000270b3612/0xc20d828fcf548599 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x16:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10ac expref: 6 pid: 6695 timeout: 2156 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986272.899003:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986272.899007:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986272.899012:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986272.899021:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986272.899047:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986272.899118:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971268736:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 205us (9348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986272.899125:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 371 00010000:00010000:2.0:1788986272.899516:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.899528:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.899538:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.899545:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.899566:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986272.900073:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986272.900080:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986272.900114:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986272.900118:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986272.900127:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986272.900147:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986272.900155:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040203d0e/0xc20d828fcf5485d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986272.900173:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986272.900175:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986272.900177:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986272.900439:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993492608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22440us (22570us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788986272.900447:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000004:00080000:1.0:1788986272.902573:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a761c2d80/2, rc 0, transno 4294967341 00000100:00100000:1.0:1788986272.902586:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993492608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788986272.947305:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986272.947406:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971268864 00000100:00100000:2.0:1788986272.947415:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971268864 00000100:00100000:2.0:1788986272.947471:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 709 00000100:00100000:2.0:1788986272.947481:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46181:x1875885971268864:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986272.947503:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986272.947520:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5485d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10ba expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947570:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5485df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947583:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5485df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947594:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5485df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947607:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5485e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947613:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5485e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947620:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5485e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947866:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5485ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947890:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5485ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947897:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5485ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986272.947916:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:2.0:1788986272.947919:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986272.947935:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5485ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947946:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5485df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947952:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5485df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947971:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5485df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947976:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986272.947980:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5485df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947988:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5485df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.947998:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:2.0:1788986272.948001:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986272.948006:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5485df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.948015:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5485df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.948027:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5485e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.948033:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5485e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.948039:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5485e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.948044:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986272.948046:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5485e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.948051:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5485e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.948058:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a45aca400) 00010000:00010000:2.0:1788986272.948060:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986272.948063:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5485e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.948068:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf5485e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.948149:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5485d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10ba expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.948162:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5485ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10ba expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986272.948170:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986272.948172:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986272.948175:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1800, rc 0) 00000100:00100000:2.0:1788986272.948219:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46181:x1875885971268864:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 740us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986272.948225:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 709 00010000:00010000:0.0:1788986273.728262:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986273.795260:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993493120:0@lo:400:kworker.0 00000100:00100000:0.0:1788986273.795317:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986273.795371:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986273.795377:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993493248:0@lo:400:kworker.0 00000100:00100000:0.0:1788986273.795398:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986273.795433:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993493120 00000100:00100000:0.0:1788986273.795439:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993493120 00000100:00100000:0.0:1788986273.795487:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1440 00000100:00100000:0.0:1788986273.795494:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993493120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986273.795534:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993493120:12345-0@lo:400:kworker.0 Request processed in 41us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986273.795541:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1440 00000100:00100000:0.0:1788986273.795563:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993493248 00000100:00100000:0.0:1788986273.795565:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993493248 00000100:00100000:0.0:1788986273.795584:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1788986273.795589:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993493248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986273.795612:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993493248:12345-0@lo:400:kworker.0 Request processed in 23us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986273.795617:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00080000:0.0:1788986273.795629:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986273.795656:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993493248:0@lo:400:kworker.0 00000100:00100000:0.0:1788986273.795676:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993493120:0@lo:400:kworker.0 00000100:00100000:1.0:1788986273.796017:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993492864:0@lo:400:kworker.0 00000100:00100000:1.0:1788986273.796048:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986273.796076:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993493376:0@lo:400:kworker.0 00000100:00100000:1.0:1788986273.796119:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986273.796134:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788986273.796140:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993492992:0@lo:400:kworker.0 00000100:00100000:1.0:1788986273.796156:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986273.796170:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993493504:0@lo:400:kworker.0 00000100:00100000:1.0:1788986273.796185:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986273.796205:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993493376 00000100:00100000:1.0:1788986273.796208:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993493376 00000100:00100000:1.0:1788986273.796231:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993492992 00000100:00100000:1.0:1788986273.796233:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993492992 00000100:00100000:1.0:1788986273.796245:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1788986273.796250:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993493376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986273.796279:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993493376:12345-0@lo:400:kworker.0 Request processed in 28us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986273.796284:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1788986273.796294:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1788986273.796299:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993492992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986273.796318:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993492992:12345-0@lo:400:kworker.0 Request processed in 19us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986273.796323:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1788986273.796347:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993493504 00000100:00100000:1.0:1788986273.796350:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993493504 00000100:00100000:1.0:1788986273.796368:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1788986273.796373:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993493504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986273.796396:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993493504:12345-0@lo:400:kworker.0 Request processed in 24us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986273.796489:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1788986273.796519:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993492992:0@lo:400:kworker.0 00000100:00100000:1.0:1788986273.796527:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993493504:0@lo:400:kworker.0 00000100:00100000:1.0:1788986273.796534:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993493376:0@lo:400:kworker.0 00000100:00100000:0.0:1788986273.796735:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993492864 00000100:00100000:0.0:1788986273.796803:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993492864 00000100:00100000:0.0:1788986273.796834:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1175 00000100:00100000:0.0:1788986273.796840:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993492864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986273.796888:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993492864:12345-0@lo:400:kworker.0 Request processed in 48us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986273.796894:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1175 00000100:00080000:0.0:1788986273.796919:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986273.796983:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993492864:0@lo:400:kworker.0 00000100:00100000:3.0:1788986274.025974:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986274.026040:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971268992 00000100:00100000:1.0:1788986274.026050:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971268992 00000100:00100000:1.0:1788986274.026134:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 710 00000100:00100000:1.0:1788986274.026144:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46195:x1875885971268992:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986274.026162:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986274.026180:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5485f4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10c1 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.026235:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5485fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.026248:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5485fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.026260:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5485fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986274.026290:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:1.0:1788986274.026294:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986274.026311:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5485fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.026333:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5485f4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10c1 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.026364:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5485fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10c1 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.026373:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:1.0:1788986274.026377:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986274.026380:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00100000:1.0:1788986274.026430:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46195:x1875885971268992:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 287us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986274.026436:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 710 00000100:00080000:2.0:1788986274.026983:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986274.030039:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986274.030130:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971269248 00000100:00100000:2.0:1788986274.030138:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971269248 00000100:00100000:2.0:1788986274.030185:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 711 00000100:00100000:2.0:1788986274.030194:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46195:x1875885971269248:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986274.030236:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986274.030260:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5485fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10c1 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986274.030281:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf5485ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10ba expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986274.030291:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986274.030300:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986274.030322:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548602 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986274.030333:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986274.030353:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986274.030650:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f4f7c0f1 reply state 00000000461da541 transno 4294967564 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986274.030659:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986274.030667:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000100:00100000:2.0:1788986274.030738:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46195:x1875885971269248:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 544us (706us total) trans 4294967564 rc 0/0 00000100:00100000:2.0:1788986274.030757:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 711 00010000:00010000:3.0:1788986274.038679:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548602 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986274.038697:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548602 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986274.038705:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548602 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986274.038711:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986274.038715:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548602 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986274.038722:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548602 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986274.038747:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:3.0:1788986274.038752:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986274.038757:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548602 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986274.038764:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548602 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986274.250520:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986274.254236:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971269376 00000100:00100000:0.0:1788986274.254251:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971269376 00000100:00100000:0.0:1788986274.254309:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 712 00000100:00100000:0.0:1788986274.254319:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46207:x1875885971269376:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986274.254761:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46207:x1875885971269376:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 442us (4250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986274.254781:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 712 00000100:00100000:2.0:1788986274.269388:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986274.269488:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971269504 00000100:00100000:0.0:1788986274.269498:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971269504 00000100:00100000:0.0:1788986274.269598:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 386 00000100:00100000:0.0:1788986274.269610:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46207:x1875885971269504:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986274.270028:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46207:x1875885971269504:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 420us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986274.270035:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 386 00000100:00080000:2.0:1788986274.270106:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986274.275396:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986274.275486:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971269632 00000100:00100000:2.0:1788986274.275495:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971269632 00000100:00100000:2.0:1788986274.275565:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 387 00000100:00100000:2.0:1788986274.275575:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46207:x1875885971269632:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986274.275941:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46207:x1875885971269632:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 367us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986274.275949:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 387 00000100:00080000:0.0:1788986274.276830:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986274.278355:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986274.278848:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971269760 00000100:00100000:1.0:1788986274.278858:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971269760 00000100:00100000:1.0:1788986274.278923:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 713 00000100:00100000:1.0:1788986274.278932:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46207:x1875885971269760:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986274.280047:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46207:x1875885971269760:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 1112us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986274.280057:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 713 00000100:00100000:3.0:1788986274.290465:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986274.290657:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971269888 00000100:00100000:0.0:1788986274.290666:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971269888 00000100:00100000:0.0:1788986274.290729:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 714 00000100:00100000:0.0:1788986274.290739:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46207:x1875885971269888:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986274.290832:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46207:x1875885971269888:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 94us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986274.290839:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 714 00000100:00100000:3.0:1788986274.292848:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986274.292937:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971270016 00000100:00100000:0.0:1788986274.292944:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971270016 00000100:00100000:0.0:1788986274.292992:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 388 00000100:00100000:0.0:1788986274.293002:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46207:x1875885971270016:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986274.293383:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46207:x1875885971270016:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 380us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986274.293391:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 388 00000100:00100000:3.0:1788986274.296013:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986274.296121:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971270144 00000100:00100000:2.0:1788986274.296129:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971270144 00000100:00100000:2.0:1788986274.296181:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 389 00000100:00100000:2.0:1788986274.296191:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46207:x1875885971270144:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986274.296738:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46207:x1875885971270144:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 547us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986274.296747:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 389 00000100:00100000:3.0:1788986274.313660:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986274.313854:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986274.313882:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993493632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986274.313932:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986274.314731:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993493632 00000100:00100000:2.0:1788986274.314750:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993493632 00000100:00100000:2.0:1788986274.314814:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1788986274.314823:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993493632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986274.314855:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986274.314928:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993493632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986274.314936:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 731 00000100:00100000:2.0:1788986274.314983:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993493632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986274.316831:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971270272 00000100:00100000:1.0:1788986274.316843:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971270272 00000100:00100000:1.0:1788986274.316917:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 715 00000100:00100000:1.0:1788986274.316928:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46207:x1875885971270272:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986274.317507:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46207:x1875885971270272:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 578us (3854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986274.317515:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 715 00000100:00080000:0.0:1788986274.317529:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986274.398652:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986274.406363:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971270400 00000100:00100000:1.0:1788986274.406384:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971270400 00000100:00100000:1.0:1788986274.406445:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 716 00000100:00100000:1.0:1788986274.406456:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46211:x1875885971270400:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:1.0:1788986274.406477:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986274.406498:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548609 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10c8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.406557:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548610 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.406571:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548610 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.406583:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548610 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.406595:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548617 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.406601:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.406606:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.406924:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54861e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.406932:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54861e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.406939:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54861e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986274.406957:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:1.0:1788986274.406960:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986274.406979:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54861e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.406989:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548610 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.406996:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548610 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407002:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548610 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407008:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986274.407013:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548610 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407020:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548610 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407030:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:1.0:1788986274.407033:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986274.407037:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548610 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407042:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548610 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407057:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548617 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407062:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548617 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407067:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548617 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407073:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986274.407075:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548617 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407081:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548617 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407138:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a45316000) 00010000:00010000:1.0:1788986274.407141:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986274.407144:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548617 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407150:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548617 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407178:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548609 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10c8 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407189:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54861e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10c8 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.407199:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45316200) 00010000:00010000:1.0:1788986274.407201:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986274.407203:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788986274.407260:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46211:x1875885971270400:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 806us (8616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986274.407267:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 716 00000100:00100000:3.0:1788986274.412704:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986274.412819:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971270656 00000100:00100000:1.0:1788986274.412827:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971270656 00000100:00100000:1.0:1788986274.412887:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 717 00000100:00100000:1.0:1788986274.412895:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46211:x1875885971270656:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:1.0:1788986274.412912:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986274.412932:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548625 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10cf expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.413192:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54862c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.413207:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54862c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.413216:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54862c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.413229:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548633 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.413236:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.413242:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788986274.413834:0:15241:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x17:0x0], index 0: 0 00010000:00010000:1.0:1788986274.414047:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54863a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.414057:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54863a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.414064:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54863a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.414128:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54862c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.414135:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54862c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.414141:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54862c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.414147:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986274.414151:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54862c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.414158:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54862c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.414169:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45316200) 00010000:00010000:1.0:1788986274.414172:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986274.414176:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54862c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.414182:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54862c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986274.414195:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b7c7c417 reply state 0000000011c17df5 transno 4294967565 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986274.414203:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986274.414230:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548625 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10cf expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.414245:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54863a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10cf expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.414252:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9b0a45316700) 00010000:00010000:1.0:1788986274.414254:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986274.414256:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986274.414328:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46211:x1875885971270656:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 1434us (1633us total) trans 4294967565 rc 0/0 00000100:00100000:1.0:1788986274.414336:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 717 00010000:00010000:1.0:1788986274.417727:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548633 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.417745:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548633 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.417753:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548633 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.417765:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986274.417770:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548633 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.417778:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548633 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.417794:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a45316100) 00010000:00010000:1.0:1788986274.417797:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986274.417801:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548633 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986274.417808:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548633 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986274.423841:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986274.423941:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971270784 00000100:00100000:0.0:1788986274.423950:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971270784 00000100:00100000:0.0:1788986274.424003:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 390 00000100:00100000:0.0:1788986274.424013:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46211:x1875885971270784:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:0.0:1788986274.424032:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986274.424052:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082e40c83/0xc20d828fcf548648 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10d6 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986274.424076:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788986274.424132:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=2058s v=(0 0) 00010000:00010000:0.0:1788986274.424137:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986274.424147:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082e40c83/0xc20d828fcf548648 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10d6 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986274.424164:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000082e40c83/0xc20d828fcf548648 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10d6 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986274.424176:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788986274.424230:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46211:x1875885971270784:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 218us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986274.424236:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 390 00000100:00100000:2.0:1788986274.453383:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986274.453507:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971270912 00000100:00100000:3.0:1788986274.453516:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971270912 00002000:00100000:3.0:1788986274.453567:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x17:0x0] (0->1048575) req@ffff9b0a761c1880 x1875885971270912/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:195/0 lens 488/0 e 0 to 0 dl 1788986285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1788986274.453579:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a761c1880 with x1875885971270912 ext(0->1048575) 00002000:00010000:3.0:1788986274.453584:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0a761c1880 00000100:00100000:3.0:1788986274.453616:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:3.0:1788986274.453625:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971270912:12345-192.168.206.21@tcp:4:dd.60003 00000100:00100000:0.0:1788986274.480214:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971270912:12345-192.168.206.21@tcp:4:dd.60003 Request processed in 26580us (26830us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1788986274.480230:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00002000:00100000:0.0:1788986274.480242:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x17:0x0] (0->1048575) req@ffff9b0a761c1880 x1875885971270912/t4294967342(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:195/0 lens 488/448 e 0 to 0 dl 1788986285 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1788986274.480252:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a761c1880 with x1875885971270912 ext(0->1048575) 00002000:00010000:0.0:1788986274.480258:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0a761c1880 00000100:00100000:2.0:1788986274.483453:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986274.483555:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971271040 00000100:00100000:0.0:1788986274.483564:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971271040 00000100:00100000:0.0:1788986274.483662:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 718 00000100:00100000:0.0:1788986274.483673:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46211:x1875885971271040:12345-192.168.206.21@tcp:44:dd.60003 00000100:00100000:1.0:1788986274.511591:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46211:x1875885971271040:12345-192.168.206.21@tcp:44:dd.60003 Request processed in 27910us (28137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986274.511605:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 718 00000001:00080000:3.0:1788986274.511685:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967565 is committed 00000100:00100000:3.0:1788986274.514212:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986274.514308:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971271168 00000100:00100000:1.0:1788986274.514317:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971271168 00000100:00100000:1.0:1788986274.514385:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 391 00000100:00100000:1.0:1788986274.514394:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971271168:12345-192.168.206.21@tcp:16:dd.60003 00000100:00100000:3.0:1788986274.551455:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971271168:12345-192.168.206.21@tcp:16:dd.60003 Request processed in 37053us (37243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986274.551467:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 391 00000001:00080000:0.0:1788986274.552692:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967342 is committed 00000100:00100000:0.0:1788986274.554212:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986274.554503:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971271424 00000100:00100000:1.0:1788986274.554513:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971271424 00000100:00100000:1.0:1788986274.554568:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 72 00000100:00100000:1.0:1788986274.554579:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46211:x1875885971271424:12345-192.168.206.21@tcp:35:dd.60003 00000100:00100000:1.0:1788986274.555022:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46211:x1875885971271424:12345-192.168.206.21@tcp:35:dd.60003 Request processed in 443us (814us total) trans 4294967566 rc 0/0 00000100:00100000:1.0:1788986274.555031:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 72 00010000:00010000:3.0:1788986274.752256:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986275.778423:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986275.891713:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967566 is committed 00000100:00100000:2.0:1788986275.958179:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986275.958224:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986275.958250:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986275.958274:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986275.958307:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971271680 00000100:00100000:2.0:1788986275.958315:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971271680 00000100:00100000:2.0:1788986275.958373:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1443 00000100:00100000:2.0:1788986275.958384:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971271680:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986275.958457:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971271680:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 75us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986275.958464:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1443 00000100:00100000:0.0:1788986275.958805:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971271808 00000100:00100000:0.0:1788986275.958811:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971271808 00000100:00100000:0.0:1788986275.958840:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971271936 00000100:00100000:0.0:1788986275.958843:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971271936 00000100:00100000:0.0:1788986275.958870:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1035 00000100:00100000:0.0:1788986275.958878:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971271808:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986275.958914:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971271808:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986275.958920:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1035 00000100:00100000:0.0:1788986275.958946:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1036 00000100:00100000:0.0:1788986275.958953:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971271936:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986275.958978:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971271936:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986275.958984:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1036 00000100:00100000:3.0:1788986275.959352:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971271552 00000100:00100000:3.0:1788986275.959356:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971271552 00000100:00100000:3.0:1788986275.959394:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1176 00000100:00100000:3.0:1788986275.959400:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971271552:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986275.959432:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971271552:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986275.959438:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1176 00010000:00010000:3.0:1788986276.800280:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986276.910622:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967341 is committed 00000004:00080000:3.0:1788986277.436978:0:79529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2061339885637ns, next at 2036292428059ns, rc = 0 00000004:00080000:3.0:1788986277.437171:0:79529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2061340080983ns, next at 2056440845351ns, rc = 0 00000004:00080000:0.0:1788986277.442452:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 60 committed 00000004:00080000:0.0:1788986277.442473:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 59 committed 00010000:00010000:0.0:1788986277.824491:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986277.888670:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986277.888692:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993493760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986277.888756:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986277.888880:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993493760 00000100:00100000:2.0:1788986277.888889:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993493760 00000100:00100000:2.0:1788986277.888948:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1788986277.888957:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993493760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986277.888988:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788986277.889041:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993493760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986277.889048:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 732 00000100:00100000:2.0:1788986277.889109:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993493760:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986277.889501:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986278.849196:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986278.915679:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993493888:0@lo:400:kworker.0 00000100:00100000:3.0:1788986278.915713:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993494016:0@lo:400:kworker.0 00000100:00100000:0.0:1788986278.915754:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986278.915760:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986278.915809:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993494400:0@lo:400:kworker.0 00000100:00100000:0.0:1788986278.915839:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986278.915881:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993494272:0@lo:400:kworker.0 00000100:00100000:0.0:1788986278.915908:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986278.915938:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986278.915944:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993494144:0@lo:400:kworker.0 00000100:00100000:0.0:1788986278.915966:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986278.915993:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993493888 00000100:00100000:0.0:1788986278.916000:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993493888 00000100:00100000:0.0:1788986278.916039:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1788986278.916055:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993493888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986278.916236:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993493888:12345-0@lo:400:kworker.0 Request processed in 182us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986278.916244:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:0.0:1788986278.916277:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993494016 00000100:00100000:0.0:1788986278.916282:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993494016 00000100:00100000:0.0:1788986278.916305:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993494400 00000100:00100000:0.0:1788986278.916308:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993494400 00000100:00100000:0.0:1788986278.916332:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993494144 00000100:00100000:0.0:1788986278.916335:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993494144 00000100:00100000:0.0:1788986278.916350:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:0.0:1788986278.916356:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993494016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986278.916388:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993494016:12345-0@lo:400:kworker.0 Request processed in 32us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986278.916395:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:0.0:1788986278.916407:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1788986278.916413:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993494400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986278.916439:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993494400:12345-0@lo:400:kworker.0 Request processed in 27us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986278.916445:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1788986278.916456:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1788986278.916461:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993494144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986278.916490:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993494144:12345-0@lo:400:kworker.0 Request processed in 29us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986278.916495:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00080000:0.0:1788986278.916520:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986278.916548:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993494144:0@lo:400:kworker.0 00000100:00100000:0.0:1788986278.916570:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80716300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993494400:0@lo:400:kworker.0 00000100:00100000:0.0:1788986278.916578:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993493888:0@lo:400:kworker.0 00000100:00100000:1.0:1788986278.916686:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993494272 00000100:00100000:1.0:1788986278.916691:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993494272 00000100:00100000:1.0:1788986278.916734:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1788986278.916741:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993494272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986278.916780:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993494272:12345-0@lo:400:kworker.0 Request processed in 40us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986278.916787:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1788986278.916813:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993494272:0@lo:400:kworker.0 00000100:00100000:3.0:1788986278.921397:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993494016:0@lo:400:kworker.0 00000100:00100000:3.0:1788986278.921414:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993494528:0@lo:400:kworker.0 00000100:00100000:3.0:1788986278.921563:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986278.921791:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993494528 00000100:00100000:1.0:1788986278.921799:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993494528 00000100:00100000:1.0:1788986278.921904:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1788986278.921913:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993494528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986278.921969:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993494528:12345-0@lo:400:kworker.0 Request processed in 58us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986278.921976:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1788986278.922005:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967341 gen 2 00000004:00080000:1.0:1788986278.922011:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a761c2d80, transno 4294967341 00000100:00100000:1.0:1788986278.922023:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993494528:0@lo:400:kworker.0 00000100:00080000:2.0:1788986278.922646:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986279.186349:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986279.186604:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971272064 00000100:00100000:0.0:1788986279.186614:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971272064 00000100:00080000:2.0:1788986279.186738:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986279.187910:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 719 00000100:00100000:0.0:1788986279.187927:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46404:x1875885971272064:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986279.188018:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46404:x1875885971272064:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 98us (1679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986279.188026:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 719 00000100:00100000:3.0:1788986279.191275:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986279.191414:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971272192 00000100:00100000:2.0:1788986279.191424:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971272192 00000100:00100000:2.0:1788986279.191491:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 392 00000100:00100000:2.0:1788986279.191501:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46404:x1875885971272192:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986279.191902:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46404:x1875885971272192:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 402us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986279.191910:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 392 00000100:00080000:3.0:1788986279.193084:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986279.194430:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986279.194910:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971272320 00000100:00100000:1.0:1788986279.194920:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971272320 00000100:00100000:1.0:1788986279.194995:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 393 00000100:00100000:1.0:1788986279.195006:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46404:x1875885971272320:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986279.195713:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46404:x1875885971272320:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 706us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986279.195723:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 393 00000100:00080000:3.0:1788986279.195856:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986279.198934:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986279.202973:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971272448 00000100:00100000:0.0:1788986279.202987:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971272448 00000100:00100000:0.0:1788986279.203198:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 720 00000100:00100000:0.0:1788986279.203210:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46404:x1875885971272448:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986279.204761:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46404:x1875885971272448:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 1546us (5828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986279.204775:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 720 00000100:00100000:2.0:1788986279.208465:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986279.208568:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971272576 00000100:00100000:0.0:1788986279.208582:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971272576 00000100:00100000:0.0:1788986279.208704:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 721 00000100:00100000:0.0:1788986279.208715:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46404:x1875885971272576:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986279.208830:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46404:x1875885971272576:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 117us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986279.208849:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 721 00000100:00100000:2.0:1788986279.220982:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986279.222907:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971272704 00000100:00100000:1.0:1788986279.222921:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971272704 00000100:00100000:1.0:1788986279.223001:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 394 00000100:00100000:1.0:1788986279.223014:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46404:x1875885971272704:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986279.223435:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46404:x1875885971272704:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 423us (2468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986279.223443:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 394 00000100:00100000:2.0:1788986279.227599:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986279.227901:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971272832 00000100:00100000:0.0:1788986279.227917:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971272832 00000100:00100000:0.0:1788986279.227989:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 395 00000100:00100000:0.0:1788986279.228000:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46404:x1875885971272832:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986279.233630:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46404:x1875885971272832:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 5619us (6032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986279.233645:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 395 00000100:00100000:3.0:1788986279.236939:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986279.237145:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971272960 00000100:00100000:0.0:1788986279.237160:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971272960 00000100:00100000:0.0:1788986279.237232:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 722 00000100:00100000:0.0:1788986279.237244:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46404:x1875885971272960:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986279.238908:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46404:x1875885971272960:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 1655us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986279.238923:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 722 00000100:00100000:0.0:1788986279.346549:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986279.346784:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971273216 00000100:00100000:2.0:1788986279.346796:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971273216 00000100:00100000:2.0:1788986279.346896:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 723 00000100:00100000:2.0:1788986279.346908:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46408:x1875885971273216:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:2.0:1788986279.346974:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986279.347020:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54863a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10cf expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.347047:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9b0a45316700) 00010000:00010000:2.0:1788986279.347059:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986279.347144:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54864f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.347162:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54864f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.347174:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54864f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.347191:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548656 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.347199:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.347206:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.347632:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54865d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.347642:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54865d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.347653:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54865d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986279.348561:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].23, 64 off9664 00000004:00080000:2.0:1788986279.348575:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2063251484711ns, next at 2064251481809ns, rc = 0 00010000:00010000:2.0:1788986279.348684:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548664 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348699:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548664 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348709:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548664 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348717:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548664 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348724:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548664 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348730:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548664 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348764:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986279.348792:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54865d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348798:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54865d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348804:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54865d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348811:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986279.348817:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54865d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348825:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54865d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348837:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986279.348851:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986279.348857:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54865d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348864:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54865d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348885:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54864f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348892:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54864f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348899:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54864f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348905:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986279.348908:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54864f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348914:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54864f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348926:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45316200) 00010000:00010000:2.0:1788986279.348929:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986279.348932:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54864f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986279.348939:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54864f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x36:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986279.348948:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ff84d0da reply state 000000009c3a6a50 transno 4294967567 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986279.348958:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986279.349084:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46408:x1875885971273216:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 2172us (2544us total) trans 4294967567 rc 0/0 00000100:00100000:2.0:1788986279.349129:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 723 00010000:00010000:0.0:1788986279.349836:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986279.349856:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548664 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986279.349865:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986279.349869:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548664 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986279.349878:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548664 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986279.349893:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3b:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:0.0:1788986279.349896:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788986279.349900:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548664 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986279.349905:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548664 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986279.349929:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986279.349931:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986279.349933:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986279.357558:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548656 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986279.357585:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548656 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986279.357593:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986279.357600:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986279.357606:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548656 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986279.357615:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548656 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986279.357637:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0xf9c7deb2 (ffff9b0a45acaf00) 00010000:00010000:3.0:1788986279.357641:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986279.357646:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548656 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986279.357653:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548656 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x36:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986279.428614:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986279.428654:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993494656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986279.429039:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986279.429400:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993494656 00000100:00100000:0.0:1788986279.429479:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993494656 00000100:00100000:0.0:1788986279.429593:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 733 00000100:00100000:0.0:1788986279.429604:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993494656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986279.429652:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986279.429994:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993494656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 390us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986279.430003:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 733 00000100:00100000:1.0:1788986279.430134:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993494656:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986279.872601:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986280.897412:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986281.075660:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986281.075714:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986281.075750:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986281.075781:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986281.075959:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971273344 00000100:00100000:3.0:1788986281.075973:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971273344 00000100:00100000:3.0:1788986281.076032:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1178 00000100:00100000:3.0:1788986281.076042:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971273344:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986281.076152:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971273344:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 112us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986281.076161:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1178 00000100:00100000:2.0:1788986281.076885:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971273472 00000100:00100000:2.0:1788986281.076893:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971273472 00000100:00100000:2.0:1788986281.076960:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1447 00000100:00100000:2.0:1788986281.076969:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971273472:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986281.077021:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971273472:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 53us (1373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986281.077027:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1447 00000100:00100000:2.0:1788986281.077052:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971273728 00000100:00100000:2.0:1788986281.077055:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971273728 00000100:00100000:2.0:1788986281.077081:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971273600 00000100:00100000:2.0:1788986281.077084:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971273600 00000100:00080000:3.0:1788986281.077235:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986281.077248:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986281.077419:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1039 00000100:00100000:2.0:1788986281.077427:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971273728:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986281.077460:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971273728:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (1745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986281.077467:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1039 00000100:00100000:2.0:1788986281.077481:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1040 00000100:00100000:2.0:1788986281.077487:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971273600:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986281.077512:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971273600:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (1731us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986281.077519:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1040 00000100:00080000:3.0:1788986281.084600:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788986281.798908:0:79675:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2065701814533ns, next at 2064251481809ns, rc = 0 00000004:00080000:1.0:1788986281.893179:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 61 committed 00000001:00080000:1.0:1788986281.893219:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967567 is committed 00000004:00080000:1.0:1788986281.893225:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 60 committed 00000100:00100000:1.0:1788986281.893911:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993494784:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788986281.893982:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986281.894061:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993494784 00000100:00100000:1.0:1788986281.894069:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993494784 00000100:00100000:1.0:1788986281.894158:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788986281.894167:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993494784:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788986281.894196:0:8478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:23 count 1 00010000:00010000:1.0:1788986281.894224:0:8478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986281.894245:0:8478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000082e40c83/0xc20d828fcf548648 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10d6 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986281.894261:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x17:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1788986281.894265:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986281.894272:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986281.894308:0:8478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000082e40c83/0xc20d828fcf548648 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10d6 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986281.894323:0:8478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000082e40c83/0xc20d828fcf548648 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10d6 expref: 5 pid: 6695 timeout: 2165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986281.894334:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8478:1875885993494912:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986281.894393:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a412ed300 going to sleep for 11 seconds 00000100:00080000:1.0:1788986281.894407:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986281.896290:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8478:1875885993494912:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788986281.896315:0:8478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986281.896464:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986281.896869:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971273856 00000100:00100000:1.0:1788986281.896876:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971273856 00010000:00010000:1.0:1788986281.896907:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000082e40c83/0xc20d828fcf548648 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10d6 expref: 6 pid: 6695 timeout: 2165 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986281.896938:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 372 00000100:00100000:1.0:1788986281.896946:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971273856:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986281.896959:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986281.896965:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000082e40c83/0xc20d828fcf548648 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10d6 expref: 6 pid: 6695 timeout: 2165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986281.896978:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000082e40c83/0xc20d828fcf548648 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10d6 expref: 6 pid: 6695 timeout: 2165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986281.897000:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082e40c83/0xc20d828fcf548648 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10d6 expref: 6 pid: 6695 timeout: 2165 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986281.897016:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986281.897020:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986281.897026:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986281.897037:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986281.897067:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986281.897154:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971273856:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 208us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986281.897162:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 372 00010000:00010000:2.0:1788986281.897494:0:8478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986281.897504:0:8478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986281.897515:0:8478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986281.897523:0:8478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986281.897541:0:8478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788986281.898115:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993494784:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3925us (4108us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1788986281.898124:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00010000:00010000:2.0:1788986281.898149:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986281.898155:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986281.898164:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986281.898168:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986281.898177:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986281.898192:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986281.898199:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54866b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986281.898220:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986281.898222:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986281.898223:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788986281.898315:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a80ccaa00/2, rc 0, transno 4294967343 00000100:00100000:1.0:1788986281.898333:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993494784:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788986281.898671:0:79675:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2065801579755ns, next at 2056440845351ns, rc = 0 00000004:00080000:1.0:1788986281.909321:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 61 committed 00010000:00010000:2.0:1788986281.924421:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986282.947116:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986283.010842:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993495040:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986283.010919:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986283.011281:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993495040 00000100:00100000:2.0:1788986283.011299:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993495040 00000100:00100000:2.0:1788986283.011351:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1788986283.011360:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993495040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986283.011391:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788986283.011446:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993495040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986283.011452:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 734 00000100:00100000:2.0:1788986283.011496:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993495040:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986283.011647:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986283.968311:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986284.032898:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993495552:0@lo:400:kworker.0 00000100:00100000:3.0:1788986284.032962:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986284.033034:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788986284.033041:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993495168:0@lo:400:kworker.0 00000100:00100000:3.0:1788986284.033068:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986284.033106:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993495680:0@lo:400:kworker.0 00000100:00100000:3.0:1788986284.033131:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986284.033256:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993495552 00000100:00100000:2.0:1788986284.033264:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993495552 00000100:00100000:1.0:1788986284.033396:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993495424:0@lo:400:kworker.0 00000100:00100000:1.0:1788986284.033427:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986284.033450:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788986284.033456:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993495296:0@lo:400:kworker.0 00000100:00100000:1.0:1788986284.033477:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986284.033494:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993495808:0@lo:400:kworker.0 00000100:00100000:1.0:1788986284.033513:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986284.033629:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993495168 00000100:00100000:0.0:1788986284.033634:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993495168 00000100:00100000:0.0:1788986284.033692:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1788986284.033700:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993495168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986284.033747:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993495168:12345-0@lo:400:kworker.0 Request processed in 47us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986284.033754:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1179 00000100:00100000:0.0:1788986284.033783:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993495680 00000100:00100000:0.0:1788986284.033786:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993495680 00000100:00100000:0.0:1788986284.033827:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993495424 00000100:00100000:0.0:1788986284.033830:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993495424 00000100:00100000:0.0:1788986284.033847:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993495296 00000100:00100000:0.0:1788986284.033850:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993495296 00000100:00100000:0.0:1788986284.033862:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1448 00000100:00100000:0.0:1788986284.033868:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993495680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986284.033898:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993495680:12345-0@lo:400:kworker.0 Request processed in 30us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986284.033904:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1448 00000100:00100000:0.0:1788986284.033916:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:0.0:1788986284.033921:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993495424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986284.033944:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993495424:12345-0@lo:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986284.033950:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:0.0:1788986284.033962:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:0.0:1788986284.033968:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993495296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986284.033992:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993495296:12345-0@lo:400:kworker.0 Request processed in 24us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986284.033998:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00080000:0.0:1788986284.034034:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986284.034550:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993495168:0@lo:400:kworker.0 00000100:00100000:0.0:1788986284.034565:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993495680:0@lo:400:kworker.0 00000100:00100000:0.0:1788986284.040438:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993495424:0@lo:400:kworker.0 00000100:00100000:2.0:1788986284.040559:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993495808 00000100:00100000:2.0:1788986284.040567:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993495808 00000100:00100000:2.0:1788986284.040711:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1788986284.040720:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993495552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986284.040824:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993495552:12345-0@lo:400:kworker.0 Request processed in 95us (7852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986284.040831:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:2.0:1788986284.040850:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1788986284.040856:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993495808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986284.040887:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993495808:12345-0@lo:400:kworker.0 Request processed in 31us (7372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986284.040892:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00080000:2.0:1788986284.040910:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986284.040934:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993495552:0@lo:400:kworker.0 00000100:00100000:0.0:1788986284.041346:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993495296:0@lo:400:kworker.0 00000100:00100000:0.0:1788986284.041617:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993495808:0@lo:400:kworker.0 00000001:00080000:2.0:1788986284.163457:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967343 is committed 00000100:00100000:2.0:1788986284.548666:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986284.548697:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993495936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986284.548760:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986284.548836:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993495936 00000100:00100000:2.0:1788986284.548844:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993495936 00000100:00100000:2.0:1788986284.548888:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 735 00000100:00100000:2.0:1788986284.548896:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993495936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986284.548933:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986284.548981:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993495936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986284.548988:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 735 00000100:00100000:2.0:1788986284.549031:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993495936:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986284.992302:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986286.019276:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986286.194006:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986286.194049:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986286.194128:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986286.194165:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986286.194191:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971274240 00000100:00100000:2.0:1788986286.194200:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971274240 00000100:00100000:2.0:1788986286.194250:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971274368 00000100:00100000:2.0:1788986286.194254:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971274368 00000100:00100000:1.0:1788986286.194274:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1043 00000100:00100000:1.0:1788986286.194288:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971274240:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986286.194295:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1044 00000100:00100000:2.0:1788986286.194306:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971274368:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986286.194362:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971274240:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986286.194371:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1043 00000100:00100000:3.0:1788986286.194382:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971274112 00000100:00100000:3.0:1788986286.194388:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971274112 00000100:00100000:3.0:1788986286.194428:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1451 00000100:00100000:3.0:1788986286.194437:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971274112:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986286.194504:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971273984 00000100:00100000:0.0:1788986286.194509:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971273984 00000100:00100000:0.0:1788986286.194538:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1180 00000100:00100000:0.0:1788986286.194544:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971273984:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986286.194598:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971274368:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 293us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986286.194607:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1044 00000100:00080000:2.0:1788986286.194631:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986286.194636:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986286.194638:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986286.199980:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971274112:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5533us (5839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986286.199994:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1451 00000100:00100000:0.0:1788986286.207870:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971273984:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 13314us (13862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986286.207885:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1180 00010000:00010000:2.0:1788986287.043020:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986288.064578:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986288.128421:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993496064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986288.128497:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986288.128654:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993496064 00000100:00100000:3.0:1788986288.128662:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993496064 00000100:00100000:3.0:1788986288.128726:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 736 00000100:00100000:3.0:1788986288.128736:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993496064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986288.128769:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788986288.128849:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986288.130207:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993496064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1468us (1705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986288.130219:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 736 00000100:00100000:0.0:1788986288.133298:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967343 gen 2 00000004:00080000:0.0:1788986288.133310:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a80ccaa00, transno 4294967343 00000100:00100000:0.0:1788986288.133410:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993496064:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986289.095466:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986289.160018:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986289.160048:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993496320:0@lo:400:kworker.0 00000100:00100000:3.0:1788986289.160150:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986289.160221:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993496320 00000100:00100000:3.0:1788986289.160230:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993496320 00000100:00100000:3.0:1788986289.160296:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1788986289.160306:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094381b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993496320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986289.160365:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094381b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993496320:12345-0@lo:400:kworker.0 Request processed in 61us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986289.160372:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1452 00000100:00100000:3.0:1788986289.160423:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993496320:0@lo:400:kworker.0 00000100:00100000:3.0:1788986289.160461:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993496448:0@lo:400:kworker.0 00000100:00100000:3.0:1788986289.160490:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986289.160519:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993496448 00000100:00100000:3.0:1788986289.160523:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993496448 00000100:00100000:3.0:1788986289.160560:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1788986289.160567:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993496448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986289.160601:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993496448:12345-0@lo:400:kworker.0 Request processed in 35us (110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986289.160607:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1788986289.160633:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993496448:0@lo:400:kworker.0 00000100:00100000:3.0:1788986289.160673:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986289.160679:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094381a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993496832:0@lo:400:kworker.0 00000100:00100000:3.0:1788986289.160708:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986289.160953:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993496576:0@lo:400:kworker.0 00000100:00100000:0.0:1788986289.160988:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986289.161018:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788986289.161024:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993496192:0@lo:400:kworker.0 00000100:00100000:0.0:1788986289.161055:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986289.161077:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993496704:0@lo:400:kworker.0 00000100:00100000:0.0:1788986289.161122:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986289.161149:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993496704 00000100:00100000:0.0:1788986289.161153:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993496704 00000100:00100000:0.0:1788986289.161186:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1788986289.161193:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993496704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986289.161231:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993496704:12345-0@lo:400:kworker.0 Request processed in 38us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986289.161237:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:0.0:1788986289.161274:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993496832 00000100:00100000:0.0:1788986289.161279:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993496832 00000100:00100000:0.0:1788986289.161308:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993496576 00000100:00100000:0.0:1788986289.161312:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993496576 00000100:00100000:0.0:1788986289.161334:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1788986289.161341:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993496832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986289.161377:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943818e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993496832:12345-0@lo:400:kworker.0 Request processed in 38us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986289.161383:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1788986289.161395:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1788986289.161400:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993496576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986289.161425:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993496576:12345-0@lo:400:kworker.0 Request processed in 25us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986289.161433:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1788986289.161451:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993496192 00000100:00100000:0.0:1788986289.161455:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993496192 00000100:00100000:0.0:1788986289.161481:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1788986289.161487:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993496192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986289.161515:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993496192:12345-0@lo:400:kworker.0 Request processed in 29us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986289.161521:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:0.0:1788986289.161566:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993496192:0@lo:400:kworker.0 00000100:00100000:0.0:1788986289.161578:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993496704:0@lo:400:kworker.0 00000100:00100000:0.0:1788986289.161587:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993496576:0@lo:400:kworker.0 00000100:00100000:0.0:1788986289.161620:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094381a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993496832:0@lo:400:kworker.0 00000100:00080000:1.0:1788986289.161895:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986289.161901:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986289.681427:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986289.681447:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993496960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986289.681531:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986289.682385:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993496960 00000100:00100000:2.0:1788986289.682395:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993496960 00000100:00100000:2.0:1788986289.682449:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 737 00000100:00100000:2.0:1788986289.682458:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993496960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986289.682488:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986289.682561:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993496960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986289.682568:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 737 00000100:00100000:3.0:1788986289.685141:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993496960:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986290.112311:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986291.138344:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986291.316244:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986291.316292:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986291.316340:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986291.316372:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986291.316409:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971274496 00000100:00100000:1.0:1788986291.316421:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971274496 00000100:00100000:3.0:1788986291.316560:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971274624 00000100:00100000:3.0:1788986291.316564:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971274624 00000100:00100000:3.0:1788986291.316648:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1455 00000100:00100000:3.0:1788986291.316661:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971274624:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986291.316771:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971274624:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 113us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986291.316790:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1455 00000100:00080000:3.0:1788986291.316844:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986291.316859:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971274880 00000100:00100000:3.0:1788986291.316863:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971274880 00000100:00100000:3.0:1788986291.316898:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971274752 00000100:00100000:3.0:1788986291.316901:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971274752 00000100:00100000:3.0:1788986291.316923:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1047 00000100:00100000:3.0:1788986291.316930:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971274880:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986291.316959:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971274880:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986291.316966:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1047 00000100:00100000:3.0:1788986291.316978:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1048 00000100:00100000:3.0:1788986291.316984:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971274752:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986291.317010:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971274752:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986291.317015:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1048 00000100:00080000:3.0:1788986291.317035:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986291.317039:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986291.317860:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1182 00000100:00100000:1.0:1788986291.317871:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971274496:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986291.317920:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971274496:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 51us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986291.317928:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1182 00010000:00010000:2.0:1788986292.160519:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986293.184311:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986293.249126:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993497088:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986293.249197:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986293.252447:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993497088 00000100:00100000:2.0:1788986293.252459:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993497088 00000100:00100000:2.0:1788986293.252542:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 738 00000100:00100000:2.0:1788986293.252552:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993497088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986293.252586:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986293.252679:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993497088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (3482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986293.252686:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 738 00000100:00100000:1.0:1788986293.252875:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993497088:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986293.252970:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986294.208283:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986294.272388:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993497216:0@lo:400:kworker.0 00000100:00100000:1.0:1788986294.272460:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986294.272687:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993497216 00000100:00100000:0.0:1788986294.272696:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993497216 00000100:00100000:0.0:1788986294.272742:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1183 00000100:00100000:0.0:1788986294.272751:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993497216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986294.274692:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993497600:0@lo:400:kworker.0 00000100:00100000:3.0:1788986294.274746:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986294.274823:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993497600 00000100:00100000:3.0:1788986294.274829:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993497600 00000100:00100000:3.0:1788986294.274870:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1788986294.274879:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993497600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986294.274923:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943819880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993497600:12345-0@lo:400:kworker.0 Request processed in 45us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986294.274930:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1788986294.274969:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993497600:0@lo:400:kworker.0 00000100:00100000:3.0:1788986294.275064:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993497472:0@lo:400:kworker.0 00000100:00100000:3.0:1788986294.275108:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986294.275128:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986294.275134:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993497344:0@lo:400:kworker.0 00000100:00100000:3.0:1788986294.275155:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986294.275326:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993497472 00000100:00100000:3.0:1788986294.275331:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993497472 00000100:00100000:3.0:1788986294.275662:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993497344 00000100:00100000:3.0:1788986294.275667:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993497344 00000100:00100000:3.0:1788986294.275692:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1788986294.275699:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094381ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993497472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986294.275739:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094381ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993497472:12345-0@lo:400:kworker.0 Request processed in 41us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986294.275746:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1456 00000100:00100000:3.0:1788986294.275774:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1788986294.275781:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094381bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993497344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986294.275810:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094381bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993497344:12345-0@lo:400:kworker.0 Request processed in 29us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986294.275815:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00080000:3.0:1788986294.275835:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986294.275859:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993497344:0@lo:400:kworker.0 00000100:00100000:3.0:1788986294.275870:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993497472:0@lo:400:kworker.0 00000100:00100000:0.0:1788986294.281267:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993497216:12345-0@lo:400:kworker.0 Request processed in 8508us (8797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986294.281281:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1183 00000100:00100000:1.0:1788986294.281670:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993497216:0@lo:400:kworker.0 00000100:00100000:0.0:1788986294.282728:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993497856:0@lo:400:kworker.0 00000100:00100000:0.0:1788986294.282796:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986294.282862:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993497728:0@lo:400:kworker.0 00000100:00100000:1.0:1788986294.282896:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986294.282922:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993497728 00000100:00100000:1.0:1788986294.282929:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993497728 00000100:00100000:1.0:1788986294.282979:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:1.0:1788986294.282988:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993497728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986294.283030:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993497728:12345-0@lo:400:kworker.0 Request processed in 44us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986294.283036:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00080000:1.0:1788986294.283064:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986294.283085:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993497728:0@lo:400:kworker.0 00000100:00100000:1.0:1788986294.283132:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993497856 00000100:00100000:1.0:1788986294.283135:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993497856 00000100:00100000:1.0:1788986294.283165:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:1.0:1788986294.283171:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993497856:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788986294.286515:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986294.286610:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993497856:12345-0@lo:400:kworker.0 Request processed in 3434us (3809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986294.286623:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1788986294.287172:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993497856:0@lo:400:kworker.0 00000100:00100000:3.0:1788986294.785150:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986294.785173:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993497984:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986294.785235:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986294.785387:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993497984 00000100:00100000:0.0:1788986294.785394:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993497984 00000100:00100000:0.0:1788986294.785447:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 739 00000100:00100000:0.0:1788986294.785456:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993497984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986294.785486:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986294.785543:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993497984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986294.785550:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 739 00000100:00100000:3.0:1788986294.785663:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993497984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986295.232514:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986296.257133:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986296.433673:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986296.433729:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986296.433831:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971275136 00000100:00100000:0.0:1788986296.433840:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971275136 00000100:00100000:0.0:1788986296.433912:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1459 00000100:00100000:0.0:1788986296.433922:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971275136:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986296.433991:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971275136:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 71us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986296.433998:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1459 00000100:00080000:2.0:1788986296.434362:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986296.434699:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971275008 00000100:00100000:3.0:1788986296.434705:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971275008 00000100:00100000:3.0:1788986296.434744:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1184 00000100:00100000:3.0:1788986296.434761:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971275008:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986296.434811:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971275008:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 50us (1145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986296.434818:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1184 00000100:00100000:2.0:1788986296.437311:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986296.437355:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986296.437508:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971275392 00000100:00100000:0.0:1788986296.437517:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971275392 00000100:00100000:0.0:1788986296.437579:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971275264 00000100:00100000:0.0:1788986296.437582:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971275264 00000100:00100000:0.0:1788986296.437611:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1051 00000100:00100000:0.0:1788986296.437621:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971275392:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986296.437689:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971275392:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 70us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986296.437698:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1051 00000100:00100000:0.0:1788986296.437715:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1052 00000100:00100000:0.0:1788986296.437722:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971275264:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986296.437759:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971275264:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986296.437766:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1052 00000100:00080000:2.0:1788986296.438173:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986296.438178:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788986297.280524:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986298.304686:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986298.368771:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986298.368793:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993498112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986298.368852:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986298.369206:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993498112 00000100:00100000:0.0:1788986298.369215:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993498112 00000100:00100000:0.0:1788986298.369275:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 740 00000100:00100000:0.0:1788986298.369284:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993498112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986298.369327:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986298.369371:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993498112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986298.369378:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 740 00000100:00100000:1.0:1788986298.369480:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993498112:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986298.370150:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986299.332671:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986299.394997:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993498496:0@lo:400:kworker.0 00000100:00100000:2.0:1788986299.395061:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986299.395138:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788986299.395145:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993498368:0@lo:400:kworker.0 00000100:00100000:2.0:1788986299.395167:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986299.395186:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993498880:0@lo:400:kworker.0 00000100:00100000:2.0:1788986299.395208:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986299.395400:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993498880 00000100:00100000:0.0:1788986299.395408:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993498880 00000100:00100000:0.0:1788986299.395463:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1788986299.395472:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993498880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986299.395528:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993498880:12345-0@lo:400:kworker.0 Request processed in 57us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986299.395534:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00080000:0.0:1788986299.395556:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986299.395591:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993498880:0@lo:400:kworker.0 00000100:00100000:1.0:1788986299.395666:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993498240:0@lo:400:kworker.0 00000100:00100000:1.0:1788986299.395699:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986299.395742:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993498752:0@lo:400:kworker.0 00000100:00100000:1.0:1788986299.395766:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986299.395786:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986299.395791:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993498624:0@lo:400:kworker.0 00000100:00100000:1.0:1788986299.395811:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986299.395837:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993498496 00000100:00100000:1.0:1788986299.395841:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993498496 00000100:00100000:1.0:1788986299.395874:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993498368 00000100:00100000:1.0:1788986299.395877:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993498368 00000100:00100000:1.0:1788986299.395893:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993498752 00000100:00100000:1.0:1788986299.395896:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993498752 00000100:00100000:1.0:1788986299.395913:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1460 00000100:00100000:1.0:1788986299.395919:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993498496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986299.395956:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993498496:12345-0@lo:400:kworker.0 Request processed in 37us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986299.395962:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1460 00000100:00100000:1.0:1788986299.395976:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1788986299.395982:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993498368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986299.396010:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993498368:12345-0@lo:400:kworker.0 Request processed in 28us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986299.396015:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:1.0:1788986299.396026:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1788986299.396032:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993498752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986299.396065:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993498752:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986299.396070:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1788986299.396115:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993498624 00000100:00100000:1.0:1788986299.396119:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993498624 00000100:00100000:1.0:1788986299.396140:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1788986299.396146:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993498624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986299.396177:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993498624:12345-0@lo:400:kworker.0 Request processed in 31us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986299.396182:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00080000:1.0:1788986299.396217:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986299.396235:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993498624:0@lo:400:kworker.0 00000100:00100000:1.0:1788986299.396245:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993498752:0@lo:400:kworker.0 00000100:00100000:1.0:1788986299.396271:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993498368:0@lo:400:kworker.0 00000100:00100000:1.0:1788986299.396281:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993498496:0@lo:400:kworker.0 00000100:00100000:0.0:1788986299.396986:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993498240 00000100:00100000:0.0:1788986299.396991:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993498240 00000100:00100000:0.0:1788986299.397026:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1185 00000100:00100000:0.0:1788986299.397034:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993498240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986299.397074:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993498240:12345-0@lo:400:kworker.0 Request processed in 42us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986299.397080:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1185 00000100:00100000:1.0:1788986299.398498:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993498240:0@lo:400:kworker.0 00000100:00100000:0.0:1788986299.828587:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986299.828664:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971275520 00000100:00100000:3.0:1788986299.828675:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971275520 00000100:00100000:3.0:1788986299.828759:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 724 00000100:00100000:3.0:1788986299.828769:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46666:x1875885971275520:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986299.828857:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46666:x1875885971275520:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 91us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986299.828867:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 724 00000100:00080000:0.0:1788986299.829533:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986299.837305:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986299.837415:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971275648 00000100:00100000:3.0:1788986299.837423:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971275648 00000100:00100000:3.0:1788986299.837491:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 397 00000100:00100000:3.0:1788986299.837502:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46666:x1875885971275648:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986299.837955:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46666:x1875885971275648:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 454us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986299.837964:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 397 00000100:00080000:1.0:1788986299.838313:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986299.840066:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986299.840391:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971275776 00000100:00100000:1.0:1788986299.840398:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971275776 00000100:00100000:1.0:1788986299.840461:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 398 00000100:00100000:1.0:1788986299.840471:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094381aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46666:x1875885971275776:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00080000:3.0:1788986299.841361:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986299.841561:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094381aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46666:x1875885971275776:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 1088us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986299.841573:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 398 00000100:00100000:0.0:1788986299.868783:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986299.868831:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971275904 00000100:00100000:0.0:1788986299.868840:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971275904 00000100:00100000:0.0:1788986299.868889:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 725 00000100:00100000:0.0:1788986299.868899:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46666:x1875885971275904:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986299.869521:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46666:x1875885971275904:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 621us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986299.869529:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 725 00000100:00100000:1.0:1788986299.877386:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986299.877459:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971276032 00000100:00100000:2.0:1788986299.877468:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971276032 00000100:00100000:2.0:1788986299.877521:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 726 00000100:00100000:2.0:1788986299.877531:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46666:x1875885971276032:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986299.877624:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46666:x1875885971276032:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 94us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986299.877632:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 726 00000100:00100000:1.0:1788986299.880434:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986299.880501:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971276160 00000100:00100000:2.0:1788986299.880509:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971276160 00000100:00100000:2.0:1788986299.880561:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 399 00000100:00100000:2.0:1788986299.880571:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46666:x1875885971276160:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986299.880959:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46666:x1875885971276160:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 388us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986299.880967:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 399 00000100:00100000:2.0:1788986299.892315:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986299.892364:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971276288 00000100:00100000:2.0:1788986299.892372:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971276288 00000100:00100000:2.0:1788986299.892417:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 400 00000100:00100000:2.0:1788986299.892428:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46666:x1875885971276288:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986299.897447:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46666:x1875885971276288:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 5013us (5131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986299.897459:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 400 00000100:00100000:1.0:1788986299.907987:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986299.908019:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993499008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986299.908062:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986299.908145:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971276416 00000100:00100000:1.0:1788986299.908151:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971276416 00000100:00100000:1.0:1788986299.908189:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 727 00000100:00100000:1.0:1788986299.908354:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46666:x1875885971276416:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986299.908721:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46666:x1875885971276416:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 522us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986299.908743:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 727 00000100:00100000:1.0:1788986299.918454:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993499008 00000100:00100000:1.0:1788986299.918467:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993499008 00000100:00100000:1.0:1788986299.918521:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1788986299.918532:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993499008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986299.918568:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986299.918650:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993499008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (10587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986299.918657:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 741 00000100:00100000:1.0:1788986299.918710:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943819c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993499008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986299.952665:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986299.952800:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971276544 00000100:00100000:3.0:1788986299.952809:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971276544 00000100:00100000:3.0:1788986299.952857:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 728 00000100:00100000:3.0:1788986299.952879:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46667:x1875885971276544:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986299.952897:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986299.952914:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548672 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10dd expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986299.952969:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548679 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986299.952982:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986299.952993:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986299.953024:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00000004:00200000:3.0:1788986299.953027:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986299.953045:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548679 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986299.953068:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548672 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10dd expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986299.953116:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548679 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10dd expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986299.953125:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45316200) 00010000:00010000:3.0:1788986299.953128:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986299.953132:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2c00, rc 0) 00000100:00100000:3.0:1788986299.953186:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46667:x1875885971276544:12345-192.168.206.21@tcp:101:rm.0 Request processed in 308us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986299.953193:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 728 00000100:00100000:1.0:1788986299.961432:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986299.961960:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971276800 00000100:00100000:2.0:1788986299.961970:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971276800 00000100:00100000:2.0:1788986299.962030:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 729 00000100:00100000:2.0:1788986299.962041:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46667:x1875885971276800:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986299.962060:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986299.962078:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548680 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10e4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986299.962183:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00010000:00010000:2.0:1788986299.962558:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548680 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10e4 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986299.962573:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:2.0:1788986299.962576:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788986299.962583:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548680 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10e4 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986299.962596:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0200, rc 0) 00000100:00100000:2.0:1788986299.962651:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46667:x1875885971276800:12345-192.168.206.21@tcp:101:rm.0 Request processed in 612us (1223us total) trans 4294967568 rc 301/301 00000100:00100000:2.0:1788986299.962663:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 729 00000100:00100000:2.0:1788986299.967935:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986299.968062:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971276928 00000100:00100000:3.0:1788986299.968072:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971276928 00000100:00100000:3.0:1788986299.968154:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:3.0:1788986299.968163:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46667:x1875885971276928:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:3.0:1788986299.974026:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46667:x1875885971276928:12345-192.168.206.21@tcp:37:rm.0 Request processed in 5855us (6090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986299.974039:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 73 00000100:00100000:2.0:1788986299.988572:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986299.989331:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971277184 00000100:00100000:0.0:1788986299.989343:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971277184 00000100:00100000:0.0:1788986299.989406:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00100000:0.0:1788986299.989417:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46667:x1875885971277184:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:0.0:1788986299.989747:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46667:x1875885971277184:12345-192.168.206.21@tcp:35:rm.0 Request processed in 331us (1180us total) trans 4294967569 rc 0/0 00000100:00100000:0.0:1788986299.989754:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 74 00000100:00100000:2.0:1788986300.008959:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986300.009193:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971277440 00000100:00100000:3.0:1788986300.009202:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971277440 00000100:00100000:3.0:1788986300.009258:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 730 00000100:00100000:3.0:1788986300.009267:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46667:x1875885971277440:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788986300.009314:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788986300.009352:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548679 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10dd expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.009374:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54861e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x36:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10c8 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.009387:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a45316200) 00010000:00010000:3.0:1788986300.009402:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54832a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1012 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.009412:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:3.0:1788986300.009419:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986300.009438:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54868e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.009450:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54868e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.009460:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54868e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.009471:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548695 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.009479:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548695 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.009486:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548695 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.009790:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54869c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.009799:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54869c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.009806:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54869c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986300.011715:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x36:0x0]: returning size 16384 00010000:00010000:3.0:1788986300.014837:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54869c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014852:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54869c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014859:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54869c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014866:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986300.014870:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54869c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014877:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54869c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014891:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x36:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986300.014894:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986300.014899:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54869c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014907:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54869c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x36:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014935:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54868e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014943:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54868e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014949:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54868e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014954:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986300.014957:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54868e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014963:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54868e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014970:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:3.0:1788986300.014973:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986300.014975:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54868e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986300.014982:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54868e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986300.014994:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000086ad1567 reply state 000000002002ef7b transno 4294967570 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548695 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986300.015002:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986300.015228:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46667:x1875885971277440:12345-192.168.206.21@tcp:36:rm.0 Request processed in 5957us (6272us total) trans 4294967570 rc 0/0 00000100:00100000:3.0:1788986300.015237:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 730 00010000:00010000:0.0:1788986300.040926:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548695 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986300.040944:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548695 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986300.040952:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548695 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986300.040959:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986300.040964:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548695 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986300.040972:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548695 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986300.040987:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a55745700) 00010000:00010000:0.0:1788986300.040991:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986300.040996:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548695 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986300.041002:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548695 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986300.355994:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986301.377710:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986301.598385:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986301.598432:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986301.598458:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986301.598487:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986301.598515:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971277568 00000100:00100000:0.0:1788986301.598524:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971277568 00000100:00100000:0.0:1788986301.598571:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1186 00000100:00100000:0.0:1788986301.598581:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971277568:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986301.598649:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971277568:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986301.598656:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1186 00000100:00100000:0.0:1788986301.598692:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971277696 00000100:00100000:0.0:1788986301.598695:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971277696 00000100:00100000:0.0:1788986301.598758:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1463 00000100:00100000:0.0:1788986301.598766:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971277696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986301.598807:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971277696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 41us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986301.598814:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1463 00000100:00100000:0.0:1788986301.598835:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971277952 00000100:00100000:0.0:1788986301.598839:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971277952 00000100:00100000:0.0:1788986301.598869:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971277824 00000100:00100000:0.0:1788986301.598872:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971277824 00000100:00100000:0.0:1788986301.598895:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1055 00000100:00100000:0.0:1788986301.598902:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971277952:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986301.598930:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971277952:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986301.598936:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1055 00000100:00100000:0.0:1788986301.598947:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1056 00000100:00100000:0.0:1788986301.598953:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971277824:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986301.598973:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971277824:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 21us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986301.598979:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1056 00000100:00080000:0.0:1788986301.598998:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986301.599004:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986301.599007:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986302.400726:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788986302.523381:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967569 is committed 00000001:00080000:2.0:1788986302.523404:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967570 is committed 00010000:00010000:1.0:1788986303.437238:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986303.490473:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993499136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986303.490538:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986303.490705:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993499136 00000100:00100000:1.0:1788986303.490722:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993499136 00000100:00100000:1.0:1788986303.490789:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1788986303.490798:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993499136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986303.490829:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986303.490875:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993499136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986303.490882:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 742 00000100:00100000:1.0:1788986303.490922:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993499136:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986303.491003:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1788986303.587294:0:80043:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc3a932470 20000000:00000080:0.0:1788986303.587311:0:80043:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0941f06c00 uarg=0000000000000000 10000000:01000000:0.0:1788986303.587355:0:80043:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986303.587375:0:80043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986303.587393:0:80043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf54831c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548315 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986303.587402:0:80043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986303.587439:0:80043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf54831c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548315 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986303.587451:0:80043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf54831c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548315 expref: 18 pid: 5846 timeout: 2187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986303.587465:0:80043:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:80043:1875885993499264:0@lo:104: 00000100:00100000:0.0:1788986303.587520:0:80043:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986303.587624:0:80043:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788986303.587665:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993499264 00000100:00100000:2.0:1788986303.587672:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993499264 00000100:00100000:2.0:1788986303.587812:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788986303.587822:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:80043:x1875885993499264:12345-0@lo:104: 00010000:00010000:2.0:1788986303.587834:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54831c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986303.587953:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986303.587959:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:80043:x1875885993499264:12345-0@lo:104: Request processed in 139us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986303.587965:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00010000:00010000:1.0:1788986303.587995:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986303.588001:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54831c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986303.588146:0:80043:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:80043:1875885993499264:0@lo:104: 00010000:00010000:0.0:1788986303.588163:0:80043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986303.588381:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986303.588385:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54831c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986303.588394:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54831c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986303.588400:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54831c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986303.588407:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986303.588446:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54831c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986303.588452:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986303.588481:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54831c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986303.588493:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf548315 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54831c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986303.588508:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986303.588509:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986303.588511:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986303.588619:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993499392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986303.588653:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986303.588796:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993499392 00000100:00100000:3.0:1788986303.588802:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993499392 00010000:00010000:3.0:1788986303.588824:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf54831c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548315 expref: 19 pid: 5846 timeout: 2187 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986303.588854:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788986303.588860:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993499392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986303.588870:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986303.588874:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf54831c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548315 expref: 19 pid: 5846 timeout: 2187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986303.588884:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf54831c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548315 expref: 19 pid: 5846 timeout: 2187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986303.588896:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf54831c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548315 expref: 19 pid: 5846 timeout: 2187 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986303.588910:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986303.588917:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986303.588931:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986303.588939:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986303.588946:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986303.588956:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986303.588961:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986303.588965:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986303.588971:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986303.588981:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986303.588990:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986303.589029:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993499392:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986303.589035:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00000100:00100000:3.0:1788986303.589062:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993499392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986303.589247:0:80043:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986303.589256:0:80043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986303.589262:0:80043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf5486a3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986304.448364:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986304.515160:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993499776:0@lo:400:kworker.0 00000100:00100000:0.0:1788986304.515233:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986304.515295:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986304.515302:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993499904:0@lo:400:kworker.0 00000100:00100000:0.0:1788986304.515328:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986304.515359:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993499904 00000100:00100000:0.0:1788986304.515365:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993499904 00000100:00100000:0.0:1788986304.515406:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1788986304.515414:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993499904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986304.515459:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993499904:12345-0@lo:400:kworker.0 Request processed in 46us (131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986304.515466:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1788986304.515507:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993499904:0@lo:400:kworker.0 00000100:00100000:3.0:1788986304.515872:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993499520:0@lo:400:kworker.0 00000100:00100000:3.0:1788986304.515906:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986304.515939:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993500032:0@lo:400:kworker.0 00000100:00100000:3.0:1788986304.515962:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986304.515983:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788986304.515989:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993499648:0@lo:400:kworker.0 00000100:00100000:3.0:1788986304.516009:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986304.516025:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993500160:0@lo:400:kworker.0 00000100:00100000:3.0:1788986304.516045:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986304.516070:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993499776 00000100:00100000:3.0:1788986304.516074:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993499776 00000100:00100000:3.0:1788986304.516135:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993500032 00000100:00100000:3.0:1788986304.516139:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993500032 00000100:00100000:3.0:1788986304.516162:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993499648 00000100:00100000:3.0:1788986304.516164:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993499648 00000100:00100000:3.0:1788986304.516190:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1464 00000100:00100000:3.0:1788986304.516196:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993499776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986304.516231:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993499776:12345-0@lo:400:kworker.0 Request processed in 35us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986304.516237:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1464 00000100:00100000:3.0:1788986304.516249:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:3.0:1788986304.516255:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094381a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993500032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986304.516279:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094381a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993500032:12345-0@lo:400:kworker.0 Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986304.516285:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:3.0:1788986304.516294:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:3.0:1788986304.516299:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094381b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993499648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986304.516319:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094381b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993499648:12345-0@lo:400:kworker.0 Request processed in 20us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986304.516324:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00080000:3.0:1788986304.516339:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986304.516355:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993499648:0@lo:400:kworker.0 00000100:00100000:3.0:1788986304.516364:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993500032:0@lo:400:kworker.0 00000100:00100000:0.0:1788986304.516550:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993499520 00000100:00100000:0.0:1788986304.516555:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993499520 00000100:00100000:0.0:1788986304.516585:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1788986304.516590:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993499520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986304.516629:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993499520:12345-0@lo:400:kworker.0 Request processed in 39us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986304.516635:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:0.0:1788986304.516658:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993500160 00000100:00100000:0.0:1788986304.516661:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993500160 00000100:00100000:0.0:1788986304.516685:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1788986304.516691:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993500160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986304.516726:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993500160:12345-0@lo:400:kworker.0 Request processed in 35us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986304.516731:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00080000:0.0:1788986304.516751:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986304.516765:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993499776:0@lo:400:kworker.0 00000100:00100000:3.0:1788986304.516848:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993500160:0@lo:400:kworker.0 00000100:00100000:3.0:1788986304.516856:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993499520:0@lo:400:kworker.0 00000020:00000080:3.0:1788986304.638968:0:80091:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdea1bb6b0 20000000:00000080:3.0:1788986304.638985:0:80091:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76638000 uarg=0000000000000000 10000000:01000000:3.0:1788986304.639033:0:80091:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986304.639052:0:80091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf5486aa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986304.639069:0:80091:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf5486aa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 80091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986304.639080:0:80091:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf5486aa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986304.639126:0:80091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf5486aa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986304.639135:0:80091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf5486aa lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986304.639142:0:80091:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf5486aa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986304.639149:0:80091:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986304.639153:0:80091:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf5486aa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986304.639161:0:80091:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf5486aa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 80091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986304.639173:0:80091:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf5486aa lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986304.639182:0:80091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf5486aa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986304.639188:0:80091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf5486aa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986304.641783:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986304.641789:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986304.641794:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986304.641840:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986304.641850:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986304.641861:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986304.641888:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993500288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986304.641953:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986304.641994:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a554e0600 going to sleep for 11 seconds 00000100:00100000:0.0:1788986304.642015:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993500288 00000100:00100000:0.0:1788986304.642022:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993500288 00000100:00100000:0.0:1788986304.642064:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1788986304.642072:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993500288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986304.642086:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986304.642127:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5486b8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5486b1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986304.642152:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5486b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5486b1 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986304.642163:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5486b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5486b1 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986304.642172:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef000, rc 0) 00000100:00100000:0.0:1788986304.642210:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993500288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986304.642217:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:0.0:1788986304.642272:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993500288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986304.642286:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5486b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986304.642295:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5486b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986304.642312:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986304.642317:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5486b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986304.642324:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5486b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986305.029458:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986305.029482:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993500416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986305.029543:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986305.030132:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993500416 00000100:00100000:3.0:1788986305.030140:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993500416 00000100:00100000:3.0:1788986305.030184:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 743 00000100:00100000:3.0:1788986305.030192:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993500416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986305.030225:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986305.030275:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993500416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986305.030282:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 743 00000100:00100000:0.0:1788986305.030418:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943818380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993500416:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986305.484890:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986306.501842:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986306.679512:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986306.679540:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986306.679563:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986306.679583:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986306.679618:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971278336 00000100:00100000:3.0:1788986306.679626:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971278336 00000100:00100000:3.0:1788986306.679671:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971278464 00000100:00100000:3.0:1788986306.679674:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971278464 00000100:00100000:3.0:1788986306.679704:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1059 00000100:00100000:3.0:1788986306.679713:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094381b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971278336:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986306.679776:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094381b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971278336:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986306.679783:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1059 00000100:00100000:3.0:1788986306.679799:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1060 00000100:00100000:3.0:1788986306.679805:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971278464:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986306.679824:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943819c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971278464:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 21us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986306.679830:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1060 00000100:00100000:3.0:1788986306.679846:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971278208 00000100:00100000:3.0:1788986306.679848:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971278208 00000100:00100000:3.0:1788986306.679872:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1467 00000100:00100000:3.0:1788986306.679878:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971278208:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986306.679905:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971278208:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986306.679910:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1467 00000100:00080000:3.0:1788986306.679927:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986306.679931:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986306.679933:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986306.680174:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971278080 00000100:00100000:1.0:1788986306.680179:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971278080 00000100:00100000:1.0:1788986306.680217:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1189 00000100:00100000:1.0:1788986306.680224:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971278080:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986306.680260:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971278080:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986306.680266:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1189 00010000:00010000:1.0:1788986307.520487:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986307.659274:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986307.659678:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971278592 00000100:00100000:1.0:1788986307.659699:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971278592 00000100:00100000:1.0:1788986307.659761:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 731 00000100:00100000:1.0:1788986307.659770:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46780:x1875885971278592:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986307.659788:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986307.659811:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5486bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10eb expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.659868:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5486c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.659886:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5486c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.659899:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5486c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986307.659934:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788986307.659937:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986307.659962:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5486c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.659985:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5486bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10eb expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.660002:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5486c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10eb expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.660010:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:1.0:1788986307.660013:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986307.660016:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986307.660078:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46780:x1875885971278592:12345-192.168.206.21@tcp:101:rm.0 Request processed in 309us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986307.660085:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 731 00000100:00100000:1.0:1788986307.664754:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986307.665302:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971278720 00000100:00100000:0.0:1788986307.665312:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971278720 00000100:00100000:0.0:1788986307.665414:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 732 00000100:00100000:0.0:1788986307.665425:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46780:x1875885971278720:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986307.665445:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986307.665465:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5486cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10f2 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665523:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5486d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665537:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5486d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665547:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5486d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665575:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665582:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665589:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665813:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5486d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665821:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5486d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665827:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5486d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665834:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986307.665838:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5486d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665845:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5486d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665857:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:0.0:1788986307.665860:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986307.665865:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5486d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665870:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5486d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665883:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665889:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665894:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665902:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986307.665905:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665911:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665921:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a4823b100) 00010000:00010000:0.0:1788986307.665924:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986307.665926:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665932:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665971:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5486cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10f2 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665981:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:0.0:1788986307.665984:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986307.665987:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5486cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10f2 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.665998:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eee00, rc 0) 00000100:00100000:0.0:1788986307.666068:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46780:x1875885971278720:12345-192.168.206.21@tcp:101:rm.0 Request processed in 645us (1324us total) trans 0 rc 301/301 00000100:00100000:0.0:1788986307.666076:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 732 00000100:00100000:3.0:1788986307.712263:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986307.712539:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971278848 00000100:00100000:0.0:1788986307.712549:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971278848 00000100:00100000:3.0:1788986307.712675:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986307.712824:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971279104 00000100:00100000:1.0:1788986307.712829:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971279104 00000100:00100000:1.0:1788986307.712879:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 733 00000100:00100000:1.0:1788986307.712889:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971278848:12345-192.168.206.21@tcp:41:mkdir.0 00000004:00000024:1.0:1788986307.712932:0:7899:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788986307.713046:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971278848:12345-192.168.206.21@tcp:41:mkdir.0 Request processed in 157us (791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986307.713054:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 733 00000100:00100000:1.0:1788986307.713073:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 734 00000100:00100000:1.0:1788986307.713080:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094381aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46784:x1875885971279104:12345-192.168.206.21@tcp:36:mkdir.0 00010000:00010000:1.0:1788986307.713140:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986307.713363:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5486c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10eb expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.713381:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:1.0:1788986307.713392:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986307.713614:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5486e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.713628:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5486e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.713639:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5486e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.713651:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5486e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.713659:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5486e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.713665:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5486e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986307.714881:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00010000:00010000:1.0:1788986307.714897:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5486e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.714906:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5486e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.714913:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5486e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.714919:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986307.714923:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5486e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.714931:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5486e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.714943:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:1.0:1788986307.714946:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986307.714950:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5486e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.714956:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5486e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986307.714973:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b5167c18 reply state 000000001319ffc0 transno 4294967571 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5486e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986307.714982:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986307.715066:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094381aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46784:x1875885971279104:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 1984us (2389us total) trans 4294967571 rc 0/0 00000100:00100000:1.0:1788986307.715077:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 734 00010000:00010000:3.0:1788986307.719922:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5486e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986307.719939:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5486e9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986307.719948:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5486e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986307.719955:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986307.719961:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5486e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986307.719968:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5486e9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986307.719983:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a45316800) 00010000:00010000:3.0:1788986307.719986:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986307.719990:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5486e9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986307.720007:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5486e9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986307.790282:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986307.790383:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971279232 00000100:00100000:0.0:1788986307.790392:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971279232 00000100:00100000:0.0:1788986307.790453:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 735 00000100:00100000:0.0:1788986307.790463:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094381a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46788:x1875885971279232:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:0.0:1788986307.790487:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986307.790509:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5486f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d10f9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.790581:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.790596:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.790607:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986307.790645:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788986307.790649:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986307.790667:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.790701:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5486f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10f9 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.790720:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10f9 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986307.790729:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:0.0:1788986307.790731:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986307.790735:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef800, rc 0) 00000100:00100000:0.0:1788986307.790791:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094381a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46788:x1875885971279232:12345-192.168.206.21@tcp:101:chown.0 Request processed in 329us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986307.790799:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 735 00000100:00100000:1.0:1788986307.797318:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986307.797454:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971279360 00000100:00100000:2.0:1788986307.797463:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971279360 00000100:00100000:2.0:1788986307.797520:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 736 00000100:00100000:2.0:1788986307.797529:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46788:x1875885971279360:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:2.0:1788986307.797550:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986307.797581:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5486fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1100 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.797637:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548705 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.797651:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548705 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.797661:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548705 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.797674:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54870c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.797681:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54870c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.797699:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54870c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.797784:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548713 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.797792:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.797799:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986307.797828:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:2.0:1788986307.797832:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986307.797852:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548713 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798271:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548705 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798280:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548705 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798288:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548705 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798294:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986307.798298:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548705 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798306:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548705 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798316:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:2.0:1788986307.798319:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986307.798324:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548705 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798330:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548705 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798343:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54870c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798349:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54870c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798359:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54870c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798625:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986307.798629:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54870c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798636:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54870c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798645:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986307.798647:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986307.798651:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54870c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798657:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54870c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798702:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5486fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1100 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798716:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548713 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1100 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986307.798723:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986307.798726:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986307.798728:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788986307.798792:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46788:x1875885971279360:12345-192.168.206.21@tcp:101:chown.0 Request processed in 1263us (1482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986307.798803:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 736 00000100:00100000:3.0:1788986307.803997:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986307.804629:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971279616 00000100:00100000:1.0:1788986307.804640:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971279616 00000100:00100000:1.0:1788986307.804761:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 737 00000100:00100000:1.0:1788986307.804772:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46788:x1875885971279616:12345-192.168.206.21@tcp:36:chown.0 00010000:00010000:1.0:1788986307.804832:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986307.804982:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548713 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1100 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.805003:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:1.0:1788986307.805014:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986307.805039:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54871a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.805051:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54871a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.805061:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54871a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788986307.871394:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967572 is committed 00000004:00010000:1.0:1788986307.871497:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000086861732 reply state 0000000097d56c3f transno 4294967572 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54871a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986307.871510:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986307.871524:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00010000:00080000:1.0:1788986307.871624:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788986307.871643:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46788:x1875885971279616:12345-192.168.206.21@tcp:36:chown.0 Request processed in 66869us (67653us total) trans 4294967572 rc 0/0 00000100:00100000:1.0:1788986307.871655:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 737 00010000:00010000:1.0:1788986307.871701:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54871a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.871710:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54871a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.871718:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54871a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.871733:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986307.871738:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54871a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.871747:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54871a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.871761:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:1.0:1788986307.871764:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986307.871769:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54871a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986307.871775:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54871a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986308.545555:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986308.609062:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993500544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986308.609165:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986308.609347:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993500544 00000100:00100000:2.0:1788986308.609356:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993500544 00000100:00100000:2.0:1788986308.609409:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 744 00000100:00100000:2.0:1788986308.609419:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993500544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986308.609451:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986308.609497:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993500544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986308.609503:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 744 00000100:00080000:1.0:1788986308.609639:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986308.609673:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993500544:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788986308.774750:0:80289:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff7d8a07b0 20000000:00000080:2.0:1788986308.774768:0:80289:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094197e000 uarg=0000000000000000 10000000:01000000:2.0:1788986308.774814:0:80289:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986308.774835:0:80289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986308.774854:0:80289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5486b8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5486b1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986308.774863:0:80289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986308.774902:0:80289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5486b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5486b1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986308.774919:0:80289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5486b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5486b1 expref: 18 pid: 5846 timeout: 2192 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986308.774934:0:80289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:80289:1875885993500672:0@lo:104: 00000100:00100000:2.0:1788986308.774996:0:80289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986308.775135:0:80289:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161300 going to sleep for 11 seconds 00000100:00100000:1.0:1788986308.775454:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993500672 00000100:00100000:1.0:1788986308.775461:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993500672 00000100:00100000:1.0:1788986308.775538:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 331 00000100:00100000:1.0:1788986308.775547:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:80289:x1875885993500672:12345-0@lo:104: 00010000:00010000:1.0:1788986308.775610:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5486b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986308.775688:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986308.775694:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:80289:x1875885993500672:12345-0@lo:104: Request processed in 149us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986308.775701:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 331 00010000:00010000:0.0:1788986308.775751:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986308.775759:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5486b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986308.775765:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986308.775769:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5486b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986308.775777:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5486b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986308.775783:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5486b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986308.775789:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986308.775818:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5486b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986308.775823:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986308.775843:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5486b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986308.775849:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf5486b1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5486b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986308.775863:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986308.775865:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986308.775866:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986308.775880:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986308.775891:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993500800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986308.775921:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986308.776215:0:80289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:80289:1875885993500672:0@lo:104: 00010000:00010000:2.0:1788986308.776232:0:80289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986308.776446:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993500800 00000100:00100000:3.0:1788986308.776451:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993500800 00010000:00010000:3.0:1788986308.776476:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5486b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5486b1 expref: 19 pid: 5846 timeout: 2192 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986308.776497:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788986308.776504:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993500800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986308.776514:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986308.776518:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5486b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5486b1 expref: 19 pid: 5846 timeout: 2192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.776528:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5486b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5486b1 expref: 19 pid: 5846 timeout: 2192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.776542:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5486b8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5486b1 expref: 19 pid: 5846 timeout: 2192 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.776554:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.776572:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.776585:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.776592:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.776598:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.776605:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.776611:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986308.776615:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.776622:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986308.776865:0:80289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986308.776874:0:80289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.779221:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.779241:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548721 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986308.779267:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986308.779338:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993500800:12345-0@lo:103:ldlm_bl.0 Request processed in 2832us (3413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986308.779347:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00000100:00100000:0.0:1788986308.779621:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993500800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986309.571980:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986309.636658:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993500928:0@lo:400:kworker.0 00000100:00100000:1.0:1788986309.636738:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986309.636781:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993501440:0@lo:400:kworker.0 00000100:00100000:1.0:1788986309.636812:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986309.636840:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986309.636846:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993501312:0@lo:400:kworker.0 00000100:00100000:1.0:1788986309.636868:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986309.636891:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993501056:0@lo:400:kworker.0 00000100:00100000:1.0:1788986309.636915:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986309.636938:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993501568:0@lo:400:kworker.0 00000100:00100000:1.0:1788986309.636960:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986309.636979:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986309.636985:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993501184:0@lo:400:kworker.0 00000100:00100000:1.0:1788986309.637021:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986309.637056:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993500928 00000100:00100000:1.0:1788986309.637065:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993500928 00000100:00100000:1.0:1788986309.637210:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1788986309.637220:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993500928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986309.637269:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993500928:12345-0@lo:400:kworker.0 Request processed in 51us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986309.637277:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1190 00000100:00100000:1.0:1788986309.637320:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993500928:0@lo:400:kworker.0 00000100:00100000:1.0:1788986309.637349:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993501440 00000100:00100000:1.0:1788986309.637352:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993501440 00000100:00100000:1.0:1788986309.637382:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993501056 00000100:00100000:1.0:1788986309.637385:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993501056 00000100:00100000:1.0:1788986309.637397:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993501184 00000100:00100000:1.0:1788986309.637400:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993501184 00000100:00100000:1.0:1788986309.637415:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1468 00000100:00100000:1.0:1788986309.637422:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993501440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986309.637442:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:0.0:1788986309.637454:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993501056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986309.637461:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993501440:12345-0@lo:400:kworker.0 Request processed in 39us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986309.637468:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1468 00000100:00100000:1.0:1788986309.637482:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:1.0:1788986309.637488:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993501184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986309.637518:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993501184:12345-0@lo:400:kworker.0 Request processed in 30us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986309.637524:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00080000:1.0:1788986309.637539:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986309.637563:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993501184:0@lo:400:kworker.0 00000100:00100000:1.0:1788986309.637584:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993501440:0@lo:400:kworker.0 00000100:00100000:1.0:1788986309.638851:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993501056:0@lo:400:kworker.0 00000100:00100000:0.0:1788986309.639069:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993501056:12345-0@lo:400:kworker.0 Request processed in 392us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986309.639079:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:3.0:1788986309.639551:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993501312 00000100:00100000:3.0:1788986309.639559:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993501312 00000100:00100000:3.0:1788986309.640609:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993501568 00000100:00100000:3.0:1788986309.640618:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993501568 00000100:00100000:3.0:1788986309.640738:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1788986309.640748:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993501312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986309.640829:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993501312:12345-0@lo:400:kworker.0 Request processed in 82us (3959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986309.640835:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1788986309.640957:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1788986309.640966:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993501568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986309.641012:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993501568:12345-0@lo:400:kworker.0 Request processed in 49us (4051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986309.641018:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:3.0:1788986309.641861:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993501312:0@lo:400:kworker.0 00000100:00080000:1.0:1788986309.643667:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986309.643784:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993501568:0@lo:400:kworker.0 00000020:00000080:1.0:1788986309.722038:0:80337:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe9270b390 20000000:00000080:1.0:1788986309.722055:0:80337:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80827c00 uarg=0000000000000000 10000000:01000000:1.0:1788986309.722264:0:80337:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986309.722285:0:80337:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf548728 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 80337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986309.722302:0:80337:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031600/0xc20d828fcf548728 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 80337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986309.722312:0:80337:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf548728 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 80337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986309.722387:0:80337:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf548728 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986309.722396:0:80337:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031600/0xc20d828fcf548728 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 80337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986309.722403:0:80337:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031600/0xc20d828fcf548728 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986309.722409:0:80337:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986309.722414:0:80337:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031600/0xc20d828fcf548728 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 80337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986309.722423:0:80337:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031600/0xc20d828fcf548728 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 80337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986309.722440:0:80337:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031600/0xc20d828fcf548728 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986309.722449:0:80337:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031600/0xc20d828fcf548728 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986309.722455:0:80337:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf548728 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 80337 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986310.154262:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993501696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986310.154328:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986310.154435:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993501696 00000100:00100000:3.0:1788986310.154442:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993501696 00000100:00100000:3.0:1788986310.154494:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 745 00000100:00100000:3.0:1788986310.154504:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993501696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986310.154533:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986310.154575:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993501696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986310.154582:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 745 00000100:00100000:1.0:1788986310.154661:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943818000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993501696:0@lo:13:osp-pre-1-0.0 10000000:01000000:0.0:1788986310.337150:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986310.337159:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986310.337164:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986310.337209:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986310.337220:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986310.337231:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986310.337257:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993501824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986310.337333:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986310.337373:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993501824 00000100:00100000:0.0:1788986310.337379:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094395f0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986310.337381:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993501824 00000100:00100000:1.0:1788986310.337435:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1788986310.337444:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993501824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986310.337456:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986310.337469:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548736 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54872f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986310.337492:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548736 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54872f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986310.337502:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548736 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54872f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986310.337510:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788986310.337563:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993501824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986310.337569:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:2.0:1788986310.337658:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993501824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986310.337688:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548736 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986310.337697:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548736 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986310.337715:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986310.337719:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548736 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986310.337726:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548736 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986310.593240:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986311.617573:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986311.799364:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986311.799401:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986311.799514:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971279872 00000100:00100000:1.0:1788986311.799524:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971279872 00000100:00100000:1.0:1788986311.799594:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1471 00000100:00100000:1.0:1788986311.799603:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971279872:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986311.800482:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971279872:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 876us (1124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986311.800493:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1471 00000100:00080000:1.0:1788986311.800521:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986311.802248:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986311.802282:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986311.804425:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971279744 00000100:00100000:3.0:1788986311.804437:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971279744 00000100:00100000:3.0:1788986311.804591:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1192 00000100:00100000:3.0:1788986311.804608:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971279744:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986311.804686:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971279744:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 86us (2445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986311.807512:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1192 00000100:00100000:0.0:1788986311.807779:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971280128 00000100:00100000:0.0:1788986311.807789:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971280128 00000100:00100000:0.0:1788986311.808304:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971280000 00000100:00100000:0.0:1788986311.808311:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971280000 00000100:00100000:0.0:1788986311.808346:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1063 00000100:00100000:0.0:1788986311.808356:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971280128:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986311.808427:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971280128:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 73us (9024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986311.808434:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1063 00000100:00100000:0.0:1788986311.808452:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1064 00000100:00100000:0.0:1788986311.808459:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971280000:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986311.808484:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971280000:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (6201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986311.808490:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1064 00000100:00080000:3.0:1788986311.808707:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986311.808712:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986312.628193:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986312.629553:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971280256 00000100:00100000:3.0:1788986312.629566:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971280256 00000100:00100000:3.0:1788986312.629637:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 12 00000100:00100000:3.0:1788986312.629647:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:5589:x1875885971280256:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986312.629673:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986312.629706:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5486f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d10f9 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986312.629725:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:3.0:1788986312.629736:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986312.629793:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5589:x1875885971280256:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 147us (1608us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986312.629800:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 12 00010000:00010000:0.0:1788986312.641534:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986313.554296:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986313.554389:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971280384 00000100:00100000:1.0:1788986313.554399:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971280384 00000100:00100000:1.0:1788986313.554472:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 738 00000100:00100000:1.0:1788986313.554484:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46893:x1875885971280384:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986313.554507:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986313.554530:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54873d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1107 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986313.554594:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548744 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986313.554608:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986313.554620:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986313.554665:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788986313.554670:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986313.554690:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548744 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986313.554711:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54873d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1107 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986313.554730:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548744 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1107 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986313.554738:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:1.0:1788986313.554741:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986313.554745:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788986313.554796:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46893:x1875885971280384:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 315us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986313.554803:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 738 00000100:00080000:0.0:1788986313.555083:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986313.567431:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986313.568546:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971280512 00000100:00100000:0.0:1788986313.568557:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971280512 00000100:00100000:0.0:1788986313.568615:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 739 00000100:00100000:0.0:1788986313.568626:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46893:x1875885971280512:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986313.568646:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986313.568679:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54874b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d110e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.568741:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548752 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.568756:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.568768:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.568782:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548759 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.568788:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.568795:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569231:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548760 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569240:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569248:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986313.569279:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:0.0:1788986313.569283:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986313.569300:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548760 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569310:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548752 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569316:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548752 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569327:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569333:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986313.569336:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548752 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569343:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548752 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569355:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:0.0:1788986313.569358:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986313.569362:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548752 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569368:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548752 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569378:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548759 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569383:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548759 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569389:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569393:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986313.569395:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548759 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569404:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548759 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569410:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986313.569412:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986313.569415:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548759 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569420:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548759 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569448:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54874b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d110e expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569460:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548760 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d110e expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.569467:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:0.0:1788986313.569470:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986313.569472:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee400, rc 0) 00000100:00100000:0.0:1788986313.569538:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46893:x1875885971280512:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 913us (2114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986313.569545:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 739 00000100:00100000:1.0:1788986313.573588:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986313.573679:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971280768 00000100:00100000:2.0:1788986313.573688:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971280768 00000100:00100000:2.0:1788986313.573746:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 740 00000100:00100000:2.0:1788986313.573756:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46893:x1875885971280768:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986313.573806:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986313.573830:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf548760 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d110e expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.573847:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:2.0:1788986313.573867:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986313.573892:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548767 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.573905:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.573915:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986313.637433:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009a1602d0 reply state 00000000a92ae6fb transno 4294967573 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986313.637451:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986313.637467:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000100:00100000:2.0:1788986313.637572:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46893:x1875885971280768:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 63813us (63989us total) trans 4294967573 rc 0/0 00000100:00100000:2.0:1788986313.637580:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 740 00000001:00080000:2.0:1788986313.637623:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967573 is committed 00010000:00010000:2.0:1788986313.637762:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548767 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.637772:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548767 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.637781:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548767 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.637787:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986313.637792:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548767 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.637799:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548767 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.637814:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986313.637818:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986313.637823:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548767 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.637829:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548767 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986313.666676:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986313.710683:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986313.710817:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971280896 00000100:00100000:0.0:1788986313.710827:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971280896 00000100:00100000:0.0:1788986313.711075:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 741 00000100:00100000:0.0:1788986313.711117:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46897:x1875885971280896:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788986313.711153:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986313.711172:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54876e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1115 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711228:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548775 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711242:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548775 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711253:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548775 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711267:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54877c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711274:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54877c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711281:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54877c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711561:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548783 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711570:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711577:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986313.711604:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:0.0:1788986313.711609:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986313.711628:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548783 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711638:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548775 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711644:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548775 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711650:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548775 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711667:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986313.711671:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548775 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711677:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548775 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711688:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:0.0:1788986313.711691:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986313.711695:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548775 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711700:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548775 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711712:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54877c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711719:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54877c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711728:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54877c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711733:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986313.711736:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54877c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711742:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54877c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711750:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986313.711753:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986313.711756:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54877c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711761:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54877c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711790:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54876e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1115 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711803:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548783 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1115 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.711811:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:0.0:1788986313.711813:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986313.711815:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eea00, rc 0) 00000100:00100000:0.0:1788986313.711883:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46897:x1875885971280896:12345-192.168.206.21@tcp:101:touch.0 Request processed in 799us (1208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986313.711895:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 741 00000100:00100000:2.0:1788986313.715321:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986313.716250:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971281152 00000100:00100000:1.0:1788986313.716261:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971281152 00000100:00100000:2.0:1788986313.716383:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 742 00000100:00100000:2.0:1788986313.716394:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46897:x1875885971281152:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986313.716413:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986313.716434:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54878a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d111c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.716706:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548791 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.716720:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548791 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.716731:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548791 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.716782:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548798 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.716790:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.716797:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986313.717748:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x17:0x0], index 1: 0 00010000:00010000:2.0:1788986313.718353:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54879f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.718369:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54879f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.718379:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54879f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.718417:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548791 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.718428:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548791 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.718435:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548791 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.718441:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986313.718445:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548791 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.718452:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548791 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.718463:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:2.0:1788986313.718466:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986313.718471:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548791 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.718477:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548791 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986313.718494:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000cf29e7d2 reply state 000000007014b32f transno 4294967574 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986313.718504:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986313.718725:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54878a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d111c expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.718740:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54879f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d111c expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.718752:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:2.0:1788986313.718755:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986313.718758:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1e00, rc 0) 00000100:00100000:2.0:1788986313.718876:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46897:x1875885971281152:12345-192.168.206.21@tcp:101:touch.0 Request processed in 2483us (3563us total) trans 4294967574 rc 0/0 00000100:00100000:2.0:1788986313.718885:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 742 00000100:00100000:2.0:1788986313.724078:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:3.0:1788986313.724358:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548798 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986313.724369:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548798 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986313.724376:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548798 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986313.724383:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986313.724388:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548798 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986313.724395:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548798 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986313.724410:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a45aca800) 00010000:00010000:3.0:1788986313.724413:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986313.724417:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548798 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986313.724424:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548798 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986313.724487:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971281408 00000100:00100000:0.0:1788986313.724498:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971281408 00000100:00100000:0.0:1788986313.724662:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 743 00000100:00100000:0.0:1788986313.724673:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46897:x1875885971281408:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:0.0:1788986313.724723:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986313.724741:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54879f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d111c expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.724752:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:0.0:1788986313.724759:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986313.724796:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5487ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.724807:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5487ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.724816:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5487ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986313.725016:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000190db1c7 reply state 00000000db3e4bb9 transno 4294967575 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5487ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986313.725025:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986313.725300:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46897:x1875885971281408:12345-192.168.206.21@tcp:36:touch.0 Request processed in 628us (1228us total) trans 4294967575 rc 0/0 00000100:00100000:0.0:1788986313.725306:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 743 00010000:00010000:2.0:1788986313.727639:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5487ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.727665:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5487ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.727674:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5487ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.727680:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986313.727684:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5487ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.727692:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5487ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.727706:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:2.0:1788986313.727709:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986313.727714:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5487ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986313.727719:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5487ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986313.728759:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986313.729006:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971281536 00000100:00100000:0.0:1788986313.729015:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971281536 00000100:00100000:0.0:1788986313.729066:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 744 00000100:00100000:0.0:1788986313.729075:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46897:x1875885971281536:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788986313.729147:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986313.729165:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5487b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1123 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.729218:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5487b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1123 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.729232:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5487b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1123 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.729251:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986313.729254:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788986313.729257:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee800, rc 0) 00000100:00100000:0.0:1788986313.729308:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46897:x1875885971281536:12345-192.168.206.21@tcp:101:touch.0 Request processed in 234us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986313.729314:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 744 00000100:00100000:3.0:1788986313.730191:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993501952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986313.730239:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986313.730632:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993501952 00000100:00100000:2.0:1788986313.730638:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993501952 00000100:00100000:2.0:1788986313.730705:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 746 00000100:00100000:2.0:1788986313.730714:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993501952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986313.730743:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986313.730799:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993501952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986313.730805:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 746 00000100:00100000:3.0:1788986313.730888:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993501952:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986313.731051:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986313.733445:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986313.733538:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971281664 00000100:00100000:0.0:1788986313.733547:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971281664 00000100:00100000:0.0:1788986313.733613:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 401 00000100:00100000:0.0:1788986313.733624:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971281664:12345-192.168.206.21@tcp:2:touch.0 00000100:00100000:0.0:1788986313.733923:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971281664:12345-192.168.206.21@tcp:2:touch.0 Request processed in 300us (484us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1788986313.733929:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 401 00000100:00080000:3.0:1788986313.734071:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986313.737263:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986313.737336:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971281920 00000100:00100000:3.0:1788986313.737344:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971281920 00000100:00100000:3.0:1788986313.737397:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:3.0:1788986313.737407:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46897:x1875885971281920:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:3.0:1788986313.737724:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46897:x1875885971281920:12345-192.168.206.21@tcp:35:touch.0 Request processed in 318us (468us total) trans 4294967576 rc 0/0 00000100:00100000:3.0:1788986313.737732:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 75 00000100:00100000:2.0:1788986313.791008:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986313.791145:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971282048 00000100:00100000:0.0:1788986313.791155:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971282048 00000100:00100000:0.0:1788986313.791202:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 745 00000100:00100000:0.0:1788986313.791211:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46901:x1875885971282048:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986313.791233:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986313.791250:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5487bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d112a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791308:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487c2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791321:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791332:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791344:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791351:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791357:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791435:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5487d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791443:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5487d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791454:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5487d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986313.791485:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3d:0x0]: returning size 0 00000004:00200000:0.0:1788986313.791489:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986313.791507:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5487d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791518:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5487d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791537:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487c2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791544:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487c2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791550:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791556:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986313.791559:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487c2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791566:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487c2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791576:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:0.0:1788986313.791579:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986313.791584:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791594:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791606:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791611:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791616:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791620:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efe00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986313.791623:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791629:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791635:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986313.791637:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986313.791640:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791645:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791682:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5487bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d112a expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791698:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5487d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d112a expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.791705:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986313.791707:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986313.791709:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee000, rc 0) 00000100:00100000:0.0:1788986313.791769:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46901:x1875885971282048:12345-192.168.206.21@tcp:101:rm.0 Request processed in 558us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986313.791776:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 745 00000100:00100000:1.0:1788986313.796362:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986313.796434:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971282176 00000100:00100000:0.0:1788986313.796442:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971282176 00000100:00100000:0.0:1788986313.796495:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 402 00000100:00100000:0.0:1788986313.796504:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971282176:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986313.796521:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986313.796541:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b71c7a4/0xc20d828fcf5487d7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1131 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986313.796565:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x6aa1c3c9, atime: 0x6aa1c3c9, ctime: 0x6aa1c3c9, blocks: 0x1 00010000:00010000:0.0:1788986313.796584:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=2097s v=(0 0) 00010000:00010000:0.0:1788986313.796589:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986313.796597:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b71c7a4/0xc20d828fcf5487d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1131 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.796615:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b71c7a4/0xc20d828fcf5487d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1131 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.796633:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986313.796697:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971282176:12345-192.168.206.21@tcp:101:rm.0 Request processed in 194us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986313.796704:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 402 00000100:00100000:2.0:1788986313.800192:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986313.800277:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971282432 00000100:00100000:0.0:1788986313.800286:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971282432 00000100:00100000:0.0:1788986313.800348:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 746 00000100:00100000:0.0:1788986313.800358:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46901:x1875885971282432:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1788986313.800407:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986313.800431:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5487d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3d:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d112a expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.800452:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf5487b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3d:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1123 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.800462:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986313.800472:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986313.800491:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5487de lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.800503:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5487de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.800511:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5487de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.800523:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.800529:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.800535:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.800632:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.800639:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.800646:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788986313.801218:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].23, 64 off9664 00000004:00080000:0.0:1788986313.801228:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2097704138303ns, next at 2098704135758ns, rc = 0 00010000:00010000:0.0:1788986313.801283:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5487f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801293:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5487f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801300:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5487f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801307:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5487f3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801313:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5487f3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801323:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5487f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801347:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788986313.801365:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801371:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801378:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801383:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986313.801387:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801394:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801402:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:0.0:1788986313.801405:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788986313.801408:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801414:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5487ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801429:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5487de lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801436:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5487de lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801441:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5487de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801446:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986313.801448:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5487de lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801453:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5487de lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801459:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:0.0:1788986313.801462:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986313.801464:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5487de lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.801469:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf5487de lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986313.801477:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005b4f58c8 reply state 00000000b026cf83 transno 4294967577 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986313.801484:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986313.801553:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46901:x1875885971282432:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1196us (1369us total) trans 4294967577 rc 0/0 00000100:00100000:0.0:1788986313.801561:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 746 00010000:00010000:3.0:1788986313.802023:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986313.802030:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5487f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986313.802036:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986313.802039:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5487f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986313.802045:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5487f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986313.802054:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3d:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:3.0:1788986313.802056:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986313.802059:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5487f3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986313.802063:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5487f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986313.802076:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986313.802078:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986313.802079:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986313.805017:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.805034:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.805045:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.805050:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efe00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986313.805054:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.805062:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.805075:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986313.805078:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986313.805083:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986313.805130:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf5487e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986314.701350:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986314.753606:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993502080:0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.753683:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986314.753724:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993502592:0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.753753:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986314.753778:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986314.753784:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993502464:0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.753807:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986314.753835:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993502208:0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.753857:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986314.753871:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993502720:0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.753889:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986314.753906:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986314.753912:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993502336:0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.753932:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986314.753978:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993502464 00000100:00100000:1.0:1788986314.753984:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993502464 00000100:00100000:1.0:1788986314.754018:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993502720 00000100:00100000:1.0:1788986314.754021:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993502720 00000100:00100000:1.0:1788986314.754048:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1788986314.754056:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993502464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.754132:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993502464:12345-0@lo:400:kworker.0 Request processed in 77us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986314.754139:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1788986314.754156:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1788986314.754162:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993502720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.754193:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993502720:12345-0@lo:400:kworker.0 Request processed in 32us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986314.754199:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1788986314.754216:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993502592 00000100:00100000:1.0:1788986314.754220:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993502592 00000100:00100000:1.0:1788986314.754240:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993502208 00000100:00100000:1.0:1788986314.754242:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993502208 00000100:00100000:1.0:1788986314.754256:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993502336 00000100:00100000:1.0:1788986314.754258:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993502336 00000100:00100000:1.0:1788986314.754272:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1472 00000100:00100000:1.0:1788986314.754278:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993502592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.754308:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993502592:12345-0@lo:400:kworker.0 Request processed in 30us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986314.754314:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1472 00000100:00100000:1.0:1788986314.754326:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:1.0:1788986314.754331:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993502208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.754358:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993502208:12345-0@lo:400:kworker.0 Request processed in 27us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986314.754364:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:1.0:1788986314.754377:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:1.0:1788986314.754382:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993502336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.754407:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993502336:12345-0@lo:400:kworker.0 Request processed in 25us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986314.754412:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00080000:1.0:1788986314.754427:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986314.754431:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986314.754634:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993502336:0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.754644:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993502208:0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.754668:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993502720:0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.754698:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993502464:0@lo:400:kworker.0 00000100:00100000:1.0:1788986314.754708:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993502592:0@lo:400:kworker.0 00000100:00100000:0.0:1788986314.756377:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993502080 00000100:00100000:0.0:1788986314.756386:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993502080 00000100:00100000:0.0:1788986314.756425:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1788986314.756434:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993502080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986314.756499:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993502080:12345-0@lo:400:kworker.0 Request processed in 66us (2815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986314.756505:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1193 00000100:00100000:0.0:1788986314.756741:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993502080:0@lo:400:kworker.0 00000001:00080000:1.0:1788986314.814468:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967342 is committed 00000100:00100000:2.0:1788986314.852244:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986314.852327:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971282560 00000100:00100000:1.0:1788986314.852336:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971282560 00000100:00100000:1.0:1788986314.852395:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 747 00000100:00100000:1.0:1788986314.852406:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46916:x1875885971282560:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986314.852429:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986314.852448:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5487fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1138 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986314.852506:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548801 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986314.852532:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986314.852544:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986314.852576:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:1.0:1788986314.852580:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986314.852597:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548801 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986314.852621:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5487fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1138 expref: 13 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986314.852639:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548801 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1138 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986314.852665:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:1.0:1788986314.852668:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986314.852672:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986314.852734:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46916:x1875885971282560:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 329us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986314.852741:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 747 00000100:00100000:3.0:1788986314.865556:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986314.865635:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971282816 00000100:00100000:2.0:1788986314.865643:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971282816 00000100:00100000:2.0:1788986314.865707:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 748 00000100:00100000:2.0:1788986314.865724:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46916:x1875885971282816:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986314.865770:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986314.865793:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548801 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1138 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986314.865812:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548783 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1115 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986314.865822:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:2.0:1788986314.865831:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986314.865852:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548808 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986314.865864:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986314.865872:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788986314.940126:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967577 is committed 00000004:00080000:3.0:1788986314.940139:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 62 committed 00000001:00080000:3.0:1788986314.940160:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967578 is committed 00000100:00100000:2.0:1788986314.940391:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993502848:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788986314.940457:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:1.0:1788986314.940594:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ca22c51f reply state 000000006d9d088c transno 4294967578 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986314.940608:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986314.940621:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00010000:00080000:1.0:1788986314.940711:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788986314.940727:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46916:x1875885971282816:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 75010us (75176us total) trans 4294967578 rc 0/0 00000100:00100000:1.0:1788986314.940737:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 748 00010000:00010000:2.0:1788986314.940824:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548808 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986314.940834:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548808 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986314.940841:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548808 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986314.940847:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986314.940852:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548808 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986314.940859:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548808 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986314.940874:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:2.0:1788986314.940877:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986314.940881:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548808 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986314.940887:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548808 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986314.940945:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993502848 00000100:00100000:0.0:1788986314.940953:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993502848 00000100:00100000:0.0:1788986314.941000:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1788986314.941009:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993502848:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788986314.941032:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:23 count 1 00010000:00010000:0.0:1788986314.941053:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.941071:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b71c7a4/0xc20d828fcf5487d7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1131 expref: 5 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.941080:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788986314.941085:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986314.941138:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.941169:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b71c7a4/0xc20d828fcf5487d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1131 expref: 5 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.941186:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b71c7a4/0xc20d828fcf5487d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1131 expref: 5 pid: 6697 timeout: 2198 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986314.941198:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993502976:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986314.941247:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09427c4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788986314.946637:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993502976:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788986314.946685:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986314.953913:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986314.954283:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971282944 00000100:00100000:0.0:1788986314.954292:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971282944 00010000:00010000:0.0:1788986314.954329:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b71c7a4/0xc20d828fcf5487d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1131 expref: 6 pid: 6697 timeout: 2198 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986314.954372:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 375 00000100:00100000:0.0:1788986314.954382:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971282944:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986314.954397:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986314.954403:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b71c7a4/0xc20d828fcf5487d7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1131 expref: 6 pid: 6697 timeout: 2198 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.954417:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b71c7a4/0xc20d828fcf5487d7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1131 expref: 6 pid: 6697 timeout: 2198 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.954439:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b71c7a4/0xc20d828fcf5487d7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x17:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1131 expref: 6 pid: 6697 timeout: 2198 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.954454:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986314.954458:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986314.954463:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.954472:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.954510:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986314.954607:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971282944:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 225us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986314.954613:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 375 00010000:00010000:1.0:1788986314.955181:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986314.955194:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986314.955204:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986314.955212:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986314.955238:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788986314.955778:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993502848:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14769us (15319us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788986314.955786:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00010000:00010000:0.0:1788986314.957241:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986314.957252:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.957264:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986314.957269:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.957279:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.957299:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.957306:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070705d56/0xc20d828fcf54880f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986314.957329:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986314.957331:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986314.957332:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986314.958035:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b094268d180/2, rc 0, transno 4294967343 00000100:00100000:3.0:1788986314.958046:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993502848:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788986315.052785:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986315.055641:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971283072 00000100:00100000:0.0:1788986315.055666:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971283072 00000100:00100000:2.0:1788986315.055910:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 749 00000100:00100000:2.0:1788986315.055922:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46920:x1875885971283072:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986315.055946:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986315.055966:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548816 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d113f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.056024:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54881d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.056037:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54881d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.056047:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54881d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.056061:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548824 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.056067:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548824 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.056073:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548824 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.058179:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54882b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.058197:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54882b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.058209:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54882b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986315.058241:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:2.0:1788986315.058245:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986315.058264:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54882b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059069:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54881d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059078:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54881d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059084:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54881d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059160:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986315.059165:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54881d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059174:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54881d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059186:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:2.0:1788986315.059189:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986315.059193:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54881d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059199:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54881d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059219:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548824 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059225:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548824 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059230:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548824 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059235:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986315.059238:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548824 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059244:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548824 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059252:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a45aca500) 00010000:00010000:2.0:1788986315.059254:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986315.059257:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548824 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.059263:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548824 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.060797:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548816 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d113f expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.060825:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54882b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d113f expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.060839:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:2.0:1788986315.060842:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986315.060846:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1a00, rc 0) 00000100:00100000:2.0:1788986315.060925:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46920:x1875885971283072:12345-192.168.206.21@tcp:101:touch.0 Request processed in 5005us (8148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986315.060934:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 749 00000100:00080000:1.0:1788986315.064198:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986315.071605:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986315.071918:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971283328 00000100:00100000:1.0:1788986315.071927:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971283328 00000100:00100000:1.0:1788986315.071980:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 750 00000100:00100000:1.0:1788986315.071991:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46920:x1875885971283328:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986315.072009:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986315.072027:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548832 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1146 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.072402:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548839 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.072415:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548839 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.072436:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548839 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.072451:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548840 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.072458:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.072465:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788986315.073152:0:7899:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x18:0x0], index 0: 0 00010000:00010000:1.0:1788986315.076655:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548847 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.076676:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.076688:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548847 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.076729:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548839 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.076736:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548839 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.076743:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548839 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.076749:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986315.076753:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548839 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.076760:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548839 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.076770:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:1.0:1788986315.076773:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986315.076778:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548839 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.076786:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548839 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986315.076801:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b2bcd8cb reply state 000000009da9c913 transno 4294967579 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986315.076809:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986315.076845:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548832 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1146 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.076860:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548847 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1146 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.076867:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9b0a45316a00) 00010000:00010000:1.0:1788986315.076869:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986315.076872:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788986315.082502:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46920:x1875885971283328:12345-192.168.206.21@tcp:101:touch.0 Request processed in 10501us (10892us total) trans 4294967579 rc 0/0 00000100:00100000:1.0:1788986315.082514:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 750 00010000:00010000:1.0:1788986315.087361:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548840 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.087378:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548840 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.087385:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548840 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986315.087386:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:1.0:1788986315.087391:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986315.087396:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548840 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.087403:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548840 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986315.087417:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971283584 00010000:00010000:1.0:1788986315.087418:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a45316d00) 00010000:00010000:1.0:1788986315.087421:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788986315.087425:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971283584 00010000:00010000:1.0:1788986315.087425:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548840 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.087430:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548840 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986315.087468:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 751 00000100:00100000:3.0:1788986315.087477:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46920:x1875885971283584:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:3.0:1788986315.087525:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986315.087542:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548847 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1146 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.087553:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9b0a45316a00) 00010000:00010000:3.0:1788986315.087559:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986315.087597:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548855 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.087608:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.087617:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986315.087745:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000cdab71d reply state 00000000ce136663 transno 4294967580 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986315.087753:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986315.087847:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46920:x1875885971283584:12345-192.168.206.21@tcp:36:touch.0 Request processed in 371us (464us total) trans 4294967580 rc 0/0 00000100:00100000:3.0:1788986315.087855:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 751 00010000:00010000:2.0:1788986315.089962:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548855 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.089977:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548855 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.089984:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.089991:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986315.089995:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548855 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.090002:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548855 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.090016:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:2.0:1788986315.090019:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986315.090033:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548855 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.090039:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548855 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986315.090743:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986315.091342:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971283712 00000100:00100000:2.0:1788986315.091351:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971283712 00000100:00100000:2.0:1788986315.091407:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 752 00000100:00100000:2.0:1788986315.091417:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46920:x1875885971283712:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986315.091440:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986315.091458:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54885c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d114d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.091510:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54885c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d114d expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.091523:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54885c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d114d expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986315.091540:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:2.0:1788986315.091543:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788986315.091546:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1200, rc 0) 00000100:00100000:2.0:1788986315.091600:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46920:x1875885971283712:12345-192.168.206.21@tcp:101:touch.0 Request processed in 185us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986315.091607:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 752 00000100:00100000:2.0:1788986315.100433:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986315.100493:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971283840 00000100:00100000:0.0:1788986315.100502:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971283840 00000100:00100000:0.0:1788986315.100576:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 404 00000100:00100000:0.0:1788986315.100587:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971283840:12345-192.168.206.21@tcp:2:touch.0 00000100:00100000:0.0:1788986315.100911:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971283840:12345-192.168.206.21@tcp:2:touch.0 Request processed in 326us (486us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788986315.100919:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 404 00000100:00080000:1.0:1788986315.100986:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986315.107866:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986315.108022:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971284096 00000100:00100000:3.0:1788986315.108032:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971284096 00000100:00100000:3.0:1788986315.108085:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:3.0:1788986315.108129:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:46920:x1875885971284096:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:3.0:1788986315.108471:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46920:x1875885971284096:12345-192.168.206.21@tcp:35:touch.0 Request processed in 344us (612us total) trans 4294967581 rc 0/0 00000100:00100000:3.0:1788986315.108479:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 76 00000100:00100000:3.0:1788986315.208743:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986315.208819:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971284224 00000100:00100000:1.0:1788986315.208828:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971284224 00000100:00100000:1.0:1788986315.208895:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 753 00000100:00100000:1.0:1788986315.208904:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46924:x1875885971284224:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986315.208927:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986315.208957:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548863 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1154 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209014:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54886a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209028:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54886a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209044:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54886a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209058:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548871 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209065:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209071:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209200:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548878 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209208:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209215:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986315.209244:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3e:0x0]: returning size 0 00000004:00200000:1.0:1788986315.209248:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986315.209265:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209508:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548878 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209526:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54886a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209537:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54886a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209543:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54886a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209548:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986315.209552:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54886a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209559:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54886a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209570:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:1.0:1788986315.209573:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986315.209578:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54886a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209584:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54886a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209598:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548871 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209603:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548871 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209609:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209614:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986315.209617:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548871 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209623:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548871 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209630:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a45316d00) 00010000:00010000:1.0:1788986315.209632:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986315.209635:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548871 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209641:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548871 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209680:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548863 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1154 expref: 13 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209693:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548878 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1154 expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.209701:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:1.0:1788986315.209703:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986315.209706:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788986315.209765:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46924:x1875885971284224:12345-192.168.206.21@tcp:101:rm.0 Request processed in 863us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986315.209772:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 753 00000100:00100000:2.0:1788986315.220850:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986315.220958:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971284352 00000100:00100000:0.0:1788986315.220968:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971284352 00000100:00100000:0.0:1788986315.221031:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 405 00000100:00100000:0.0:1788986315.221041:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971284352:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986315.221057:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986315.221076:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54887f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d115b expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986315.221137:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x6aa1c3ca, atime: 0x6aa1c3ca, ctime: 0x6aa1c3ca, blocks: 0x1 00010000:00010000:0.0:1788986315.221157:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=2099s v=(0 0) 00010000:00010000:0.0:1788986315.221161:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986315.221170:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54887f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d115b expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986315.221200:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54887f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d115b expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986315.221212:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788986315.221316:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971284352:12345-192.168.206.21@tcp:101:rm.0 Request processed in 276us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986315.221324:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 405 00000100:00100000:2.0:1788986315.231658:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986315.231830:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971284608 00000100:00100000:3.0:1788986315.231840:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971284608 00000100:00100000:3.0:1788986315.231905:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 754 00000100:00100000:3.0:1788986315.231915:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46924:x1875885971284608:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788986315.231961:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986315.231986:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548878 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1154 expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.232012:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54885c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d114d expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.232034:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:3.0:1788986315.232044:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986315.232064:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548886 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.232077:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548886 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.232354:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548886 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.232374:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54888d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.232383:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54888d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.232391:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54888d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.232492:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548894 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.232499:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548894 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.232505:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548894 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788986315.233793:0:15241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].24, 64 off9728 00000004:00080000:3.0:1788986315.233805:0:15241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2099136715701ns, next at 2100136713317ns, rc = 0 00010000:00010000:3.0:1788986315.233869:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54889b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.233881:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54889b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234005:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54889b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234013:0:15241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54889b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234104:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54889b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234171:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54889b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234247:0:15241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986315.234281:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548894 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234289:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548894 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234295:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548894 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234301:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986315.234304:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548894 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234311:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548894 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234323:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986315.234326:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986315.234330:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548894 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234336:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548894 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234354:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548886 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234361:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548886 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234370:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548886 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234376:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986315.234378:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548886 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234384:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548886 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234390:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:3.0:1788986315.234392:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986315.234395:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548886 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986315.234400:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548886 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986315.234411:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000179ffd8 reply state 0000000027d1fe91 transno 4294967582 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54888d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986315.234429:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986315.234521:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46924:x1875885971284608:12345-192.168.206.21@tcp:36:rm.0 Request processed in 2596us (2869us total) trans 4294967582 rc 0/0 00000100:00100000:3.0:1788986315.234531:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 754 00010000:00010000:0.0:1788986315.240613:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54888d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986315.240632:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54888d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986315.240639:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54888d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986315.240654:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986315.240658:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54888d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986315.240666:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54888d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986315.240681:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a55745600) 00010000:00010000:0.0:1788986315.240684:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986315.240689:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54888d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986315.240695:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54888d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.241357:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986315.241366:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54889b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.241377:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986315.241381:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54889b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.241387:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54889b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.241398:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3e:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:1.0:1788986315.241400:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788986315.241404:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54889b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.241409:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54889b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986315.241500:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986315.241503:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986315.241505:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986315.266198:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986315.266224:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993503104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986315.266297:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986315.267121:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993503104 00000100:00100000:2.0:1788986315.267130:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993503104 00000100:00100000:2.0:1788986315.267191:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 747 00000100:00100000:2.0:1788986315.267200:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993503104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986315.267237:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986315.267305:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993503104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (1008us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986315.267313:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 747 00000100:00100000:0.0:1788986315.267774:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993503104:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986315.717656:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986316.264237:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986316.264342:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971284736 00000100:00100000:3.0:1788986316.264352:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971284736 00000100:00100000:3.0:1788986316.264407:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 755 00000100:00100000:3.0:1788986316.264418:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46938:x1875885971284736:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986316.264442:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986316.264461:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5488a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1162 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.264520:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5488a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.264535:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5488a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.264548:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5488a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986316.264580:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:3.0:1788986316.264584:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986316.264601:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5488a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.264628:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5488a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1162 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.264656:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5488a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1162 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.264664:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:3.0:1788986316.264667:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986316.264671:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2c00, rc 0) 00000100:00100000:3.0:1788986316.264723:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46938:x1875885971284736:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 308us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986316.264732:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 755 00000100:00100000:3.0:1788986316.268419:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986316.268452:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971284992 00000100:00100000:3.0:1788986316.268460:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971284992 00000100:00100000:3.0:1788986316.268508:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 756 00000100:00100000:3.0:1788986316.268518:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46938:x1875885971284992:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986316.268564:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986316.268590:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5488a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1162 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.268610:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54882b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d113f expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.268622:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:3.0:1788986316.268633:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986316.268667:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.268679:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.268687:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986316.268901:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000086413c0d reply state 00000000ac50a70f transno 4294967583 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986316.268909:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986316.268918:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000100:00100000:3.0:1788986316.268988:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46938:x1875885971284992:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 470us (578us total) trans 4294967583 rc 0/0 00000100:00100000:3.0:1788986316.268995:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 756 00010000:00010000:0.0:1788986316.274171:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.274188:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.274196:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.274203:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986316.274208:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.274215:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.274228:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:0.0:1788986316.274232:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788986316.274237:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.274242:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986316.427539:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986316.429130:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971285120 00000100:00100000:1.0:1788986316.429141:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971285120 00000100:00100000:1.0:1788986316.429196:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 757 00000100:00100000:1.0:1788986316.429213:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46951:x1875885971285120:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986316.429310:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46951:x1875885971285120:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 106us (1781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986316.429317:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 757 00000100:00100000:3.0:1788986316.432900:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986316.433263:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971285248 00000100:00100000:0.0:1788986316.433273:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971285248 00000100:00100000:0.0:1788986316.433324:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 406 00000100:00100000:0.0:1788986316.433334:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46951:x1875885971285248:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986316.433854:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46951:x1875885971285248:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 519us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986316.433866:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 406 00000100:00100000:3.0:1788986316.438305:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986316.438412:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971285376 00000100:00100000:0.0:1788986316.438423:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971285376 00000100:00100000:0.0:1788986316.438538:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 407 00000100:00100000:0.0:1788986316.438548:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46951:x1875885971285376:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986316.438920:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46951:x1875885971285376:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 372us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986316.438928:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 407 00000100:00080000:1.0:1788986316.441631:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986316.445466:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986316.445625:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971285504 00000100:00100000:3.0:1788986316.445635:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971285504 00000100:00100000:3.0:1788986316.445710:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 758 00000100:00100000:3.0:1788986316.445721:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46951:x1875885971285504:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986316.446844:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46951:x1875885971285504:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 1122us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986316.446854:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 758 00000100:00100000:3.0:1788986316.450587:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986316.450701:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971285632 00000100:00100000:2.0:1788986316.450712:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971285632 00000100:00100000:2.0:1788986316.450769:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 759 00000100:00100000:2.0:1788986316.450780:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46951:x1875885971285632:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986316.450878:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46951:x1875885971285632:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 100us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986316.450886:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 759 00000100:00100000:2.0:1788986316.453883:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986316.453969:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971285760 00000100:00100000:1.0:1788986316.453978:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971285760 00000100:00100000:1.0:1788986316.454081:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 408 00000100:00100000:1.0:1788986316.454131:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46951:x1875885971285760:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986316.454503:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:46951:x1875885971285760:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 411us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986316.454520:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 408 00000100:00100000:2.0:1788986316.458991:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986316.459470:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971285888 00000100:00100000:0.0:1788986316.459480:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971285888 00000100:00100000:0.0:1788986316.459545:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 409 00000100:00100000:0.0:1788986316.459555:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46951:x1875885971285888:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986316.459905:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46951:x1875885971285888:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 350us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986316.459912:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 409 00000100:00100000:2.0:1788986316.462064:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986316.462248:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971286016 00000100:00100000:1.0:1788986316.462257:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971286016 00000100:00100000:1.0:1788986316.462301:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 760 00000100:00100000:1.0:1788986316.462311:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46951:x1875885971286016:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986316.462788:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46951:x1875885971286016:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 477us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986316.462796:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 760 00000100:00100000:2.0:1788986316.543429:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986316.543546:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971286144 00000100:00100000:3.0:1788986316.543556:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971286144 00000100:00100000:3.0:1788986316.543614:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 761 00000100:00100000:3.0:1788986316.543623:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:46955:x1875885971286144:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:3.0:1788986316.543653:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986316.543673:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5488b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1169 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.543727:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5488be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.543741:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5488be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.543757:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5488be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.543778:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5488c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.543787:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5488c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.543793:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5488c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544026:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544035:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544042:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986316.544068:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:3.0:1788986316.544072:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986316.544133:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544146:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5488be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544153:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5488be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544165:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5488be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544172:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986316.544176:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5488be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544184:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5488be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544195:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:3.0:1788986316.544199:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986316.544203:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5488be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544210:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5488be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544226:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5488c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544232:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5488c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544237:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5488c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544242:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986316.544245:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5488c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544255:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5488c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544262:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a55745000) 00010000:00010000:3.0:1788986316.544264:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986316.544267:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5488c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544272:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5488c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544302:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5488b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1169 expref: 13 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544316:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1169 expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.544323:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986316.544326:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986316.544328:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2a00, rc 0) 00000100:00100000:3.0:1788986316.544399:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46955:x1875885971286144:12345-192.168.206.21@tcp:101:dd.0 Request processed in 776us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986316.544406:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 761 00000100:00100000:3.0:1788986316.555406:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986316.555709:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971286400 00000100:00100000:0.0:1788986316.555723:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971286400 00000100:00100000:0.0:1788986316.555922:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 762 00000100:00100000:0.0:1788986316.555935:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:46955:x1875885971286400:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1788986316.555955:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986316.555974:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5488d3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1170 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556131:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5488da lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556149:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5488da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556160:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5488da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556175:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5488e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556183:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5488e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556189:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5488e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986316.556684:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x18:0x0], index 1: 0 00010000:00010000:0.0:1788986316.556857:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5488e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556868:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5488e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556876:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5488e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556908:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5488da lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556914:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5488da lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556921:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5488da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556927:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986316.556931:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5488da lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556937:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5488da lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556948:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:0.0:1788986316.556951:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986316.556955:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5488da lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.556961:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5488da lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986316.556974:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f03bd6a0 reply state 00000000d97baeb6 transno 4294967584 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5488e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986316.556982:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788986316.557012:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5488d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1170 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.557027:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5488e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1170 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.557034:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:0.0:1788986316.557037:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986316.557039:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efc00, rc 0) 00000100:00100000:0.0:1788986316.557154:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+15:46955:x1875885971286400:12345-192.168.206.21@tcp:101:dd.0 Request processed in 1221us (1772us total) trans 4294967584 rc 0/0 00000100:00100000:0.0:1788986316.557162:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 762 00010000:00010000:1.0:1788986316.560844:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5488e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986316.560860:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5488e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986316.560877:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5488e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986316.560883:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986316.560888:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5488e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986316.560897:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5488e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986316.560913:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a4823bf00) 00010000:00010000:1.0:1788986316.560917:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986316.560922:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5488e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986316.560928:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf5488e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986316.570854:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986316.571795:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971286528 00000100:00100000:0.0:1788986316.571808:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971286528 00000100:00100000:0.0:1788986316.571871:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 410 00000100:00100000:0.0:1788986316.571880:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:46955:x1875885971286528:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1788986316.571896:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986316.571913:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2ac2044/0xc20d828fcf5488f6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1177 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986316.571937:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788986316.571957:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=2100s v=(0 0) 00010000:00010000:0.0:1788986316.571962:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986316.571972:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ac2044/0xc20d828fcf5488f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1177 expref: 6 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.571990:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e2ac2044/0xc20d828fcf5488f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1177 expref: 6 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.572003:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef800, rc 0) 00000100:00100000:0.0:1788986316.572072:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:46955:x1875885971286528:12345-192.168.206.21@tcp:101:dd.0 Request processed in 192us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986316.572079:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 410 00000100:00100000:2.0:1788986316.605665:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986316.605769:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971286656 00000100:00100000:0.0:1788986316.605778:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971286656 00002000:00100000:0.0:1788986316.605825:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x18:0x0] (0->1048575) req@ffff9b0a760e7800 x1875885971286656/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:237/0 lens 488/0 e 0 to 0 dl 1788986327 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788986316.605844:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a760e7800 with x1875885971286656 ext(0->1048575) 00002000:00010000:0.0:1788986316.605850:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a760e7800 00000100:00100000:0.0:1788986316.605883:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:0.0:1788986316.605893:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971286656:12345-192.168.206.21@tcp:4:dd.0 00000100:00100000:1.0:1788986316.631849:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971286656:12345-192.168.206.21@tcp:4:dd.0 Request processed in 25947us (26183us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1788986316.631864:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00002000:00100000:1.0:1788986316.631877:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x18:0x0] (0->1048575) req@ffff9b0a760e7800 x1875885971286656/t4294967344(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:237/0 lens 488/448 e 0 to 0 dl 1788986327 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788986316.631888:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a760e7800 with x1875885971286656 ext(0->1048575) 00002000:00010000:1.0:1788986316.631894:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a760e7800 00000100:00100000:3.0:1788986316.636209:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986316.636341:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971286784 00000100:00100000:1.0:1788986316.636351:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971286784 00000100:00100000:1.0:1788986316.636407:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 763 00000100:00100000:1.0:1788986316.636416:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+14:46955:x1875885971286784:12345-192.168.206.21@tcp:44:dd.0 00000001:00080000:3.0:1788986316.701224:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967584 is committed 00000004:00080000:3.0:1788986316.701268:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 62 committed 00000100:00100000:3.0:1788986316.701380:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993503232:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788986316.701436:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986316.701503:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993503232 00000100:00100000:3.0:1788986316.701510:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993503232 00000100:00100000:3.0:1788986316.701555:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:3.0:1788986316.701563:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993503232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788986316.701586:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:24 count 1 00010000:00010000:3.0:1788986316.701607:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.701629:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54887f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d115b expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.701649:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788986316.701653:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986316.701658:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.701685:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54887f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d115b expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.701698:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54887f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d115b expref: 6 pid: 6695 timeout: 2200 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986316.701710:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875885993503360:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788986316.701760:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7977d840 going to sleep for 11 seconds 00000100:00080000:3.0:1788986316.701771:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986316.702054:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46955:x1875885971286784:12345-192.168.206.21@tcp:44:dd.0 Request processed in 65637us (65853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986316.702063:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 763 00000100:00100000:1.0:1788986316.708745:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875885993503360:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788986316.708774:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986316.708978:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986316.709331:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971286912 00000100:00100000:0.0:1788986316.709339:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971286912 00010000:00010000:0.0:1788986316.709378:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54887f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d115b expref: 7 pid: 6695 timeout: 2200 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986316.709417:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 376 00000100:00100000:0.0:1788986316.709427:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971286912:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986316.709441:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986316.709447:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54887f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d115b expref: 7 pid: 6695 timeout: 2200 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.709458:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54887f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d115b expref: 7 pid: 6695 timeout: 2200 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.709481:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54887f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d115b expref: 7 pid: 6695 timeout: 2200 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.709496:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986316.709500:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986316.709505:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.709516:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986316.709553:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986316.709609:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971286912:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 183us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986316.709616:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 376 00010000:00010000:1.0:1788986316.711564:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986316.711583:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986316.711595:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986316.711603:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986316.711628:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788986316.712190:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993503232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10625us (10751us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1788986316.712199:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1788986316.712662:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:3.0:1788986316.712836:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986316.712844:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.712854:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986316.712858:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.712881:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.712899:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.712907:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d6dd58b/0xc20d828fcf5488fd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986316.712927:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986316.712929:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986316.712931:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986316.712965:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a80d3ed80/2, rc 0, transno 4294967345 00000100:00100000:3.0:1788986316.712971:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993503232:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788986316.713036:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971287040 00000100:00100000:1.0:1788986316.713043:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971287040 00000100:00100000:1.0:1788986316.713117:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 412 00000100:00100000:1.0:1788986316.713127:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971287040:12345-192.168.206.21@tcp:16:dd.0 00010000:00010000:2.0:1788986316.742879:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788986316.782792:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967344 is committed 00000001:00080000:1.0:1788986316.782810:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967343 is committed 00000100:00100000:0.0:1788986316.783081:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971287040:12345-192.168.206.21@tcp:16:dd.0 Request processed in 69950us (70416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986316.783134:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 412 00000100:00100000:2.0:1788986316.794827:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986316.794925:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971287296 00000100:00100000:0.0:1788986316.794933:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971287296 00000100:00100000:0.0:1788986316.794989:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 77 00000100:00100000:0.0:1788986316.795000:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:46955:x1875885971287296:12345-192.168.206.21@tcp:35:dd.0 00000100:00100000:0.0:1788986316.795432:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:46955:x1875885971287296:12345-192.168.206.21@tcp:35:dd.0 Request processed in 434us (614us total) trans 4294967585 rc 0/0 00000100:00100000:0.0:1788986316.795440:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 77 00000100:00100000:0.0:1788986316.916423:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986316.916503:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971287424 00000100:00100000:3.0:1788986316.916513:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971287424 00000100:00100000:3.0:1788986316.916573:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1194 00000100:00100000:3.0:1788986316.916583:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971287424:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986316.916661:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971287424:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 79us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986316.916668:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1194 00010000:00010000:1.0:1788986317.765196:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986318.140657:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967585 is committed 00010000:00010000:0.0:1788986318.788744:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986318.850419:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986318.850441:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993503488:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986318.850511:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986318.850671:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993503488 00000100:00100000:0.0:1788986318.850679:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993503488 00000100:00100000:0.0:1788986318.850740:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 748 00000100:00100000:0.0:1788986318.850750:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993503488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986318.850785:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986318.850832:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993503488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986318.850838:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 748 00000100:00080000:2.0:1788986318.850889:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986318.850925:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993503488:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788986319.585258:0:80729:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2103488166018ns, next at 2100136713317ns, rc = 0 00000004:00080000:1.0:1788986319.585354:0:80729:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2103488264133ns, next at 2098704135758ns, rc = 0 00000004:00080000:3.0:1788986319.590599:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 63 committed 00000004:00080000:3.0:1788986319.590636:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 63 committed 00010000:00010000:1.0:1788986319.809739:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986319.882118:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993503616:0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.882182:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986319.882222:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993504128:0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.882248:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986319.882273:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986319.882279:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993504000:0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.882302:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986319.882329:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993504128 00000100:00100000:0.0:1788986319.882335:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993504128 00000100:00100000:0.0:1788986319.882383:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:0.0:1788986319.882391:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993504128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.882437:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993504128:12345-0@lo:400:kworker.0 Request processed in 47us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986319.882444:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00100000:0.0:1788986319.882470:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993504000 00000100:00100000:0.0:1788986319.882474:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993504000 00000100:00100000:0.0:1788986319.882498:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1788986319.882503:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993504000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.882531:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993504000:12345-0@lo:400:kworker.0 Request processed in 27us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986319.882536:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00080000:0.0:1788986319.882551:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986319.882760:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993504000:0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.882778:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993504128:0@lo:400:kworker.0 00000100:00100000:1.0:1788986319.886757:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993503616 00000100:00100000:1.0:1788986319.886769:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993503616 00000100:00100000:1.0:1788986319.886824:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:1.0:1788986319.886834:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993503616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986319.886917:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993503616:12345-0@lo:400:kworker.0 Request processed in 84us (4735us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986319.886923:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:0.0:1788986319.891813:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993503616:0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.893769:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993503872:0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.893833:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986319.893876:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788986319.893883:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993503744:0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.893906:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986319.893928:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993504256:0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.893951:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986319.893985:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993503872 00000100:00100000:0.0:1788986319.893992:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993503872 00000100:00100000:0.0:1788986319.894041:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993503744 00000100:00100000:0.0:1788986319.894044:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993503744 00000100:00100000:0.0:1788986319.894064:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1788986319.894071:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993503872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.894136:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993503872:12345-0@lo:400:kworker.0 Request processed in 65us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986319.894143:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1476 00000100:00100000:0.0:1788986319.894160:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1788986319.894166:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993503744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.894192:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993503744:12345-0@lo:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986319.894198:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:0.0:1788986319.894215:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993504256 00000100:00100000:0.0:1788986319.894218:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993504256 00000100:00100000:0.0:1788986319.894244:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:0.0:1788986319.894250:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993504256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.894279:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993504256:12345-0@lo:400:kworker.0 Request processed in 29us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986319.894284:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00080000:0.0:1788986319.894302:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986319.894306:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986319.894332:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993503744:0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.894342:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967343 gen 2 00000004:00080000:0.0:1788986319.894346:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b094268d180, transno 4294967343 00000100:00100000:0.0:1788986319.894356:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993504256:0@lo:400:kworker.0 00000100:00100000:0.0:1788986319.894366:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993503872:0@lo:400:kworker.0 00000001:00080000:2.0:1788986319.956223:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967344 is committed 00000001:00080000:2.0:1788986319.956238:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967345 is committed 00000100:00100000:0.0:1788986320.385776:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993504384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986320.385879:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986320.385973:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993504384 00000100:00100000:0.0:1788986320.385983:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993504384 00000100:00100000:0.0:1788986320.386046:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1788986320.386058:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993504384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986320.386124:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788986320.386181:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993504384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986320.386189:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 749 00000100:00100000:0.0:1788986320.386245:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993504384:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986320.832400:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986320.906934:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986320.907137:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971287552 00000100:00100000:1.0:1788986320.907151:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971287552 00000100:00100000:1.0:1788986320.907234:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 764 00000100:00100000:1.0:1788986320.907248:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47148:x1875885971287552:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986320.907373:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47148:x1875885971287552:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 128us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986320.907381:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 764 00000100:00080000:0.0:1788986320.907573:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986320.909689:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986320.909842:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971287680 00000100:00100000:1.0:1788986320.909852:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971287680 00000100:00100000:1.0:1788986320.909941:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 413 00000100:00100000:1.0:1788986320.909960:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47148:x1875885971287680:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986320.910520:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47148:x1875885971287680:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 568us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986320.910530:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 413 00000100:00080000:3.0:1788986320.910917:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986320.912472:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986320.912539:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971287808 00000100:00100000:0.0:1788986320.912609:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971287808 00000100:00100000:0.0:1788986320.912697:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 414 00000100:00100000:0.0:1788986320.912708:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47148:x1875885971287808:12345-192.168.206.21@tcp:19:lfs.0 00000100:00080000:3.0:1788986320.913147:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986320.913435:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47148:x1875885971287808:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 726us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986320.913446:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 414 00000100:00100000:3.0:1788986320.922832:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986320.922895:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971287936 00000100:00100000:1.0:1788986320.922908:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971287936 00000100:00100000:1.0:1788986320.922980:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 765 00000100:00100000:1.0:1788986320.922992:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47148:x1875885971287936:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986320.924340:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47148:x1875885971287936:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 1342us (1512us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986320.924359:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 765 00000100:00100000:3.0:1788986320.930313:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986320.930367:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971288064 00000100:00100000:2.0:1788986320.930380:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971288064 00000100:00100000:2.0:1788986320.930475:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 766 00000100:00100000:2.0:1788986320.930502:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47148:x1875885971288064:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986320.930657:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47148:x1875885971288064:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 170us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986320.930666:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 766 00000100:00100000:1.0:1788986320.938191:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986320.938257:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971288192 00000100:00100000:2.0:1788986320.938269:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971288192 00000100:00100000:2.0:1788986320.938341:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 415 00000100:00100000:2.0:1788986320.938352:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47148:x1875885971288192:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986320.940305:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47148:x1875885971288192:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 1942us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986320.940321:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 415 00000100:00100000:3.0:1788986320.943500:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986320.943836:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971288320 00000100:00100000:2.0:1788986320.943849:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971288320 00000100:00100000:2.0:1788986320.943965:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 416 00000100:00100000:2.0:1788986320.943978:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47148:x1875885971288320:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986320.944446:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47148:x1875885971288320:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 469us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986320.944456:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 416 00000100:00100000:3.0:1788986320.948832:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986320.948987:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971288448 00000100:00100000:1.0:1788986320.949000:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971288448 00000100:00100000:3.0:1788986320.949185:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 767 00000100:00100000:3.0:1788986320.949198:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47148:x1875885971288448:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986320.949818:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47148:x1875885971288448:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 622us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986320.949827:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 767 00000100:00100000:1.0:1788986321.008054:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986321.008369:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971288704 00000100:00100000:0.0:1788986321.008384:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971288704 00000100:00100000:1.0:1788986321.008674:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 768 00000100:00100000:1.0:1788986321.008687:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47152:x1875885971288704:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788986321.008752:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986321.008784:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5488e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1170 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.008806:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:1.0:1788986321.008817:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986321.008845:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548904 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.008861:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548904 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.008930:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548904 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.008957:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54890b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.008966:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54890b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.008974:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54890b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.011320:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548912 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.011342:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548912 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.011355:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548912 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986321.013741:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].24, 64 off9728 00000004:00080000:1.0:1788986321.013760:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2104916669837ns, next at 2105916666196ns, rc = 0 00010000:00010000:1.0:1788986321.013887:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548919 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.013907:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.013920:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548919 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.013930:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548919 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.013938:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548919 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.013944:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548919 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.013979:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986321.014010:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548912 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014018:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548912 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014025:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548912 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014032:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986321.014037:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548912 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014046:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548912 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014060:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff9b0a45316600) 00010000:00010000:1.0:1788986321.014063:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986321.014070:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548912 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014076:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548912 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014135:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548904 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014142:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548904 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014149:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548904 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014154:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986321.014157:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548904 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014164:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548904 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014172:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:1.0:1788986321.014175:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986321.014178:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548904 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986321.014183:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548904 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986321.014193:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002ea6a451 reply state 00000000a352ad2e transno 4294967586 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54890b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986321.014203:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788986321.014225:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986321.014235:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548919 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986321.014244:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986321.014249:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548919 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986321.014258:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548919 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986321.014270:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3f:0x0].0x0 (ffff9b0a45316600) 00010000:00010000:3.0:1788986321.014273:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986321.014277:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548919 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986321.014284:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548919 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986321.014306:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986321.014308:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986321.014311:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986321.014315:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:47152:x1875885971288704:12345-192.168.206.21@tcp:36:rm.0 Request processed in 5624us (6267us total) trans 4294967586 rc 0/0 00000100:00100000:1.0:1788986321.014327:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 768 00010000:00010000:0.0:1788986321.016516:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54890b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986321.016535:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54890b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986321.016543:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54890b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986321.016550:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986321.016555:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54890b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986321.016563:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54890b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986321.016579:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a45316400) 00010000:00010000:0.0:1788986321.016582:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986321.016588:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54890b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986321.016600:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54890b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986321.873726:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986322.034086:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986322.034223:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986322.034267:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971288960 00000100:00100000:2.0:1788986322.034280:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971288960 00000100:00100000:1.0:1788986322.034328:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986322.034361:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1478 00000100:00100000:2.0:1788986322.034373:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971288960:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986322.034477:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971288960:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 104us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986322.034485:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1478 00000100:00080000:2.0:1788986322.034513:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986322.034650:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971289216 00000100:00100000:0.0:1788986322.034655:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971289216 00000100:00100000:1.0:1788986322.034699:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986322.034723:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971288832 00000100:00100000:1.0:1788986322.034726:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971288832 00000100:00100000:1.0:1788986322.034754:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1196 00000100:00100000:1.0:1788986322.034762:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971288832:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986322.034789:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971288832:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986322.034796:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1196 00000100:00100000:0.0:1788986322.034910:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971289088 00000100:00100000:0.0:1788986322.034914:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971289088 00000100:00100000:0.0:1788986322.034937:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1069 00000100:00100000:0.0:1788986322.034945:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971289216:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986322.034976:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971289216:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986322.034983:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1069 00000100:00100000:0.0:1788986322.034998:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1070 00000100:00100000:0.0:1788986322.035004:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971289088:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986322.035029:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971289088:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986322.035034:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1070 00000100:00080000:2.0:1788986322.035122:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986322.035126:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788986322.882232:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986323.076585:0:80873:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2106979492586ns, next at 2100136713317ns, rc = 0 00000004:00080000:3.0:1788986323.076781:0:80873:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2106979691385ns, next at 2105916666196ns, rc = 0 00000001:00080000:1.0:1788986323.110621:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967586 is committed 00000004:00080000:1.0:1788986323.110640:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 64 committed 00000004:00080000:1.0:1788986323.110656:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 65 committed 00000004:00080000:1.0:1788986323.110661:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 64 committed 00000100:00100000:3.0:1788986323.110838:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986323.110855:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a457ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993504512:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788986323.110908:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986323.110965:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993504512 00000100:00100000:3.0:1788986323.110971:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993504512 00000100:00100000:3.0:1788986323.111015:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:3.0:1788986323.111022:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993504512:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788986323.111045:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:24 count 1 00010000:00010000:3.0:1788986323.111066:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.111110:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e2ac2044/0xc20d828fcf5488f6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1177 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.111125:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x18:0x0].0x0 since=7s v=(0 0) 00010000:00010000:3.0:1788986323.111130:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986323.111134:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.111158:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e2ac2044/0xc20d828fcf5488f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1177 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.111172:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e2ac2044/0xc20d828fcf5488f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1177 expref: 5 pid: 8478 timeout: 2207 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986323.111253:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a457afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875885993504640:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788986323.111301:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a41254e40 going to sleep for 11 seconds 00000100:00080000:2.0:1788986323.111431:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986323.116257:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a457afb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875885993504640:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788986323.116296:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986323.126622:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986323.127250:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971289344 00000100:00100000:3.0:1788986323.127264:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971289344 00010000:00010000:3.0:1788986323.127321:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e2ac2044/0xc20d828fcf5488f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1177 expref: 6 pid: 8478 timeout: 2207 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986323.127365:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 377 00000100:00100000:3.0:1788986323.127378:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971289344:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986323.127398:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986323.127677:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e2ac2044/0xc20d828fcf5488f6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1177 expref: 6 pid: 8478 timeout: 2207 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.127695:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e2ac2044/0xc20d828fcf5488f6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1177 expref: 6 pid: 8478 timeout: 2207 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.127727:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2ac2044/0xc20d828fcf5488f6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1177 expref: 6 pid: 8478 timeout: 2207 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.127748:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986323.127754:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986323.127761:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.127782:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.127826:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986323.128419:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971289344:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 1041us (1824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986323.128429:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 377 00010000:00010000:0.0:1788986323.128734:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986323.128749:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986323.128763:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986323.128774:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986323.128803:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788986323.130033:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993504512:12345-0@lo:6:osp-syn-1-0.0 Request processed in 19005us (19118us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1788986323.130045:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00010000:00010000:3.0:1788986323.130725:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986323.130736:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.130757:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986323.130762:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.130775:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.130799:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.130808:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf548920 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986323.130842:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986323.130856:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986323.130858:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986323.130910:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a457ad880/2, rc 0, transno 4294967345 00000100:00100000:3.0:1788986323.130926:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a457ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993504512:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788986323.906752:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986323.973492:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986323.973522:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993504768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986323.974284:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986323.974429:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993504768 00000100:00100000:1.0:1788986323.974442:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993504768 00000100:00100000:1.0:1788986323.974543:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 750 00000100:00100000:1.0:1788986323.974554:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993504768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986323.974617:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986323.974677:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993504768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986323.974684:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 750 00000100:00080000:3.0:1788986323.974832:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986323.974988:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967345 gen 2 00000004:00080000:0.0:1788986323.974997:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a80d3ed80, transno 4294967345 00000100:00100000:0.0:1788986323.975030:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993504768:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986324.929265:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986324.999782:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993505280:0@lo:400:kworker.0 00000100:00100000:3.0:1788986324.999802:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993505152:0@lo:400:kworker.0 00000100:00100000:3.0:1788986324.999884:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986324.999884:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986324.999903:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993504896:0@lo:400:kworker.0 00000100:00100000:2.0:1788986324.999964:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986325.000031:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993505024:0@lo:400:kworker.0 00000100:00100000:1.0:1788986325.000072:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986325.000153:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993505536:0@lo:400:kworker.0 00000100:00100000:1.0:1788986325.000179:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986325.000228:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993505152 00000100:00100000:1.0:1788986325.000238:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993505152 00000100:00100000:0.0:1788986325.000254:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993505280 00000100:00100000:0.0:1788986325.000260:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993505280 00000100:00100000:0.0:1788986325.000309:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993505536 00000100:00100000:1.0:1788986325.000312:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993505024 00000100:00100000:0.0:1788986325.000313:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993505536 00000100:00100000:1.0:1788986325.000319:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993505024 00000100:00100000:1.0:1788986325.000352:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:1.0:1788986325.000362:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993505152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986325.000419:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993505152:12345-0@lo:400:kworker.0 Request processed in 58us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986325.000430:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:1.0:1788986325.000451:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1480 00000100:00100000:1.0:1788986325.000457:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993505024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986325.000497:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993505024:12345-0@lo:400:kworker.0 Request processed in 39us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986325.000505:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1480 00000100:00100000:0.0:1788986325.000508:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:0.0:1788986325.000519:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993505280:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788986325.000528:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986325.000535:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986325.000538:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986325.000562:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993505280:12345-0@lo:400:kworker.0 Request processed in 46us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986325.000570:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:1.0:1788986325.000585:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993505024:0@lo:400:kworker.0 00000100:00100000:0.0:1788986325.000588:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:0.0:1788986325.000610:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993505536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986325.000652:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993505536:12345-0@lo:400:kworker.0 Request processed in 43us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986325.000659:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:1.0:1788986325.000666:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993505536:0@lo:400:kworker.0 00000100:00100000:0.0:1788986325.000693:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993505280:0@lo:400:kworker.0 00000100:00100000:1.0:1788986325.000707:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993504896 00000100:00100000:1.0:1788986325.000713:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993504896 00000100:00100000:0.0:1788986325.000736:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993505408:0@lo:400:kworker.0 00000100:00100000:1.0:1788986325.000750:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1788986325.000759:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993504896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986325.000767:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986325.000805:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993504896:12345-0@lo:400:kworker.0 Request processed in 47us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986325.000811:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993504896:0@lo:400:kworker.0 00000100:00100000:1.0:1788986325.000816:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1197 00000100:00100000:1.0:1788986325.000858:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993505408 00000100:00100000:1.0:1788986325.000862:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993505408 00000100:00100000:3.0:1788986325.002962:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993505152:0@lo:400:kworker.0 00000100:00080000:3.0:1788986325.003138:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986325.003348:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:3.0:1788986325.003362:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993505408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986325.003957:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993505408:12345-0@lo:400:kworker.0 Request processed in 598us (3188us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986325.003966:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1788986325.004139:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993505408:0@lo:400:kworker.0 00000100:00100000:0.0:1788986325.519381:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a457ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993505664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986325.519495:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986325.526853:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993505664 00000100:00100000:2.0:1788986325.526871:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993505664 00000100:00100000:0.0:1788986325.530378:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 751 00000100:00100000:0.0:1788986325.530396:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993505664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986325.530450:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788986325.531181:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993505664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 787us (11682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986325.531192:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 751 00000100:00100000:3.0:1788986325.537409:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a457ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993505664:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986325.952230:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986326.128226:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967345 is committed 00010000:00010000:3.0:1788986326.976218:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986327.155357:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986327.155402:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986327.155433:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986327.155467:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986327.155550:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971289728 00000100:00100000:0.0:1788986327.155574:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971289728 00000100:00100000:0.0:1788986327.155646:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971289856 00000100:00100000:0.0:1788986327.155649:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971289856 00000100:00100000:0.0:1788986327.155672:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1073 00000100:00100000:0.0:1788986327.155681:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971289728:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986327.155767:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971289728:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 86us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986327.155778:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1073 00000100:00100000:0.0:1788986327.155794:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1074 00000100:00100000:0.0:1788986327.155801:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971289856:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986327.155827:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971289856:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986327.155833:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1074 00000100:00080000:1.0:1788986327.155989:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986327.155993:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986327.156145:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971289600 00000100:00100000:3.0:1788986327.156150:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971289600 00000100:00100000:3.0:1788986327.156202:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1482 00000100:00100000:3.0:1788986327.156209:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971289600:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986327.156245:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971289600:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986327.156250:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1482 00000100:00080000:1.0:1788986327.156302:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986327.156487:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971289472 00000100:00100000:2.0:1788986327.156505:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971289472 00000100:00100000:2.0:1788986327.156540:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1198 00000100:00100000:2.0:1788986327.156548:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971289472:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986327.156823:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971289472:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 274us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986327.156830:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1198 00010000:00010000:3.0:1788986328.000212:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986329.024294:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986329.088528:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993505792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986329.088604:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986329.088938:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993505792 00000100:00100000:0.0:1788986329.088950:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993505792 00000100:00100000:0.0:1788986329.089016:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 752 00000100:00100000:0.0:1788986329.089025:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993505792:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986329.089162:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788986329.089311:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986329.089470:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993505792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 445us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986329.089478:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 752 00000100:00100000:3.0:1788986329.107806:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993505792:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986330.054410:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986330.113554:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993506048:0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.113628:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986330.113681:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993506560:0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.113705:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986330.113731:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788986330.113738:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993505920:0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.113763:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986330.113787:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993506432:0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.113807:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986330.113833:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993506048 00000100:00100000:2.0:1788986330.113840:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993506048 00000100:00100000:2.0:1788986330.113876:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993506432 00000100:00100000:2.0:1788986330.113880:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993506432 00000100:00100000:2.0:1788986330.113906:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1788986330.113915:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993506048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.113961:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993506048:12345-0@lo:400:kworker.0 Request processed in 47us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986330.113967:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1788986330.113982:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1484 00000100:00100000:2.0:1788986330.113988:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993506432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.114015:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993506432:12345-0@lo:400:kworker.0 Request processed in 28us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986330.114020:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1484 00000100:00100000:2.0:1788986330.114042:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993506560 00000100:00100000:2.0:1788986330.114045:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993506560 00000100:00100000:2.0:1788986330.114072:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1788986330.114078:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993506560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.114128:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993506560:12345-0@lo:400:kworker.0 Request processed in 50us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986330.114134:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1788986330.114150:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993505920 00000100:00100000:2.0:1788986330.114153:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993505920 00000100:00100000:2.0:1788986330.114176:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1788986330.114182:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993505920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.114210:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993505920:12345-0@lo:400:kworker.0 Request processed in 28us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986330.114215:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00080000:2.0:1788986330.114242:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986330.114246:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986330.114276:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993505920:0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.114288:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993506432:0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.114297:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993506048:0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.114304:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967345 gen 2 00000004:00080000:2.0:1788986330.114309:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a457ad880, transno 4294967345 00000100:00100000:2.0:1788986330.114317:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993506560:0@lo:400:kworker.0 00000100:00100000:3.0:1788986330.114638:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993506176:0@lo:400:kworker.0 00000100:00100000:3.0:1788986330.114669:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986330.114700:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986330.114707:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993506304:0@lo:400:kworker.0 00000100:00100000:3.0:1788986330.114728:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986330.114763:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993506176 00000100:00100000:3.0:1788986330.114767:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993506176 00000100:00100000:3.0:1788986330.114795:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:3.0:1788986330.114800:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993506176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986330.114835:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993506176:12345-0@lo:400:kworker.0 Request processed in 35us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986330.114841:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:3.0:1788986330.115182:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993506176:0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.115300:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993506304 00000100:00100000:2.0:1788986330.115305:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993506304 00000100:00100000:2.0:1788986330.115775:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1788986330.115785:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993506304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.115837:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993506304:12345-0@lo:400:kworker.0 Request processed in 54us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986330.115844:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00080000:3.0:1788986330.120145:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986330.120294:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993506304:0@lo:400:kworker.0 00000100:00100000:2.0:1788986330.626258:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a457ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993506688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986330.626342:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986330.626531:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993506688 00000100:00100000:3.0:1788986330.626539:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993506688 00000100:00100000:3.0:1788986330.626605:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1788986330.626615:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993506688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986330.626651:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986330.626705:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993506688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986330.626711:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 753 00000100:00100000:3.0:1788986330.626761:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a457ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993506688:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986331.073475:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986332.096262:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986332.272135:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986332.272186:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986332.272224:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986332.272279:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986332.272311:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971290368 00000100:00100000:1.0:1788986332.272320:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971290368 00000100:00100000:0.0:1788986332.272340:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971290240 00000100:00100000:0.0:1788986332.272344:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971290240 00000100:00100000:2.0:1788986332.272410:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971290112 00000100:00100000:2.0:1788986332.272415:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971290112 00000100:00100000:2.0:1788986332.272461:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1486 00000100:00100000:2.0:1788986332.272470:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971290112:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986332.272541:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971290112:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986332.272548:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1486 00000100:00100000:1.0:1788986332.272883:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1077 00000100:00100000:1.0:1788986332.272894:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971290368:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986332.272933:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971290368:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 42us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986332.272939:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1077 00000100:00100000:1.0:1788986332.272954:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1078 00000100:00100000:1.0:1788986332.272960:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971290240:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986332.272983:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971290240:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986332.272989:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1078 00000100:00100000:3.0:1788986332.273239:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971289984 00000100:00100000:3.0:1788986332.273246:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971289984 00000100:00100000:3.0:1788986332.273275:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1200 00000100:00100000:3.0:1788986332.273283:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971289984:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986332.273310:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971289984:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986332.273316:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1200 00000100:00080000:3.0:1788986332.273343:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986332.273348:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986332.273350:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788986333.120229:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986334.144575:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986334.208440:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986334.208471:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993506816:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986334.208568:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986334.208986:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993506816 00000100:00100000:0.0:1788986334.208996:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993506816 00000100:00100000:0.0:1788986334.209075:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 754 00000100:00100000:0.0:1788986334.209086:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993506816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986334.209155:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986334.209222:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993506816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986334.209229:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 754 00000100:00100000:1.0:1788986334.209400:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993506816:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986334.209465:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986335.168299:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986335.234171:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993507072:0@lo:400:kworker.0 00000100:00100000:2.0:1788986335.234236:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993507328:0@lo:400:kworker.0 00000100:00100000:3.0:1788986335.234253:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986335.234330:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993506944:0@lo:400:kworker.0 00000100:00100000:0.0:1788986335.234437:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993507200:0@lo:400:kworker.0 00000100:00100000:3.0:1788986335.238083:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993507584:0@lo:400:kworker.0 00000100:00100000:3.0:1788986335.238603:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986335.238661:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993507072 00000100:00100000:3.0:1788986335.238669:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993507072 00000100:00100000:3.0:1788986335.238710:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1788986335.238718:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993507072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986335.238763:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993507072:12345-0@lo:400:kworker.0 Request processed in 46us (4513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986335.238770:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00100000:3.0:1788986335.238808:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993507072:0@lo:400:kworker.0 00000100:00100000:3.0:1788986335.238845:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993507584 00000100:00100000:3.0:1788986335.238849:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993507584 00000100:00100000:3.0:1788986335.238884:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:3.0:1788986335.238890:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993507584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986335.238921:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993507584:12345-0@lo:400:kworker.0 Request processed in 32us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986335.238926:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00080000:3.0:1788986335.238943:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986335.238957:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993507584:0@lo:400:kworker.0 00000100:00100000:1.0:1788986335.239301:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986335.239346:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993507456:0@lo:400:kworker.0 00000100:00100000:3.0:1788986335.239359:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993506944 00000100:00100000:3.0:1788986335.239364:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993506944 00000100:00100000:1.0:1788986335.239380:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986335.239391:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1201 00000100:00100000:3.0:1788986335.239400:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993506944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986335.239443:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993507456 00000100:00100000:3.0:1788986335.239447:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993506944:12345-0@lo:400:kworker.0 Request processed in 47us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986335.239450:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993507456 00000100:00100000:3.0:1788986335.239455:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1201 00000100:00080000:3.0:1788986335.239492:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986335.239503:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1488 00000100:00100000:1.0:1788986335.239513:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993507456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986335.239561:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993507456:12345-0@lo:400:kworker.0 Request processed in 50us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986335.239567:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1488 00000100:00100000:1.0:1788986335.239600:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993506944:0@lo:400:kworker.0 00000100:00100000:1.0:1788986335.239609:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993507456:0@lo:400:kworker.0 00000100:00100000:2.0:1788986335.250784:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986335.250873:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993507328 00000100:00100000:1.0:1788986335.250887:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993507328 00000100:00100000:1.0:1788986335.250966:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:1.0:1788986335.250978:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993507328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986335.251078:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993507328:12345-0@lo:400:kworker.0 Request processed in 103us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986335.251086:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:2.0:1788986335.251430:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993507328:0@lo:400:kworker.0 00000100:00100000:0.0:1788986335.253621:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986335.253730:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993507200 00000100:00100000:3.0:1788986335.253739:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993507200 00000100:00100000:3.0:1788986335.253804:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:3.0:1788986335.253813:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993507200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986335.253876:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993507200:12345-0@lo:400:kworker.0 Request processed in 64us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986335.253882:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:2.0:1788986335.254339:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993507200:0@lo:400:kworker.0 00000100:00080000:0.0:1788986335.257260:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986335.748507:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a457aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993507712:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986335.748591:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986335.748727:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993507712 00000100:00100000:3.0:1788986335.748735:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993507712 00000100:00100000:3.0:1788986335.748785:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 755 00000100:00100000:3.0:1788986335.748795:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993507712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986335.748828:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986335.748878:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993507712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986335.748885:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 755 00000100:00100000:1.0:1788986335.748979:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a457aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993507712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986336.192257:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986337.216245:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986337.398799:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986337.398844:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986337.398927:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971290624 00000100:00100000:0.0:1788986337.398937:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971290624 00000100:00100000:0.0:1788986337.399024:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1490 00000100:00100000:0.0:1788986337.399033:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971290624:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986337.399127:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971290624:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 95us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986337.399135:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1490 00000100:00080000:1.0:1788986337.399439:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986337.400514:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971290496 00000100:00100000:3.0:1788986337.400540:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971290496 00000100:00100000:1.0:1788986337.400709:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986337.400783:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1202 00000100:00100000:3.0:1788986337.400794:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971290496:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986337.400913:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971290880 00000100:00100000:2.0:1788986337.400918:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971290880 00000100:00100000:2.0:1788986337.400970:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1081 00000100:00100000:2.0:1788986337.400978:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971290880:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986337.401034:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971290496:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 241us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986337.401042:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1202 00000100:00080000:3.0:1788986337.401086:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986337.409153:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971290880:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 8163us (8433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986337.409167:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1081 00000100:00100000:0.0:1788986337.411911:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986337.412605:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971290752 00000100:00100000:2.0:1788986337.412615:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971290752 00000100:00100000:2.0:1788986337.412692:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1082 00000100:00100000:2.0:1788986337.412702:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971290752:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986337.412770:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971290752:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986337.412777:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1082 00000100:00080000:0.0:1788986337.420688:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986338.240312:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986339.267980:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986339.330309:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993507840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986339.330375:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986339.330527:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993507840 00000100:00100000:3.0:1788986339.330535:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993507840 00000100:00100000:3.0:1788986339.330601:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1788986339.330610:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993507840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986339.330645:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986339.330694:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993507840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986339.330702:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 756 00000100:00100000:3.0:1788986339.330759:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993507840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986339.330942:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986340.288602:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986340.356157:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993507968:0@lo:400:kworker.0 00000100:00100000:2.0:1788986340.356228:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986340.356336:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993507968 00000100:00100000:3.0:1788986340.356345:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993507968 00000100:00100000:3.0:1788986340.356396:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:3.0:1788986340.356406:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993507968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986340.357895:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993508096:0@lo:400:kworker.0 00000100:00100000:0.0:1788986340.357943:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986340.357991:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993508096 00000100:00100000:0.0:1788986340.357996:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993508096 00000100:00100000:0.0:1788986340.358032:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1788986340.358040:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993508096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986340.358081:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993508096:12345-0@lo:400:kworker.0 Request processed in 41us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986340.358126:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1788986340.358164:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993508096:0@lo:400:kworker.0 00000100:00100000:3.0:1788986340.370656:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993507968:12345-0@lo:400:kworker.0 Request processed in 14241us (14417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986340.370671:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00100000:2.0:1788986340.371377:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f433100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993507968:0@lo:400:kworker.0 00000100:00100000:2.0:1788986340.372986:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993508224:0@lo:400:kworker.0 00000100:00100000:2.0:1788986340.373054:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986340.373450:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993508224 00000100:00100000:3.0:1788986340.373459:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993508224 00000100:00100000:3.0:1788986340.373551:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1492 00000100:00100000:3.0:1788986340.373563:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993508224:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788986340.373645:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986340.375531:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993508352:0@lo:400:kworker.0 00000100:00100000:0.0:1788986340.375610:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986340.375669:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993508352 00000100:00100000:0.0:1788986340.375676:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993508352 00000100:00100000:0.0:1788986340.375721:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1788986340.375730:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4510b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993508352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986340.375775:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4510b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993508352:12345-0@lo:400:kworker.0 Request processed in 47us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986340.375782:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1788986340.375839:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993508352:0@lo:400:kworker.0 00000100:00100000:3.0:1788986340.378741:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993508224:12345-0@lo:400:kworker.0 Request processed in 5173us (5678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986340.378754:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1492 00000100:00100000:0.0:1788986340.379392:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993508608:0@lo:400:kworker.0 00000100:00100000:0.0:1788986340.379447:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986340.379484:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986340.379490:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993508480:0@lo:400:kworker.0 00000100:00100000:0.0:1788986340.379528:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986340.379559:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993508480 00000100:00100000:0.0:1788986340.379566:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993508480 00000100:00100000:0.0:1788986340.379612:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1788986340.379621:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4510b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993508480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986340.379669:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4510b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993508480:12345-0@lo:400:kworker.0 Request processed in 50us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986340.379676:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00080000:0.0:1788986340.379695:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986340.379733:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993508480:0@lo:400:kworker.0 00000100:00100000:1.0:1788986340.379958:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993508608 00000100:00100000:1.0:1788986340.379964:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993508608 00000100:00100000:1.0:1788986340.380017:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1788986340.380025:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993508608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986340.380068:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993508608:12345-0@lo:400:kworker.0 Request processed in 44us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986340.380074:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1788986340.380139:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993508608:0@lo:400:kworker.0 00000100:00080000:0.0:1788986340.380351:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986340.380954:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993508224:0@lo:400:kworker.0 00000100:00100000:1.0:1788986340.751951:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986340.751987:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971291008 00000100:00100000:1.0:1788986340.751996:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971291008 00000100:00100000:1.0:1788986340.752054:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 769 00000100:00100000:1.0:1788986340.752064:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47410:x1875885971291008:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986340.752175:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47410:x1875885971291008:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 112us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986340.752183:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 769 00000100:00080000:1.0:1788986340.752204:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986340.760622:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986340.776223:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971291136 00000100:00100000:3.0:1788986340.776237:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971291136 00000100:00100000:3.0:1788986340.776319:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 418 00000100:00100000:3.0:1788986340.776330:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47410:x1875885971291136:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986340.776700:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47410:x1875885971291136:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 371us (16084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986340.776708:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 418 00000100:00080000:1.0:1788986340.776877:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986340.785536:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986340.785570:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971291264 00000100:00100000:1.0:1788986340.785578:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971291264 00000100:00100000:1.0:1788986340.785631:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 419 00000100:00100000:1.0:1788986340.785641:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47410:x1875885971291264:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986340.785980:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f432d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47410:x1875885971291264:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 339us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986340.785988:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 419 00000100:00080000:1.0:1788986340.786011:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986340.789484:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986340.789619:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971291392 00000100:00100000:0.0:1788986340.789628:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971291392 00000100:00100000:0.0:1788986340.789684:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 770 00000100:00100000:0.0:1788986340.789693:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47410:x1875885971291392:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986340.790333:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f433b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47410:x1875885971291392:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 639us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986340.790342:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 770 00000100:00100000:1.0:1788986340.809908:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986340.810068:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971291520 00000100:00100000:0.0:1788986340.810109:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971291520 00000100:00100000:0.0:1788986340.810161:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 771 00000100:00100000:0.0:1788986340.810176:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47410:x1875885971291520:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986340.810264:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47410:x1875885971291520:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 93us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986340.810271:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 771 00000100:00100000:1.0:1788986340.813298:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986340.813380:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971291648 00000100:00100000:3.0:1788986340.813390:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971291648 00000100:00100000:3.0:1788986340.813447:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 420 00000100:00100000:3.0:1788986340.813457:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47410:x1875885971291648:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986340.813791:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47410:x1875885971291648:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 335us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986340.813811:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 420 00000100:00100000:3.0:1788986340.819045:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986340.819200:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971291776 00000100:00100000:1.0:1788986340.819208:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971291776 00000100:00100000:1.0:1788986340.819255:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 421 00000100:00100000:1.0:1788986340.819266:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47410:x1875885971291776:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986340.821730:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47410:x1875885971291776:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 2457us (2685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986340.821742:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 421 00000100:00100000:0.0:1788986340.825931:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986340.826481:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971291904 00000100:00100000:2.0:1788986340.826490:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971291904 00000100:00100000:2.0:1788986340.826556:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 772 00000100:00100000:2.0:1788986340.826567:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47410:x1875885971291904:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986340.826988:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47410:x1875885971291904:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 421us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986340.826996:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 772 00000100:00100000:1.0:1788986340.866664:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993508736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986340.866740:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986340.866818:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993508736 00000100:00100000:1.0:1788986340.866825:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993508736 00000100:00100000:1.0:1788986340.866869:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1788986340.866878:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993508736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986340.866910:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986340.866959:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993508736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986340.866966:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 757 00000100:00100000:1.0:1788986340.867014:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f431c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993508736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986341.313294:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986342.337248:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986342.513417:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986342.513445:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986342.513484:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986342.513520:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986342.513549:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971292416 00000100:00100000:0.0:1788986342.513551:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971292032 00000100:00100000:2.0:1788986342.513560:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971292416 00000100:00100000:0.0:1788986342.513560:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971292032 00000100:00100000:0.0:1788986342.513618:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1204 00000100:00100000:2.0:1788986342.513622:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971292288 00000100:00100000:2.0:1788986342.513627:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971292288 00000100:00100000:0.0:1788986342.513631:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971292032:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986342.513654:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1085 00000100:00100000:2.0:1788986342.513665:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971292416:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986342.513701:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971292032:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 73us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986342.513705:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971292416:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986342.513715:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1204 00000100:00100000:2.0:1788986342.513720:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1085 00000100:00100000:2.0:1788986342.513741:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1086 00000100:00100000:2.0:1788986342.513749:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971292288:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986342.513776:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971292288:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986342.513783:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1086 00000100:00100000:1.0:1788986342.514066:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971292160 00000100:00100000:1.0:1788986342.514072:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971292160 00000100:00100000:1.0:1788986342.514150:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1494 00000100:00100000:1.0:1788986342.514159:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4510a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971292160:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986342.514191:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4510a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971292160:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986342.514198:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1494 00000100:00080000:1.0:1788986342.514219:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986342.514224:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986342.514226:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986342.922078:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986342.922268:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971292544 00000100:00100000:3.0:1788986342.922287:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971292544 00000100:00100000:3.0:1788986342.922345:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 773 00000100:00100000:3.0:1788986342.922356:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47424:x1875885971292544:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986342.922376:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986342.922405:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548927 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d117e expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986342.922462:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54892e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986342.922474:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54892e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986342.922486:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54892e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986342.922528:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:3.0:1788986342.922532:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986342.922551:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54892e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986342.922574:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548927 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d117e expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986342.922592:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54892e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d117e expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986342.922599:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986342.922603:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986342.922606:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2c00, rc 0) 00000100:00100000:3.0:1788986342.922655:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47424:x1875885971292544:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 301us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986342.922666:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 773 00000100:00100000:0.0:1788986342.944148:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986342.944217:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971292800 00000100:00100000:1.0:1788986342.944226:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971292800 00000100:00100000:1.0:1788986342.944281:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 774 00000100:00100000:1.0:1788986342.944291:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4510ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47424:x1875885971292800:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986342.944335:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986342.944359:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54892e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d117e expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986342.944378:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5488cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1169 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986342.944388:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:1.0:1788986342.944398:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986342.944420:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548935 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986342.944432:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986342.944442:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788986343.043936:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967587 is committed 00000004:00010000:2.0:1788986343.045346:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000052c03687 reply state 00000000262eaaea transno 4294967587 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986343.045404:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986343.045427:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00010000:00080000:2.0:1788986343.045617:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788986343.045646:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4510ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47424:x1875885971292800:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 101348us (101498us total) trans 4294967587 rc 0/0 00000100:00100000:2.0:1788986343.045658:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 774 00010000:00010000:2.0:1788986343.045727:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548935 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.045737:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548935 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.045750:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548935 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.045764:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986343.045770:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548935 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.045789:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548935 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.045810:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:2.0:1788986343.045814:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986343.045821:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548935 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.045830:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548935 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986343.156437:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986343.156553:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971292928 00000100:00100000:2.0:1788986343.156567:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971292928 00000100:00100000:2.0:1788986343.156650:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 775 00000100:00100000:2.0:1788986343.156671:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4510bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47428:x1875885971292928:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986343.156694:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986343.156714:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54893c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1185 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.156776:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548943 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.156790:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.156803:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.156818:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54894a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.156825:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54894a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.156832:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54894a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157173:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548951 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157182:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157190:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986343.157212:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:2.0:1788986343.157216:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986343.157236:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548951 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157246:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548943 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157253:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548943 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157259:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548943 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157268:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986343.157272:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548943 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157279:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548943 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157290:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:2.0:1788986343.157293:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986343.157298:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548943 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157304:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548943 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157315:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54894a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157321:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54894a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157327:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54894a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157331:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986343.157334:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54894a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157340:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54894a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157352:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a45acab00) 00010000:00010000:2.0:1788986343.157354:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986343.157357:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54894a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157362:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54894a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157393:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54893c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1185 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157406:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548951 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1185 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.157413:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986343.157416:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986343.157418:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986343.157486:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4510bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47428:x1875885971292928:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 817us (1062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986343.157505:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 775 00000100:00100000:3.0:1788986343.162849:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986343.162993:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971293184 00000100:00100000:2.0:1788986343.163003:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971293184 00000100:00100000:2.0:1788986343.163061:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 776 00000100:00100000:2.0:1788986343.163071:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47428:x1875885971293184:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986343.163120:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986343.163139:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf548958 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d118c expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.163386:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54895f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.163400:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54895f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.163410:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54895f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.163422:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548966 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.163429:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.163435:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986343.164159:0:7899:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x19:0x0], index 0: 0 00010000:00010000:2.0:1788986343.164405:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54896d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.164416:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54896d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.164424:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54896d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.164452:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54895f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.164463:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54895f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.164469:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54895f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.164475:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986343.164480:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54895f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.164487:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54895f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.164509:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986343.164512:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986343.164517:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54895f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.164523:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54895f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986343.164536:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ad2e6310 reply state 0000000056138829 transno 4294967588 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986343.164543:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986343.164569:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf548958 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d118c expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.164582:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54896d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d118c expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.164595:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986343.164597:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986343.164600:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0600, rc 0) 00000100:00100000:2.0:1788986343.164665:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:47428:x1875885971293184:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 1595us (1823us total) trans 4294967588 rc 0/0 00000100:00100000:2.0:1788986343.164673:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 776 00010000:00010000:2.0:1788986343.168787:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548966 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.168802:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548966 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.168810:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548966 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.168817:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986343.168822:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548966 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.168829:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548966 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.168843:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a45aca400) 00010000:00010000:2.0:1788986343.168846:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986343.168851:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548966 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.168857:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548966 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986343.171481:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986343.171589:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971293440 00000100:00100000:2.0:1788986343.171598:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971293440 00000100:00100000:2.0:1788986343.171665:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 777 00000100:00100000:2.0:1788986343.171676:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:47428:x1875885971293440:12345-192.168.206.21@tcp:36:touch.60003 00010000:00010000:2.0:1788986343.171726:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986343.171750:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54896d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d118c expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.171769:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986343.171779:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986343.171816:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54897b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.171829:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54897b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.171839:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54897b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986343.171978:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000092934a33 reply state 000000004d15d219 transno 4294967589 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54897b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986343.171988:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986343.172070:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:47428:x1875885971293440:12345-192.168.206.21@tcp:36:touch.60003 Request processed in 396us (597us total) trans 4294967589 rc 0/0 00000100:00100000:2.0:1788986343.172078:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 777 00010000:00010000:1.0:1788986343.174564:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54897b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.174585:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54897b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.174594:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54897b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.174601:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986343.174608:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54897b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.174617:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54897b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.174636:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:1.0:1788986343.174640:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986343.174645:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54897b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.174652:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54897b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986343.175720:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986343.175802:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971293568 00000100:00100000:1.0:1788986343.175814:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971293568 00000100:00100000:1.0:1788986343.176042:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 778 00000100:00100000:1.0:1788986343.176056:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:47428:x1875885971293568:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:1.0:1788986343.176200:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986343.176230:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548982 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1193 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.176426:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548982 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1193 expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.176443:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548982 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x40:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1193 expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.176467:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788986343.176470:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788986343.176474:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986343.176616:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:47428:x1875885971293568:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 562us (902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986343.176624:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 778 00000100:00100000:0.0:1788986343.191623:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986343.192223:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971293696 00000100:00100000:1.0:1788986343.192241:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971293696 00000100:00100000:1.0:1788986343.192343:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 422 00000100:00100000:1.0:1788986343.192355:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a76789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971293696:12345-192.168.206.21@tcp:2:touch.60003 00000100:00100000:1.0:1788986343.192826:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a76789450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971293696:12345-192.168.206.21@tcp:2:touch.60003 Request processed in 471us (1209us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788986343.192835:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 422 00000100:00100000:1.0:1788986343.199886:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986343.202460:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971293952 00000100:00100000:0.0:1788986343.202485:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971293952 00000100:00100000:0.0:1788986343.202581:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:0.0:1788986343.202593:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:47428:x1875885971293952:12345-192.168.206.21@tcp:35:touch.60003 00000100:00100000:1.0:1788986343.205958:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:47428:x1875885971293952:12345-192.168.206.21@tcp:35:touch.60003 Request processed in 3354us (6073us total) trans 4294967590 rc 0/0 00000100:00100000:1.0:1788986343.205974:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 78 00000100:00100000:3.0:1788986343.291082:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986343.291759:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971294080 00000100:00100000:0.0:1788986343.291776:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971294080 00000100:00100000:0.0:1788986343.291859:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 779 00000100:00100000:0.0:1788986343.291871:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:47432:x1875885971294080:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:0.0:1788986343.291904:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986343.291930:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548989 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d119a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292006:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548990 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292024:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548990 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292038:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548990 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292053:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548997 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292060:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292065:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292204:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54899e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292215:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54899e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292223:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54899e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986343.292264:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x40:0x0]: returning size 0 00000004:00200000:0.0:1788986343.292269:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986343.292305:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54899e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292319:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54899e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292327:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548990 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292334:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548990 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292341:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548990 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292348:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986343.292353:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548990 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292361:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548990 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292375:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:0.0:1788986343.292379:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986343.292385:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548990 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292391:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548990 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292409:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548997 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292415:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548997 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292421:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548997 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292427:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986343.292430:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548997 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292436:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548997 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292443:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a4823bd00) 00010000:00010000:0.0:1788986343.292446:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986343.292449:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548997 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292454:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548997 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292487:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548989 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d119a expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292514:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54899e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d119a expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.292520:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:0.0:1788986343.292523:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986343.292526:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efe00, rc 0) 00000100:00100000:0.0:1788986343.292725:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:47432:x1875885971294080:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 855us (1650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986343.292734:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 779 00000100:00100000:1.0:1788986343.299599:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986343.300763:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971294208 00000100:00100000:2.0:1788986343.300779:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971294208 00000100:00100000:2.0:1788986343.300865:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 423 00000100:00100000:2.0:1788986343.300877:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971294208:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:2.0:1788986343.300901:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986343.300928:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4ec7afc/0xc20d828fcf5489a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11a1 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788986343.300962:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x6aa1c3e6, atime: 0x6aa1c3e6, ctime: 0x6aa1c3e6, blocks: 0x1 00010000:00010000:2.0:1788986343.300990:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=2127s v=(0 0) 00010000:00010000:2.0:1788986343.300995:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986343.301006:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4ec7afc/0xc20d828fcf5489a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11a1 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.301029:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c4ec7afc/0xc20d828fcf5489a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11a1 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.301044:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0600, rc 0) 00000100:00100000:2.0:1788986343.301176:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f431f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971294208:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 300us (1602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986343.301184:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 423 00000100:00100000:1.0:1788986343.313664:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986343.313769:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971294464 00000100:00100000:0.0:1788986343.313786:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971294464 00000100:00100000:0.0:1788986343.313872:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 780 00000100:00100000:0.0:1788986343.313884:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:47432:x1875885971294464:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:0.0:1788986343.313947:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986343.313981:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54899e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x40:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d119a expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.314009:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548982 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x40:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1193 expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.314025:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:0.0:1788986343.314038:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986343.314066:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5489ac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.314081:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5489ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.314163:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5489ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.314181:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5489b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.314189:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5489b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.314195:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5489b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.314534:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5489ba lrc: 3/0,1 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.314544:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5489ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986343.314551:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5489ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986343.318946:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].25, 64 off9792 00000004:00080000:1.0:1788986343.318972:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2127221882666ns, next at 2128221877784ns, rc = 0 00010000:00010000:1.0:1788986343.319446:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489c1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.319470:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.319485:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489c1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.319510:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.319517:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489c1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.319522:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.319547:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986343.319619:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986343.319633:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.319642:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5489ba lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.319651:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5489ba lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.319841:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5489ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986343.321557:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986343.321568:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489c1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986343.321582:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489c1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986343.321600:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9b0a4823be00) 00010000:00010000:3.0:1788986343.321603:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986343.321607:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489c1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986343.321614:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489c1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x40:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986343.321636:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986343.321638:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986343.321641:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986343.322237:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986343.322250:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5489ba lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.322263:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5489ba lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.322280:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x40:0x0].0x0 (ffff9b0a4823be00) 00010000:00010000:1.0:1788986343.322283:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986343.322636:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5489ba lrc: 2/0,0 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.322651:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5489ba lrc: 0/0,0 mode: --/EX res: [0x200000401:0x40:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.322694:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5489ac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.322702:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5489ac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.322710:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5489ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.322715:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986343.322718:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5489ac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.322724:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5489ac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.322734:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:1.0:1788986343.322737:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986343.322740:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5489ac lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986343.322747:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5489ac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986343.323191:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a6e7e131 reply state 0000000057b84377 transno 4294967591 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5489b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986343.323203:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986343.323857:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:47432:x1875885971294464:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 9865us (10090us total) trans 4294967591 rc 0/0 00000100:00100000:1.0:1788986343.323869:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 780 00010000:00010000:2.0:1788986343.328450:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5489b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.328471:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5489b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.328481:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5489b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.328505:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986343.328510:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5489b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.328519:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5489b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.328538:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a4823bd00) 00010000:00010000:2.0:1788986343.328542:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986343.328548:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5489b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986343.328555:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5489b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986343.361148:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986344.308312:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986344.308389:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971294592 00000100:00100000:3.0:1788986344.308407:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971294592 00000100:00100000:3.0:1788986344.308669:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 781 00000100:00100000:3.0:1788986344.308682:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:47447:x1875885971294592:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986344.308716:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986344.308744:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11a8 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.308828:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5489cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.308845:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5489cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.308861:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5489cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986344.308908:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:3.0:1788986344.308912:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986344.308937:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5489cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.309041:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11a8 expref: 13 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.309065:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5489cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11a8 expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.309075:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:3.0:1788986344.309078:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986344.309082:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00080000:2.0:1788986344.309405:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986344.310659:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:47447:x1875885971294592:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 1970us (2345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986344.310672:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 781 00000100:00100000:2.0:1788986344.324526:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986344.325065:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971294848 00000100:00100000:3.0:1788986344.325077:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971294848 00000100:00100000:3.0:1788986344.325166:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 782 00000100:00100000:3.0:1788986344.325176:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:47447:x1875885971294848:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986344.325225:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986344.325251:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5489cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11a8 expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.325270:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548951 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1185 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.325281:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:3.0:1788986344.325290:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986344.325313:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489d6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.325325:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.325334:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986344.371407:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000337e6396 reply state 000000004af9c33b transno 4294967592 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986344.371433:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986344.371468:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000100:00100000:1.0:1788986344.371627:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:47447:x1875885971294848:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 46447us (47106us total) trans 4294967592 rc 0/0 00000100:00100000:1.0:1788986344.371637:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 782 00000001:00080000:0.0:1788986344.375602:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967591 is committed 00000004:00080000:0.0:1788986344.375616:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 65 committed 00000001:00080000:0.0:1788986344.375663:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967592 is committed 00010000:00010000:2.0:1788986344.375789:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489d6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.375801:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489d6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.375876:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.375884:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986344.375889:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489d6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.375902:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489d6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.375918:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:2.0:1788986344.375920:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986344.375925:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489d6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.375931:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf5489d6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986344.376946:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993508864:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788986344.377036:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986344.377276:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993508864 00000100:00100000:2.0:1788986344.377287:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993508864 00000100:00100000:2.0:1788986344.377346:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:2.0:1788986344.377355:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993508864:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788986344.377384:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:25 count 1 00000100:00080000:3.0:1788986344.377390:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986344.377408:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.377429:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c4ec7afc/0xc20d828fcf5489a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11a1 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.377437:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788986344.377441:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986344.377446:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.377478:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c4ec7afc/0xc20d828fcf5489a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11a1 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.377515:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c4ec7afc/0xc20d828fcf5489a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11a1 expref: 6 pid: 6697 timeout: 2228 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986344.377530:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993508992:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986344.378056:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a413773c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986344.383811:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993508992:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788986344.383841:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986344.384911:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986344.384983:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971294976 00000100:00100000:0.0:1788986344.384993:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971294976 00010000:00010000:0.0:1788986344.385056:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c4ec7afc/0xc20d828fcf5489a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11a1 expref: 7 pid: 6697 timeout: 2228 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986344.385118:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 378 00000100:00100000:0.0:1788986344.385128:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971294976:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986344.385142:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986344.385148:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c4ec7afc/0xc20d828fcf5489a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11a1 expref: 7 pid: 6697 timeout: 2228 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986344.385173:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c4ec7afc/0xc20d828fcf5489a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11a1 expref: 7 pid: 6697 timeout: 2228 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986344.385196:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4ec7afc/0xc20d828fcf5489a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11a1 expref: 7 pid: 6697 timeout: 2228 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986344.385212:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986344.385216:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986344.385221:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986344.385230:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986344.385253:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986344.385303:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971294976:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 176us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986344.385725:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 378 00000100:00080000:2.0:1788986344.385927:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986344.385941:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.385951:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.385962:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.385969:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986344.385990:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986344.386588:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986344.386602:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.386618:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986344.386624:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986344.386634:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986344.386637:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.386659:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.386667:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e991b5a/0xc20d828fcf5489dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986344.386694:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986344.386696:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986344.386698:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986344.387905:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993508864:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10548us (10866us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788986344.387915:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00000004:00080000:0.0:1788986344.388443:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7f432a00/2, rc 0, transno 4294967347 00000100:00100000:0.0:1788986344.388451:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993508864:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788986344.448694:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a4510aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993509120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986344.448873:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986344.449267:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993509120 00000100:00100000:2.0:1788986344.449276:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993509120 00000100:00100000:2.0:1788986344.449352:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 758 00000100:00100000:2.0:1788986344.449363:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4515a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993509120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986344.449408:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986344.449852:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4515a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993509120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 490us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986344.449861:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 758 00000100:00100000:3.0:1788986344.450593:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a4510aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993509120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986344.489416:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986344.489722:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971295104 00000100:00100000:1.0:1788986344.489735:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971295104 00000100:00100000:1.0:1788986344.489876:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 783 00000100:00100000:1.0:1788986344.489900:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47451:x1875885971295104:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:1.0:1788986344.489933:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986344.489961:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5489e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11af expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.490041:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.490059:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.490071:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.490420:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5489f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.490691:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5489f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.490702:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5489f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.491990:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5489f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492007:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5489f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492016:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5489f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986344.492051:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:1.0:1788986344.492056:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986344.492308:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5489f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492325:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492333:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492340:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492347:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986344.492352:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492361:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492377:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:1.0:1788986344.492380:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986344.492386:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492393:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5489eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492412:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5489f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492418:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5489f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492424:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5489f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492430:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986344.492432:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5489f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492449:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5489f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492466:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a45316700) 00010000:00010000:1.0:1788986344.492469:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986344.492472:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5489f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492483:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5489f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492538:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5489e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11af expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492557:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5489f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11af expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986344.492565:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:1.0:1788986344.492568:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986344.492571:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788986344.492667:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47451:x1875885971295104:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 2769us (3454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986344.492676:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 783 00010000:00010000:0.0:1788986345.408643:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986345.472331:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993509376:0@lo:400:kworker.0 00000100:00100000:2.0:1788986345.472393:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986345.472442:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8099ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993509888:0@lo:400:kworker.0 00000100:00100000:2.0:1788986345.472465:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986345.472499:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986345.472506:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8099a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993509504:0@lo:400:kworker.0 00000100:00100000:2.0:1788986345.472526:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986345.472569:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993509376 00000100:00100000:2.0:1788986345.472576:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993509376 00000100:00100000:2.0:1788986345.472618:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993509504 00000100:00100000:2.0:1788986345.472621:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993509504 00000100:00100000:2.0:1788986345.472649:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1788986345.472656:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993509376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986345.472720:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993509376:12345-0@lo:400:kworker.0 Request processed in 63us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986345.472727:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:2.0:1788986345.472744:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:2.0:1788986345.472751:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993509504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986345.472779:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993509504:12345-0@lo:400:kworker.0 Request processed in 28us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986345.472785:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00100000:2.0:1788986345.472810:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993509888 00000100:00100000:2.0:1788986345.472813:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993509888 00000100:00100000:2.0:1788986345.472842:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1788986345.472849:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993509888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986345.472877:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993509888:12345-0@lo:400:kworker.0 Request processed in 29us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986345.472883:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00080000:2.0:1788986345.472902:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986345.472906:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986345.472936:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8099a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993509504:0@lo:400:kworker.0 00000100:00100000:2.0:1788986345.472948:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993509376:0@lo:400:kworker.0 00000100:00100000:2.0:1788986345.472955:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8099ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993509888:0@lo:400:kworker.0 00000100:00100000:0.0:1788986345.473086:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993509632:0@lo:400:kworker.0 00000100:00100000:0.0:1788986345.473195:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986345.473221:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993509248:0@lo:400:kworker.0 00000100:00100000:1.0:1788986345.473254:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986345.473287:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993509760:0@lo:400:kworker.0 00000100:00100000:0.0:1788986345.473303:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993509248 00000100:00100000:0.0:1788986345.473308:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993509248 00000100:00100000:1.0:1788986345.473310:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986345.473332:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1788986345.473334:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993509760 00000100:00100000:1.0:1788986345.473337:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993509760 00000100:00100000:0.0:1788986345.473338:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993509248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986345.473362:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:1.0:1788986345.473368:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993509760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986345.473371:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993509248:12345-0@lo:400:kworker.0 Request processed in 34us (118us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986345.473377:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1205 00000100:00100000:1.0:1788986345.473395:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993509760:12345-0@lo:400:kworker.0 Request processed in 27us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986345.473400:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:0.0:1788986345.473408:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993509248:0@lo:400:kworker.0 00000100:00100000:0.0:1788986345.473418:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993509760:0@lo:400:kworker.0 00000100:00100000:2.0:1788986345.473616:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993509632 00000100:00100000:2.0:1788986345.473621:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993509632 00000100:00100000:2.0:1788986345.473675:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1788986345.473683:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993509632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986345.473730:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993509632:12345-0@lo:400:kworker.0 Request processed in 48us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986345.473736:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:1.0:1788986345.473946:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993509632:0@lo:400:kworker.0 00000100:00080000:0.0:1788986345.474174:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986345.594266:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986345.594330:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971295232 00000100:00100000:3.0:1788986345.594339:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971295232 00000100:00100000:3.0:1788986345.594403:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 784 00000100:00100000:3.0:1788986345.594413:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47466:x1875885971295232:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986345.594430:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986345.594449:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548a00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11b6 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986345.594517:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548a07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986345.594532:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986345.594543:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986345.594575:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:3.0:1788986345.594579:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986345.594598:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548a07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986345.594625:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548a00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11b6 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986345.594642:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548a07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11b6 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986345.594649:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:3.0:1788986345.594652:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986345.594656:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3c00, rc 0) 00000100:00100000:3.0:1788986345.594708:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47466:x1875885971295232:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 297us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986345.594715:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 784 00000100:00100000:3.0:1788986345.598685:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986345.599320:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971295488 00000100:00100000:0.0:1788986345.599335:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971295488 00000100:00100000:0.0:1788986345.599402:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 785 00000100:00100000:0.0:1788986345.599412:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47466:x1875885971295488:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788986345.599464:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986345.599503:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548a07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11b6 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986345.599535:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5489f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11af expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986345.599550:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:0.0:1788986345.599561:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986345.599592:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548a0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986345.599607:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986345.599618:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986345.599986:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000168e6369 reply state 000000008ae4af92 transno 4294967593 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986345.599996:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788986345.600005:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000100:00100000:0.0:1788986345.600115:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47466:x1875885971295488:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 703us (1445us total) trans 4294967593 rc 0/0 00000100:00100000:0.0:1788986345.600123:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 785 00010000:00010000:0.0:1788986345.607390:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548a0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986345.607406:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548a0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986345.607413:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548a0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986345.607420:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986345.607424:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548a0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986345.607433:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548a0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986345.607448:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a4823bb00) 00010000:00010000:0.0:1788986345.607451:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788986345.607456:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548a0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986345.607462:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548a0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986345.733645:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986345.733965:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971295616 00000100:00100000:2.0:1788986345.733977:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971295616 00000100:00100000:2.0:1788986345.734085:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 786 00000100:00100000:2.0:1788986345.734567:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47478:x1875885971295616:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986345.734726:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47478:x1875885971295616:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 163us (1093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986345.734735:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 786 00000100:00100000:3.0:1788986345.736911:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986345.736967:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971295744 00000100:00100000:2.0:1788986345.736976:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971295744 00000100:00100000:2.0:1788986345.737041:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 425 00000100:00100000:2.0:1788986345.737051:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47478:x1875885971295744:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986345.737683:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47478:x1875885971295744:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 631us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986345.737693:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 425 00000100:00100000:1.0:1788986345.741242:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986345.741546:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971295872 00000100:00100000:2.0:1788986345.741558:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971295872 00000100:00100000:2.0:1788986345.741648:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 426 00000100:00100000:2.0:1788986345.741659:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47478:x1875885971295872:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00080000:0.0:1788986345.742200:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986345.742387:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47478:x1875885971295872:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 727us (1156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986345.742397:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 426 00000100:00100000:0.0:1788986345.745051:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986345.745353:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971296000 00000100:00100000:1.0:1788986345.745368:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971296000 00000100:00100000:1.0:1788986345.745436:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 787 00000100:00100000:1.0:1788986345.745448:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4510a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47478:x1875885971296000:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986345.748705:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4510a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47478:x1875885971296000:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 3243us (3646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986345.748723:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 787 00000100:00100000:3.0:1788986345.754945:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986345.755074:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971296128 00000100:00100000:2.0:1788986345.755115:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971296128 00000100:00100000:2.0:1788986345.755338:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 788 00000100:00100000:2.0:1788986345.755351:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47478:x1875885971296128:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986345.755475:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47478:x1875885971296128:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 127us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986345.755493:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 788 00000100:00100000:3.0:1788986345.758193:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986345.758397:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971296256 00000100:00100000:1.0:1788986345.758412:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971296256 00000100:00100000:1.0:1788986345.758504:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 427 00000100:00100000:1.0:1788986345.758517:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47478:x1875885971296256:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986345.759199:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47478:x1875885971296256:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 681us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986345.759212:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 427 00000100:00100000:0.0:1788986345.762428:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986345.762584:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971296384 00000100:00100000:3.0:1788986345.762594:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971296384 00000100:00100000:3.0:1788986345.762647:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 428 00000100:00100000:3.0:1788986345.762657:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4510b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47478:x1875885971296384:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986345.764691:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4510b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47478:x1875885971296384:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 2027us (2266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986345.764702:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 428 00000100:00100000:3.0:1788986345.766948:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986345.767722:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971296512 00000100:00100000:2.0:1788986345.767731:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971296512 00000100:00100000:2.0:1788986345.767816:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 789 00000100:00100000:2.0:1788986345.767827:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47478:x1875885971296512:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986345.768243:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47478:x1875885971296512:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 417us (1300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986345.768261:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 789 00000100:00100000:3.0:1788986345.823638:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986345.824212:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971296640 00000100:00100000:1.0:1788986345.824221:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971296640 00000100:00100000:2.0:1788986345.824424:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 790 00000100:00100000:2.0:1788986345.824445:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47482:x1875885971296640:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:2.0:1788986345.824771:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986345.824793:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548a15 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11bd expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.824848:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548a1c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.824860:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548a1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.824870:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548a1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825063:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548a23 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825070:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548a23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825078:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548a23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825377:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548a2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825395:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548a2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825402:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548a2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986345.825423:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:2.0:1788986345.825434:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986345.825453:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548a2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825473:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548a1c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825489:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548a1c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825495:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548a1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825500:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986345.825504:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548a1c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825510:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548a1c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825521:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:2.0:1788986345.825524:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986345.825528:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548a1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825533:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf548a1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825543:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548a23 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825547:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548a23 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825552:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548a23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825556:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986345.825558:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548a23 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825564:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548a23 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825577:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a45aca500) 00010000:00010000:2.0:1788986345.825579:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986345.825582:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548a23 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.825586:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf548a23 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.826721:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548a15 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11bd expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.826738:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548a2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11bd expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.826747:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986345.826750:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986345.826842:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986345.826929:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47482:x1875885971296640:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 2481us (3292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986345.826938:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 790 00000100:00100000:3.0:1788986345.829632:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986345.829713:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971296896 00000100:00100000:2.0:1788986345.829722:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971296896 00000100:00100000:2.0:1788986345.829782:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 791 00000100:00100000:2.0:1788986345.829792:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47482:x1875885971296896:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:2.0:1788986345.829809:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986345.829827:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548a31 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11c4 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.830071:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548a38 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.830086:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548a38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.830128:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548a38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.830144:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548a3f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.830151:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548a3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.830158:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548a3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986345.832349:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x19:0x0], index 1: 0 00010000:00010000:2.0:1788986345.832606:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548a46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.832621:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.832632:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548a46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.832667:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548a38 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.832675:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548a38 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.832682:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548a38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.832688:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986345.832692:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548a38 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.832702:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548a38 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.832713:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986345.832716:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986345.832721:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548a38 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.832728:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548a38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986345.832740:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008fb068b5 reply state 000000009165e018 transno 4294967594 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548a3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986345.832749:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986345.832779:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548a31 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11c4 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.832793:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548a46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11c4 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.832800:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:2.0:1788986345.832803:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986345.832805:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1800, rc 0) 00000100:00100000:2.0:1788986345.833069:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:47482:x1875885971296896:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 3277us (3444us total) trans 4294967594 rc 0/0 00000100:00100000:2.0:1788986345.833078:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 791 00010000:00010000:1.0:1788986345.835085:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548a3f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986345.835119:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548a3f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986345.835125:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548a3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986345.835135:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986345.835139:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548a3f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986345.835152:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548a3f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986345.835165:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a45aca000) 00010000:00010000:1.0:1788986345.835168:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986345.835172:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548a3f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986345.835178:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548a3f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986345.842531:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986345.842776:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971297024 00000100:00100000:2.0:1788986345.842786:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971297024 00000100:00100000:2.0:1788986345.842852:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 429 00000100:00100000:2.0:1788986345.842863:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47482:x1875885971297024:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:2.0:1788986345.842879:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986345.842898:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076ee47aa/0xc20d828fcf548a54 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11cb expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788986345.842922:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788986345.842941:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=2129s v=(0 0) 00010000:00010000:2.0:1788986345.842957:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986345.842967:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076ee47aa/0xc20d828fcf548a54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11cb expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.842984:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000076ee47aa/0xc20d828fcf548a54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11cb expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986345.842995:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0c00, rc 0) 00000100:00100000:2.0:1788986345.843056:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47482:x1875885971297024:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 195us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986345.843063:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 429 00000100:00100000:2.0:1788986345.877978:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986345.878061:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971297152 00000100:00100000:3.0:1788986345.878070:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971297152 00002000:00100000:3.0:1788986345.878154:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x19:0x0] (0->1048575) req@ffff9b0a8099ad80 x1875885971297152/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:266/0 lens 488/0 e 0 to 0 dl 1788986356 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1788986345.878165:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a8099ad80 with x1875885971297152 ext(0->1048575) 00002000:00010000:3.0:1788986345.878171:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a8099ad80 00000100:00100000:3.0:1788986345.878206:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:3.0:1788986345.878217:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971297152:12345-192.168.206.21@tcp:4:dd.60003 00000100:00100000:1.0:1788986345.917042:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971297152:12345-192.168.206.21@tcp:4:dd.60003 Request processed in 38816us (39062us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788986345.917057:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00002000:00100000:1.0:1788986345.917071:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x19:0x0] (0->1048575) req@ffff9b0a8099ad80 x1875885971297152/t4294967346(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:266/0 lens 488/448 e 0 to 0 dl 1788986356 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:1.0:1788986345.917082:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a8099ad80 with x1875885971297152 ext(0->1048575) 00002000:00010000:1.0:1788986345.917137:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a8099ad80 00000100:00100000:0.0:1788986345.924337:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986345.924433:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971297280 00000100:00100000:2.0:1788986345.924443:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971297280 00000100:00100000:2.0:1788986345.924559:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 792 00000100:00100000:2.0:1788986345.924569:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:47482:x1875885971297280:12345-192.168.206.21@tcp:44:dd.60003 00000001:00080000:2.0:1788986345.959339:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967593 is committed 00000001:00080000:2.0:1788986345.959362:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967594 is committed 00000100:00100000:0.0:1788986345.960732:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47482:x1875885971297280:12345-192.168.206.21@tcp:44:dd.60003 Request processed in 36157us (36396us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986345.960743:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 792 00000100:00100000:0.0:1788986345.966928:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986345.967238:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971297408 00000100:00100000:2.0:1788986345.967247:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971297408 00000100:00100000:2.0:1788986345.967298:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 430 00000100:00100000:2.0:1788986345.967307:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971297408:12345-192.168.206.21@tcp:16:dd.60003 00000100:00100000:1.0:1788986345.985204:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993510016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986345.985276:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986345.985345:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993510016 00000100:00100000:1.0:1788986345.985364:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993510016 00000100:00100000:1.0:1788986345.985408:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 759 00000100:00100000:1.0:1788986345.985418:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993510016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986345.985437:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986345.985813:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993510016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 395us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986345.985821:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 759 00000100:00100000:1.0:1788986345.985866:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993510016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986346.023551:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971297408:12345-192.168.206.21@tcp:16:dd.60003 Request processed in 56236us (56623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986346.023565:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 430 00000001:00080000:3.0:1788986346.024791:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967346 is committed 00000100:00100000:2.0:1788986346.027219:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986346.027385:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971297664 00000100:00100000:1.0:1788986346.027394:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971297664 00000100:00100000:1.0:1788986346.027446:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00100000:1.0:1788986346.027454:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47482:x1875885971297664:12345-192.168.206.21@tcp:35:dd.60003 00000100:00100000:1.0:1788986346.027890:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:47482:x1875885971297664:12345-192.168.206.21@tcp:35:dd.60003 Request processed in 436us (678us total) trans 4294967595 rc 0/0 00000100:00100000:1.0:1788986346.027898:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 79 00000100:00080000:0.0:1788986346.028729:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986346.432227:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788986346.580931:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967346 is committed 00000001:00080000:2.0:1788986346.580956:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967347 is committed 00000001:00080000:3.0:1788986347.440022:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967595 is committed 00010000:00010000:0.0:1788986347.458382:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986347.638253:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986347.638479:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971297920 00000100:00100000:1.0:1788986347.638488:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971297920 00000100:00100000:1.0:1788986347.638549:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1498 00000100:00100000:1.0:1788986347.638619:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4510aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971297920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986347.638712:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4510aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971297920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 153us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986347.638721:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1498 00000100:00100000:0.0:1788986347.639627:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986347.639674:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971297792 00000100:00100000:0.0:1788986347.639678:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986347.639681:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971297792 00000100:00100000:1.0:1788986347.639719:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1206 00000100:00100000:1.0:1788986347.639729:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971297792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986347.639734:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986347.639772:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971297792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 45us (148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986347.639779:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1206 00000100:00100000:0.0:1788986347.639847:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971298048 00000100:00100000:0.0:1788986347.639852:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971298048 00000100:00100000:0.0:1788986347.639890:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971298176 00000100:00100000:0.0:1788986347.639894:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971298176 00000100:00100000:3.0:1788986347.639910:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1089 00000100:00100000:3.0:1788986347.639925:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4510b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971298048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986347.639964:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4510b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971298048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 42us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986347.639993:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1090 00000100:00100000:0.0:1788986347.640002:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971298176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986347.640327:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971298176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 325us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986347.640335:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1090 00000100:00080000:0.0:1788986347.640355:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986347.640358:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986347.640605:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1089 00010000:00010000:3.0:1788986348.481221:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788986348.699474:0:81339:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2132602371684ns, next at 2128221877784ns, rc = 0 00000004:00080000:0.0:1788986348.699646:0:81339:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2132602556177ns, next at 2105916666196ns, rc = 0 00000004:00080000:2.0:1788986348.703491:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 66 committed 00000004:00080000:2.0:1788986348.703516:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 66 committed 00010000:00010000:1.0:1788986349.504341:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986349.571654:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986349.571674:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a45109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993510144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986349.571735:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986349.571791:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993510144 00000100:00100000:0.0:1788986349.571799:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993510144 00000100:00100000:0.0:1788986349.571854:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1788986349.571863:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993510144:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986349.572033:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788986349.572122:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986349.572165:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45108e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993510144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 303us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986349.572172:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 760 00000100:00100000:0.0:1788986349.572206:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:0.0:1788986349.572211:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7f432a00, transno 4294967347 00000100:00100000:0.0:1788986349.572226:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a45109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993510144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986350.382475:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986350.382648:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971298304 00000100:00100000:3.0:1788986350.382658:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971298304 00000100:00100000:3.0:1788986350.382723:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 793 00000100:00100000:3.0:1788986350.382733:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47675:x1875885971298304:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986350.382821:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47675:x1875885971298304:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 89us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986350.382828:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 793 00000100:00080000:0.0:1788986350.386356:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986350.395854:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986350.395931:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971298432 00000100:00100000:0.0:1788986350.395940:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971298432 00000100:00100000:0.0:1788986350.396013:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 431 00000100:00100000:0.0:1788986350.396023:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47675:x1875885971298432:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986350.396395:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47675:x1875885971298432:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 373us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986350.396403:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 431 00000100:00080000:1.0:1788986350.396903:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986350.409654:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986350.410782:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971298560 00000100:00100000:1.0:1788986350.410794:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971298560 00000100:00100000:1.0:1788986350.410855:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 432 00000100:00100000:1.0:1788986350.410865:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47675:x1875885971298560:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986350.411256:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47675:x1875885971298560:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 391us (1611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986350.411263:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 432 00000100:00080000:1.0:1788986350.411287:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986350.421795:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986350.421832:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971298688 00000100:00100000:0.0:1788986350.421840:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971298688 00000100:00100000:0.0:1788986350.421888:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 794 00000100:00100000:0.0:1788986350.421899:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47675:x1875885971298688:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986350.422401:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47675:x1875885971298688:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 503us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986350.422409:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 794 00000100:00100000:2.0:1788986350.435128:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986350.435163:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971298816 00000100:00100000:2.0:1788986350.435172:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971298816 00000100:00100000:2.0:1788986350.435221:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 795 00000100:00100000:2.0:1788986350.435230:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47675:x1875885971298816:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986350.435315:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47675:x1875885971298816:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 85us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986350.435322:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 795 00000100:00100000:0.0:1788986350.437449:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986350.437492:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971298944 00000100:00100000:0.0:1788986350.437500:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971298944 00000100:00100000:0.0:1788986350.437540:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 433 00000100:00100000:0.0:1788986350.437549:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47675:x1875885971298944:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986350.437850:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47675:x1875885971298944:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 300us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986350.437857:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 433 00000100:00100000:2.0:1788986350.443409:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986350.443487:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971299072 00000100:00100000:0.0:1788986350.443496:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971299072 00000100:00100000:0.0:1788986350.443548:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 434 00000100:00100000:0.0:1788986350.443557:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47675:x1875885971299072:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986350.443880:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:47675:x1875885971299072:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 323us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986350.443887:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 434 00000100:00100000:3.0:1788986350.448592:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986350.448733:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971299200 00000100:00100000:1.0:1788986350.448742:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971299200 00000100:00100000:1.0:1788986350.448795:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 796 00000100:00100000:1.0:1788986350.448804:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47675:x1875885971299200:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986350.449268:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47675:x1875885971299200:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 463us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986350.449276:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 796 00000100:00100000:0.0:1788986350.508922:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986350.509016:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971299456 00000100:00100000:3.0:1788986350.509025:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971299456 00000100:00100000:3.0:1788986350.509124:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 797 00000100:00100000:3.0:1788986350.509135:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47679:x1875885971299456:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:3.0:1788986350.509181:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986350.509240:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548a46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x41:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11c4 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.509258:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:3.0:1788986350.509267:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986350.509297:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548a5b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.509309:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548a5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.509317:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548a5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.509347:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548a62 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.509355:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548a62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.509362:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548a62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.509650:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.509659:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.509666:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788986350.510510:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].25, 64 off9792 00000004:00080000:3.0:1788986350.510520:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2134413430339ns, next at 2135413428138ns, rc = 0 00010000:00010000:3.0:1788986350.510617:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548a70 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510627:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548a70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510636:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548a70 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510644:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548a70 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510654:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548a70 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510660:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548a70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510676:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986350.510696:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510702:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a69 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510708:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510714:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986350.510718:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510725:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a69 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510734:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986350.510737:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986350.510741:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a69 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510747:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a69 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x41:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510765:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548a5b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510770:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548a5b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510775:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548a5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510781:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986350.510783:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548a5b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510789:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548a5b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510795:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:3.0:1788986350.510797:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986350.510800:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548a5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986350.510804:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548a5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986350.510812:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000058f8f18a reply state 000000000f788eb9 transno 4294967596 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548a62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986350.510820:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986350.510888:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:47679:x1875885971299456:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 1754us (1974us total) trans 4294967596 rc 0/0 00000100:00100000:3.0:1788986350.510896:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 797 00010000:00010000:0.0:1788986350.511143:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986350.511149:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548a70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986350.511156:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986350.511160:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548a70 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986350.511167:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548a70 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986350.511175:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x41:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:0.0:1788986350.511178:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788986350.511181:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548a70 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986350.511187:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548a70 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x41:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986350.511200:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986350.511202:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986350.511203:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986350.514590:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548a62 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986350.514605:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548a62 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986350.514612:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548a62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986350.514618:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986350.514622:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548a62 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986350.514629:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548a62 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986350.514643:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0xf9c7deb2 (ffff9b0a55745300) 00010000:00010000:0.0:1788986350.514646:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986350.514650:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548a62 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986350.514656:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548a62 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3c:0x0].0xf9c7deb2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986350.528325:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986350.592678:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993510656:0@lo:400:kworker.0 00000100:00100000:1.0:1788986350.592745:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986350.592828:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788986350.592835:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993510272:0@lo:400:kworker.0 00000100:00100000:1.0:1788986350.592863:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986350.592884:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993510784:0@lo:400:kworker.0 00000100:00100000:1.0:1788986350.592909:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986350.593007:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993510784 00000100:00100000:2.0:1788986350.593014:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993510784 00000100:00100000:2.0:1788986350.593068:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:2.0:1788986350.593076:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993510784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986350.593155:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993510784:12345-0@lo:400:kworker.0 Request processed in 80us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986350.593162:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00080000:2.0:1788986350.593183:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986350.593195:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993510656 00000100:00100000:2.0:1788986350.593199:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993510656 00000100:00100000:2.0:1788986350.593224:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1788986350.593230:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993510656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986350.593263:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993510656:12345-0@lo:400:kworker.0 Request processed in 33us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986350.593268:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1788986350.593307:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993510400:0@lo:400:kworker.0 00000100:00100000:2.0:1788986350.593330:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986350.593352:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993510912:0@lo:400:kworker.0 00000100:00100000:2.0:1788986350.593371:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986350.593389:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986350.593394:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993510528:0@lo:400:kworker.0 00000100:00100000:2.0:1788986350.593414:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986350.593440:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993510400 00000100:00100000:2.0:1788986350.593443:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993510400 00000100:00100000:2.0:1788986350.593473:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993510528 00000100:00100000:2.0:1788986350.593476:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993510528 00000100:00100000:2.0:1788986350.593500:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1500 00000100:00100000:2.0:1788986350.593506:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993510400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986350.593549:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993510400:12345-0@lo:400:kworker.0 Request processed in 43us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986350.593555:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1500 00000100:00100000:2.0:1788986350.593573:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:2.0:1788986350.593580:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993510528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986350.593613:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993510528:12345-0@lo:400:kworker.0 Request processed in 34us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986350.593620:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00080000:2.0:1788986350.593635:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986350.593648:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993510784:0@lo:400:kworker.0 00000100:00100000:2.0:1788986350.593649:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993510528:0@lo:400:kworker.0 00000100:00100000:2.0:1788986350.593658:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993510400:0@lo:400:kworker.0 00000100:00100000:1.0:1788986350.593659:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993510656:0@lo:400:kworker.0 00000100:00100000:0.0:1788986350.594110:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993510272 00000100:00100000:0.0:1788986350.594116:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993510272 00000100:00100000:0.0:1788986350.594145:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1788986350.594152:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993510272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986350.594203:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993510272:12345-0@lo:400:kworker.0 Request processed in 52us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986350.594210:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:0.0:1788986350.594241:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993510912 00000100:00100000:0.0:1788986350.594245:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993510912 00000100:00100000:0.0:1788986350.594276:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1788986350.594283:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993510912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986350.594315:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993510912:12345-0@lo:400:kworker.0 Request processed in 33us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986350.594321:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00080000:0.0:1788986350.594336:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986350.594465:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993510912:0@lo:400:kworker.0 00000100:00100000:2.0:1788986350.594490:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993510272:0@lo:400:kworker.0 00000100:00100000:0.0:1788986351.105289:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986351.105311:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993511040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986351.105386:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986351.105582:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993511040 00000100:00100000:1.0:1788986351.105590:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993511040 00000100:00100000:1.0:1788986351.105647:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 761 00000100:00100000:1.0:1788986351.105656:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993511040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986351.105688:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788986351.105742:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993511040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986351.105749:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 761 00000100:00100000:2.0:1788986351.105822:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993511040:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986351.556890:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788986352.558027:0:81484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2136460935401ns, next at 2128221877784ns, rc = 0 00000004:00080000:0.0:1788986352.558854:0:81484:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2136461764024ns, next at 2135413428138ns, rc = 0 00010000:00010000:0.0:1788986352.585747:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788986352.616971:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 68 committed 00000004:00080000:2.0:1788986352.617002:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 67 committed 00000001:00080000:2.0:1788986352.617030:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967596 is committed 00000004:00080000:2.0:1788986352.617036:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 67 committed 00000100:00100000:0.0:1788986352.617146:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986352.617164:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993511168:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788986352.617219:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986352.617368:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993511168 00000100:00100000:2.0:1788986352.617377:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993511168 00000100:00100000:2.0:1788986352.617454:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:2.0:1788986352.617464:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993511168:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788986352.617490:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:25 count 1 00010000:00010000:2.0:1788986352.617514:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986352.617545:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076ee47aa/0xc20d828fcf548a54 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11cb expref: 5 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986352.617564:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x19:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1788986352.617569:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788986352.617576:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986352.617605:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076ee47aa/0xc20d828fcf548a54 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11cb expref: 5 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986352.617621:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076ee47aa/0xc20d828fcf548a54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11cb expref: 5 pid: 6697 timeout: 2236 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986352.617634:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80998380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875885993511296:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986352.617709:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09427c49c0 going to sleep for 11 seconds 00000100:00080000:0.0:1788986352.618052:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986352.623386:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986352.623425:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971299584 00000100:00100000:2.0:1788986352.623433:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971299584 00000100:00080000:3.0:1788986352.623494:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788986352.623496:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076ee47aa/0xc20d828fcf548a54 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11cb expref: 6 pid: 6697 timeout: 2236 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986352.623684:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 379 00000100:00100000:2.0:1788986352.623698:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971299584:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788986352.623712:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986352.623718:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076ee47aa/0xc20d828fcf548a54 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11cb expref: 6 pid: 6697 timeout: 2236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986352.623733:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076ee47aa/0xc20d828fcf548a54 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11cb expref: 6 pid: 6697 timeout: 2236 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986352.623757:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788986352.623763:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788986352.623770:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986352.623780:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986352.623799:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986352.623844:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971299584:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 150us (468us total) trans 0 rc 0/0 00010000:00010000:1.0:1788986352.624011:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076ee47aa/0xc20d828fcf548a54 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11cb expref: 6 pid: 6697 timeout: 2236 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986352.624028:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80998380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875885993511296:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788986352.624047:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986352.624063:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986352.624071:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986352.624081:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986352.624124:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986352.624140:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788986352.624730:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993511168:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7267us (7508us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788986352.624739:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00010000:00010000:1.0:1788986352.624768:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986352.624774:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986352.624783:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986352.624787:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986352.624797:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986352.624812:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986352.624819:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf548a77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986352.624836:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986352.624837:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986352.624839:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788986352.624874:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7fb33800/2, rc 0, transno 4294967347 00000100:00100000:1.0:1788986352.624887:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993511168:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788986352.632668:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 379 00000100:00100000:0.0:1788986352.763433:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986352.763489:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986352.763529:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986352.763556:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986352.763587:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971299712 00000100:00100000:0.0:1788986352.763596:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971299712 00000100:00100000:0.0:1788986352.763641:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1208 00000100:00100000:0.0:1788986352.763650:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971299712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986352.763673:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971299840 00000100:00100000:1.0:1788986352.763678:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971299840 00000100:00100000:0.0:1788986352.763712:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971299712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 63us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986352.763717:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1502 00000100:00100000:0.0:1788986352.763720:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1208 00000100:00100000:1.0:1788986352.763724:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971299840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986352.763756:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971299840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986352.763763:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1502 00000100:00080000:1.0:1788986352.763777:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986352.763892:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971300096 00000100:00100000:3.0:1788986352.763896:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971300096 00000100:00100000:3.0:1788986352.763937:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971299968 00000100:00100000:3.0:1788986352.763940:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971299968 00000100:00100000:3.0:1788986352.763972:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1093 00000100:00100000:3.0:1788986352.763979:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971300096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986352.764012:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971300096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986352.764018:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1093 00000100:00100000:3.0:1788986352.764032:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1094 00000100:00100000:3.0:1788986352.764038:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971299968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986352.764067:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971299968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986352.764073:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1094 00000100:00080000:0.0:1788986352.764787:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986353.602878:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986354.624323:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986354.688384:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993511424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986354.688460:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986354.688597:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993511424 00000100:00100000:0.0:1788986354.688605:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993511424 00000100:00100000:0.0:1788986354.688667:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1788986354.688677:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993511424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986354.688718:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986354.688764:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993511424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986354.688772:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 762 00000100:00100000:0.0:1788986354.688813:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993511424:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986354.689109:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986355.654132:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986355.716115:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993511680:0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.716210:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986355.716278:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993512192:0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.716308:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986355.716339:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788986355.716345:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993511552:0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.716377:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986355.716409:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993512064:0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.716443:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986355.716472:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993511936:0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.716496:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986355.716518:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986355.716523:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993511808:0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.716550:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986355.716662:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993511680 00000100:00100000:2.0:1788986355.716671:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993511680 00000100:00100000:2.0:1788986355.716724:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993512064 00000100:00100000:2.0:1788986355.716727:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993512064 00000100:00100000:2.0:1788986355.716751:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993511808 00000100:00100000:2.0:1788986355.716753:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993511808 00000100:00100000:2.0:1788986355.716773:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:2.0:1788986355.716782:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993511680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986355.716812:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:1.0:1788986355.716825:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993512064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.716847:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993511680:12345-0@lo:400:kworker.0 Request processed in 64us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986355.716855:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:1.0:1788986355.716875:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993512064:12345-0@lo:400:kworker.0 Request processed in 52us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986355.716879:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:1.0:1788986355.716890:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:2.0:1788986355.716891:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993511808:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788986355.716917:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986355.716931:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993511808:12345-0@lo:400:kworker.0 Request processed in 42us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986355.716938:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:2.0:1788986355.716987:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993512192 00000100:00100000:2.0:1788986355.716991:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993512192 00000100:00100000:2.0:1788986355.717024:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993511936 00000100:00100000:2.0:1788986355.717027:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993511936 00000100:00100000:2.0:1788986355.717049:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1788986355.717056:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993512192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.717112:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993512192:12345-0@lo:400:kworker.0 Request processed in 32us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986355.717119:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1788986355.717131:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1788986355.717138:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993511936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.717168:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993511936:12345-0@lo:400:kworker.0 Request processed in 30us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986355.717178:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1788986355.717195:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993511552 00000100:00100000:2.0:1788986355.717199:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993511552 00000100:00100000:2.0:1788986355.717223:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1788986355.717229:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993511552:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788986355.717253:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986355.717261:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993511552:12345-0@lo:400:kworker.0 Request processed in 31us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986355.717267:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1209 00000100:00100000:2.0:1788986355.717331:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993511808:0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.717344:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993511936:0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.717375:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80998380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993511552:0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.717384:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993512064:0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.717394:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993511680:0@lo:400:kworker.0 00000100:00100000:2.0:1788986355.717404:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993512192:0@lo:400:kworker.0 00000001:00080000:0.0:1788986355.814080:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967347 is committed 00000100:00100000:2.0:1788986356.227847:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993512320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986356.227924:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986356.228834:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993512320 00000100:00100000:0.0:1788986356.228844:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993512320 00000100:00100000:0.0:1788986356.228930:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 763 00000100:00100000:0.0:1788986356.228940:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993512320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986356.228972:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986356.229024:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993512320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986356.229031:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 763 00000100:00100000:2.0:1788986356.229151:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967347 gen 2 00000004:00080000:2.0:1788986356.229157:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7fb33800, transno 4294967347 00000100:00100000:2.0:1788986356.229187:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993512320:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986356.675509:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986357.715489:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986357.877658:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986357.877702:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986357.877738:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986357.877771:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986357.877798:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971300608 00000100:00100000:2.0:1788986357.877806:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971300608 00000100:00100000:2.0:1788986357.877865:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971300480 00000100:00100000:2.0:1788986357.877868:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971300480 00000100:00100000:2.0:1788986357.877894:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1097 00000100:00100000:1.0:1788986357.877930:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971300352 00000100:00100000:1.0:1788986357.877934:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971300352 00000100:00100000:1.0:1788986357.877966:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1506 00000100:00100000:1.0:1788986357.877974:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971300352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986357.878043:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971300352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986357.878051:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1506 00000100:00100000:2.0:1788986357.878129:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971300608:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986357.878160:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971300608:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986357.878244:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971300224 00000100:00100000:0.0:1788986357.878248:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971300224 00000100:00100000:0.0:1788986357.878292:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1210 00000100:00100000:0.0:1788986357.878300:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971300224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986357.878326:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971300224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986357.878331:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1210 00000100:00100000:3.0:1788986357.883720:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1098 00000100:00100000:3.0:1788986357.883739:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971300480:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986357.883822:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971300480:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 90us (6050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986357.883831:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1098 00000100:00080000:3.0:1788986357.886476:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986357.886486:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986357.886489:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986357.889284:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1097 00010000:00010000:1.0:1788986358.721081:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986359.744503:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986359.808860:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993512448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986359.808929:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986359.809518:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993512448 00000100:00100000:0.0:1788986359.809527:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993512448 00000100:00100000:0.0:1788986359.809612:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 764 00000100:00100000:0.0:1788986359.809622:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993512448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986359.809657:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986359.809715:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993512448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (786us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986359.809723:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 764 00000100:00100000:2.0:1788986359.809885:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993512448:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986359.810008:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986360.769042:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986360.832454:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993512832:0@lo:400:kworker.0 00000100:00100000:2.0:1788986360.832519:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986360.832944:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993512576:0@lo:400:kworker.0 00000100:00100000:3.0:1788986360.832984:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986360.833058:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993512704:0@lo:400:kworker.0 00000100:00100000:2.0:1788986360.833573:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986360.833587:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993512960:0@lo:400:kworker.0 00000100:00100000:2.0:1788986360.833633:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986360.833683:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993512832 00000100:00100000:2.0:1788986360.833690:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993512832 00000100:00100000:2.0:1788986360.833749:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:2.0:1788986360.833761:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993512832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986360.833827:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993512832:12345-0@lo:400:kworker.0 Request processed in 69us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986360.833836:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:2.0:1788986360.833866:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993512576 00000100:00100000:2.0:1788986360.833871:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993512576 00000100:00100000:2.0:1788986360.833923:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:2.0:1788986360.833931:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993512576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986360.833972:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993512576:12345-0@lo:400:kworker.0 Request processed in 42us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986360.833980:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1788986360.834033:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993512960 00000100:00100000:1.0:1788986360.834042:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993512960 00000100:00100000:1.0:1788986360.834115:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1788986360.834125:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993512960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986360.834197:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993512960:12345-0@lo:400:kworker.0 Request processed in 72us (561us total) trans 0 rc 0/0 00000100:00080000:2.0:1788986360.834203:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986360.834207:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1788986360.834497:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993512960:0@lo:400:kworker.0 00000100:00100000:2.0:1788986360.834511:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993512832:0@lo:400:kworker.0 00000100:00100000:0.0:1788986360.834713:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986360.834771:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993513216:0@lo:400:kworker.0 00000100:00100000:2.0:1788986360.834789:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993512704 00000100:00100000:2.0:1788986360.834797:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993512704 00000100:00100000:0.0:1788986360.834820:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986360.834854:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:2.0:1788986360.834867:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993512704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986360.834942:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993512704:12345-0@lo:400:kworker.0 Request processed in 78us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986360.834949:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:0.0:1788986360.834985:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993512704:0@lo:400:kworker.0 00000100:00100000:2.0:1788986360.834997:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993513216 00000100:00100000:2.0:1788986360.835004:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993513216 00000100:00080000:0.0:1788986360.835057:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986360.835068:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1788986360.835078:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993513216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986360.835168:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993513216:12345-0@lo:400:kworker.0 Request processed in 93us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986360.835183:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1788986360.835650:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993513216:0@lo:400:kworker.0 00000100:00100000:3.0:1788986360.843190:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993512576:0@lo:400:kworker.0 00000100:00100000:3.0:1788986360.843283:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993513088:0@lo:400:kworker.0 00000100:00100000:3.0:1788986360.843352:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986360.843387:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993513088 00000100:00100000:3.0:1788986360.843392:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993513088 00000100:00100000:3.0:1788986360.843866:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:3.0:1788986360.843876:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993513088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986360.843925:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993513088:12345-0@lo:400:kworker.0 Request processed in 51us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986360.843933:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00080000:3.0:1788986360.843960:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986360.843985:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993513088:0@lo:400:kworker.0 00000100:00100000:3.0:1788986361.346155:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986361.348165:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993513344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986361.348263:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986361.348597:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993513344 00000100:00100000:1.0:1788986361.348607:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993513344 00000100:00100000:1.0:1788986361.348675:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 765 00000100:00100000:1.0:1788986361.348688:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993513344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986361.348753:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986361.348820:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993513344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986361.348829:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 765 00000100:00100000:3.0:1788986361.353182:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993513344:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986361.792325:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986362.818361:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986362.994538:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986362.994596:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986362.994636:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986362.994674:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986362.994714:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971300992 00000100:00100000:2.0:1788986362.994737:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971300992 00000100:00100000:0.0:1788986362.994752:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971300864 00000100:00100000:0.0:1788986362.994759:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971300864 00000100:00100000:2.0:1788986362.994824:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971301120 00000100:00100000:2.0:1788986362.994829:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971301120 00000100:00100000:0.0:1788986362.994833:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1510 00000100:00100000:0.0:1788986362.994849:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971300864:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986362.994864:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1101 00000100:00100000:2.0:1788986362.994874:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971300992:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986362.994978:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1102 00000100:00100000:3.0:1788986362.994988:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971301120:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986362.995062:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971300736 00000100:00100000:1.0:1788986362.995066:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971300736 00000100:00100000:1.0:1788986362.995132:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1212 00000100:00100000:1.0:1788986362.995139:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971300736:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986362.995278:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971300992:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 404us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986362.995287:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1101 00000100:00080000:2.0:1788986362.995311:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986362.995317:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986362.995319:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986362.997694:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971300864:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 2833us (3040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986362.997712:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1510 00000100:00100000:3.0:1788986363.000556:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971301120:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5551us (5862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986363.000575:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1102 00000100:00100000:1.0:1788986363.001131:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971300736:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5987us (6601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986363.001143:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1212 00010000:00010000:1.0:1788986363.840468:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986364.864386:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986364.929591:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986364.929624:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993513472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986364.929717:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986364.930133:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993513472 00000100:00100000:0.0:1788986364.930146:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993513472 00000100:00100000:0.0:1788986364.930228:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 766 00000100:00100000:0.0:1788986364.930240:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993513472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986364.930302:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986364.930442:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993513472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 204us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986364.930450:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 766 00000100:00080000:2.0:1788986364.930625:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986364.933977:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993513472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986365.888950:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986365.952943:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993513600:0@lo:400:kworker.0 00000100:00100000:3.0:1788986365.953048:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986365.957224:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993513728:0@lo:400:kworker.0 00000100:00100000:1.0:1788986365.957313:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986365.957354:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993514240:0@lo:400:kworker.0 00000100:00100000:1.0:1788986365.957458:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986365.957487:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986365.957493:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993514112:0@lo:400:kworker.0 00000100:00100000:1.0:1788986365.957517:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986365.957556:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993513728 00000100:00100000:1.0:1788986365.957565:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993513728 00000100:00100000:2.0:1788986365.957737:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993513600 00000100:00100000:2.0:1788986365.957743:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993513600 00000100:00100000:2.0:1788986365.957797:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1213 00000100:00100000:2.0:1788986365.957808:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993513600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986365.957886:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993513600:12345-0@lo:400:kworker.0 Request processed in 80us (4838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986365.957894:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1213 00000100:00100000:2.0:1788986365.957934:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993514112 00000100:00100000:2.0:1788986365.957937:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993514112 00000100:00100000:2.0:1788986365.957978:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:2.0:1788986365.957985:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993514112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986365.958024:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993514112:12345-0@lo:400:kworker.0 Request processed in 40us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986365.958030:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:2.0:1788986365.958050:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993514240 00000100:00100000:2.0:1788986365.958053:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993514240 00000100:00100000:2.0:1788986365.958083:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:2.0:1788986365.958116:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993514240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986365.958151:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943819180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993514240:12345-0@lo:400:kworker.0 Request processed in 61us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986365.958157:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:2.0:1788986365.958208:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993514112:0@lo:400:kworker.0 00000100:00100000:2.0:1788986365.958221:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993514240:0@lo:400:kworker.0 00000100:00080000:2.0:1788986365.958255:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986365.958260:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986365.958672:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f432a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993513600:0@lo:400:kworker.0 00000100:00100000:2.0:1788986365.958701:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993513856:0@lo:400:kworker.0 00000100:00100000:2.0:1788986365.958740:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986365.958777:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986365.958785:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993513984:0@lo:400:kworker.0 00000100:00100000:2.0:1788986365.958810:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986365.958847:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993513984 00000100:00100000:2.0:1788986365.958851:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993513984 00000100:00100000:2.0:1788986365.958878:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1788986365.958884:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993513984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986365.958928:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993513984:12345-0@lo:400:kworker.0 Request processed in 44us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986365.958934:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1788986365.958954:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993513856 00000100:00100000:2.0:1788986365.958957:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993513856 00000100:00100000:2.0:1788986365.958986:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:2.0:1788986365.958992:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993513856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986365.959023:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f432a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993513856:12345-0@lo:400:kworker.0 Request processed in 32us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986365.959028:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00080000:2.0:1788986365.959044:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986365.959063:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993513984:0@lo:400:kworker.0 00000100:00100000:2.0:1788986365.959072:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80716d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993513856:0@lo:400:kworker.0 00000100:00100000:1.0:1788986365.959732:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:1.0:1788986365.959744:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993513728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986365.959807:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993513728:12345-0@lo:400:kworker.0 Request processed in 66us (2494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986365.959814:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:1.0:1788986365.959925:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993513728:0@lo:400:kworker.0 00000100:00100000:3.0:1788986366.464913:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986366.464946:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993514368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986366.465038:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986366.465319:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993514368 00000100:00100000:0.0:1788986366.465330:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993514368 00000100:00100000:0.0:1788986366.465409:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 767 00000100:00100000:0.0:1788986366.465421:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993514368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986366.465467:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986366.465542:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993514368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986366.465550:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 767 00000100:00100000:3.0:1788986366.465820:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993514368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986366.912543:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986367.936626:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986368.112471:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986368.112524:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986368.112563:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986368.112602:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986368.112692:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971301376 00000100:00100000:0.0:1788986368.112704:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971301376 00000100:00100000:0.0:1788986368.112786:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1514 00000100:00100000:0.0:1788986368.112797:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971301376:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986368.112898:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971301376:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 103us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986368.112906:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1514 00000100:00080000:1.0:1788986368.113035:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986368.113160:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971301248 00000100:00100000:2.0:1788986368.113166:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971301248 00000100:00100000:2.0:1788986368.113209:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1214 00000100:00100000:2.0:1788986368.113217:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971301248:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986368.113249:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971301248:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986368.113255:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1214 00000100:00100000:2.0:1788986368.113429:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971301504 00000100:00100000:2.0:1788986368.113434:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971301504 00000100:00100000:2.0:1788986368.113477:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971301632 00000100:00100000:2.0:1788986368.113480:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971301632 00000100:00100000:2.0:1788986368.113508:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1105 00000100:00100000:2.0:1788986368.113516:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094381b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971301504:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986368.113552:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094381b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971301504:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986368.113559:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1105 00000100:00100000:2.0:1788986368.113571:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1106 00000100:00100000:2.0:1788986368.113577:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971301632:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986368.113602:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943818700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971301632:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986368.113607:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1106 00000100:00080000:1.0:1788986368.113963:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986368.113967:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986368.551267:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986368.551939:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971301760 00000100:00100000:1.0:1788986368.551952:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971301760 00000100:00100000:1.0:1788986368.552022:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 798 00000100:00100000:1.0:1788986368.552034:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47897:x1875885971301760:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986368.552970:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47897:x1875885971301760:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 929us (2465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986368.552982:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 798 00000100:00100000:2.0:1788986368.572694:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986368.574013:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971301888 00000100:00100000:0.0:1788986368.574032:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971301888 00000100:00100000:0.0:1788986368.574148:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 436 00000100:00100000:0.0:1788986368.574161:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47897:x1875885971301888:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986368.575623:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47897:x1875885971301888:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 1455us (2933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986368.575637:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 436 00000100:00100000:2.0:1788986368.578850:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986368.579123:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971302016 00000100:00100000:1.0:1788986368.579151:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971302016 00000100:00100000:1.0:1788986368.579219:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 437 00000100:00100000:1.0:1788986368.579230:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47897:x1875885971302016:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986368.579981:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47897:x1875885971302016:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 750us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986368.579995:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 437 00000100:00100000:3.0:1788986368.584380:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986368.584625:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971302144 00000100:00100000:1.0:1788986368.584638:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971302144 00000100:00100000:1.0:1788986368.584711:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 799 00000100:00100000:1.0:1788986368.584721:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47897:x1875885971302144:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986368.585339:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47897:x1875885971302144:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 617us (981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986368.585348:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 799 00000100:00100000:3.0:1788986368.592164:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986368.592238:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971302272 00000100:00100000:1.0:1788986368.592251:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971302272 00000100:00100000:1.0:1788986368.592323:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 800 00000100:00100000:1.0:1788986368.592335:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47897:x1875885971302272:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986368.592488:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47897:x1875885971302272:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 155us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986368.592497:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 800 00000100:00100000:3.0:1788986368.603165:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986368.604398:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971302400 00000100:00100000:3.0:1788986368.604413:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971302400 00000100:00100000:3.0:1788986368.604487:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 438 00000100:00100000:3.0:1788986368.604499:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47897:x1875885971302400:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986368.606543:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47897:x1875885971302400:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 2032us (3379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986368.606892:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 438 00000100:00100000:3.0:1788986368.610060:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986368.610269:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971302528 00000100:00100000:2.0:1788986368.610282:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971302528 00000100:00100000:2.0:1788986368.610429:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 439 00000100:00100000:2.0:1788986368.610439:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47897:x1875885971302528:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986368.613716:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:47897:x1875885971302528:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 3261us (3652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986368.613732:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 439 00000100:00100000:2.0:1788986368.630543:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986368.630711:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971302656 00000100:00100000:0.0:1788986368.630723:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971302656 00000100:00100000:0.0:1788986368.630797:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 801 00000100:00100000:0.0:1788986368.630809:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47897:x1875885971302656:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986368.634882:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47897:x1875885971302656:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 4060us (4340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986368.634902:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 801 00000100:00100000:1.0:1788986368.665440:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986368.665488:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971302784 00000100:00100000:1.0:1788986368.665499:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971302784 00000100:00100000:1.0:1788986368.665994:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 802 00000100:00100000:1.0:1788986368.666009:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:47898:x1875885971302784:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986368.666036:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986368.667267:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548a7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11d2 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986368.667344:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548a85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986368.667371:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986368.667390:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986368.667424:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00000004:00200000:1.0:1788986368.667428:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986368.667447:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548a85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986368.667474:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548a7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11d2 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986368.667498:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548a85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11d2 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986368.667509:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:1.0:1788986368.667513:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986368.667516:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788986368.667596:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47898:x1875885971302784:12345-192.168.206.21@tcp:101:rm.0 Request processed in 1591us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986368.667606:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 802 00000100:00100000:1.0:1788986368.674920:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986368.675037:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971303040 00000100:00100000:3.0:1788986368.675055:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971303040 00000100:00100000:3.0:1788986368.675163:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 803 00000100:00100000:3.0:1788986368.675182:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:47898:x1875885971303040:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986368.675215:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986368.675253:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a8c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11d9 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986368.675389:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00010000:00010000:3.0:1788986368.675952:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a8c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11d9 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.675978:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:3.0:1788986368.675982:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788986368.675988:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a8c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11d9 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.676005:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788986368.676080:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:47898:x1875885971303040:12345-192.168.206.21@tcp:101:rm.0 Request processed in 906us (1170us total) trans 4294967597 rc 301/301 00000100:00100000:3.0:1788986368.677710:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 803 00000100:00100000:1.0:1788986368.687681:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986368.687738:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971303168 00000100:00100000:1.0:1788986368.687747:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971303168 00000100:00100000:1.0:1788986368.687804:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:1.0:1788986368.687830:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:47898:x1875885971303168:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:1.0:1788986368.693928:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:47898:x1875885971303168:12345-192.168.206.21@tcp:37:rm.0 Request processed in 6104us (6246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986368.693941:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 80 00000100:00100000:3.0:1788986368.702479:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986368.702532:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971303424 00000100:00100000:3.0:1788986368.702547:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971303424 00000100:00100000:3.0:1788986368.702684:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:3.0:1788986368.702697:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:47898:x1875885971303424:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:3.0:1788986368.703320:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:47898:x1875885971303424:12345-192.168.206.21@tcp:35:rm.0 Request processed in 622us (854us total) trans 4294967598 rc 0/0 00000100:00100000:3.0:1788986368.703330:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 81 00000100:00100000:3.0:1788986368.710483:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986368.710529:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971303680 00000100:00100000:3.0:1788986368.710540:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971303680 00000100:00100000:3.0:1788986368.710677:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 804 00000100:00100000:3.0:1788986368.710689:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:47898:x1875885971303680:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788986368.710755:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788986368.710788:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548a85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11d2 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.710816:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548a2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3c:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11bd expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.710994:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:3.0:1788986368.711020:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548744 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1107 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.711033:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:3.0:1788986368.711043:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986368.711073:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a9a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.711112:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.711125:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.711141:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548aa1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.711148:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548aa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.711543:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548aa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.712346:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548aa8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.712438:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.712447:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986368.718064:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x3c:0x0]: returning size 16384 00010000:00010000:3.0:1788986368.718120:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548aa8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718132:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548aa8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718141:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548aa8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718148:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986368.718627:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548aa8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718640:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548aa8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718659:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3c:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:3.0:1788986368.718663:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986368.718670:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548aa8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718678:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548aa8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x3c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718709:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a9a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718718:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a9a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718725:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718731:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986368.718735:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a9a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718742:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a9a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718750:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:3.0:1788986368.718753:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986368.718757:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a9a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.718763:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548a9a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986368.718779:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000090889ddc reply state 00000000763fdc96 transno 4294967599 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548aa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986368.718789:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986368.718917:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:47898:x1875885971303680:12345-192.168.206.21@tcp:36:rm.0 Request processed in 8224us (8441us total) trans 4294967599 rc 0/0 00000100:00100000:3.0:1788986368.718928:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 804 00010000:00010000:3.0:1788986368.726506:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548aa1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.726535:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548aa1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.726544:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548aa1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.726551:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986368.728269:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548aa1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.728301:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548aa1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.728323:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x6cc3edf1 (ffff9b0a55745000) 00010000:00010000:3.0:1788986368.728327:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986368.728333:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548aa1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986368.728342:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548aa1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x6cc3edf1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986368.964305:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986369.988470:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986370.049230:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986370.049250:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993514496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986370.049318:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986370.049391:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993514496 00000100:00100000:3.0:1788986370.049399:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993514496 00000100:00100000:3.0:1788986370.049455:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 768 00000100:00100000:3.0:1788986370.049464:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993514496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986370.049494:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986370.049536:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993514496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986370.049543:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 768 00000100:00080000:3.0:1788986370.049563:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986370.049598:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993514496:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788986370.448906:0:81706:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeeed70c70 20000000:00000080:0.0:1788986370.448922:0:81706:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a797dc800 uarg=0000000000000000 00010000:00010000:0.0:1788986370.453271:0:81706:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986370.453293:0:81706:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986370.453394:0:81706:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986370.453413:0:81706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986370.453430:0:81706:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548736 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54872f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986370.453438:0:81706:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986370.453473:0:81706:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548736 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54872f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986370.453489:0:81706:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548736 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54872f expref: 18 pid: 5846 timeout: 2254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986370.453502:0:81706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81706:1875885993514624:0@lo:104: 00000100:00100000:0.0:1788986370.453728:0:81706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986370.454011:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993514624 00000100:00100000:3.0:1788986370.454019:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993514624 00000100:00100000:0.0:1788986370.455250:0:81706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76320000 going to sleep for 11 seconds 00000100:00100000:3.0:1788986370.456134:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788986370.456151:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:81706:x1875885993514624:12345-0@lo:104: 00010000:00010000:3.0:1788986370.456224:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548736 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986370.458928:0:81706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81706:1875885993514624:0@lo:104: 00010000:00010000:0.0:1788986370.458956:0:81706:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986370.458995:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986370.459006:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:81706:x1875885993514624:12345-0@lo:104: Request processed in 2862us (5277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986370.459018:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00010000:00010000:2.0:1788986370.470637:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986370.470651:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548736 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.470664:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986370.470669:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548736 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.470680:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548736 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986370.470687:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548736 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986370.470693:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986370.470755:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548736 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.470761:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986370.470789:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548736 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.470796:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf54872f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548736 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.470815:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986370.470817:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986370.470818:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986370.470835:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986370.470852:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993514752:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986370.470914:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986370.470971:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993514752 00000100:00100000:2.0:1788986370.470979:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993514752 00010000:00010000:2.0:1788986370.471006:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548736 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54872f expref: 19 pid: 5846 timeout: 2254 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986370.471038:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788986370.471047:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993514752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986370.471059:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986370.471063:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548736 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54872f expref: 19 pid: 5846 timeout: 2254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.471073:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548736 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54872f expref: 19 pid: 5846 timeout: 2254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.471086:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf548736 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54872f expref: 19 pid: 5846 timeout: 2254 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.471116:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.471126:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.471141:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.471148:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.471155:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.471161:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.471171:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986370.471175:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.471182:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.471194:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986370.471202:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986370.471237:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993514752:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986370.471244:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:2.0:1788986370.471284:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80717100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993514752:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986370.471441:0:81706:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986370.471450:0:81706:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986370.471457:0:81706:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548aaf lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986371.009691:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986371.072382:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993515264:0@lo:400:kworker.0 00000100:00100000:1.0:1788986371.072494:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986371.072565:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788986371.072572:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993514880:0@lo:400:kworker.0 00000100:00100000:1.0:1788986371.072598:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986371.072615:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993515392:0@lo:400:kworker.0 00000100:00100000:1.0:1788986371.072640:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986371.072683:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993515264 00000100:00100000:1.0:1788986371.072692:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993515264 00000100:00100000:1.0:1788986371.072751:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993514880 00000100:00100000:1.0:1788986371.072755:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993514880 00000100:00100000:1.0:1788986371.072779:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:1.0:1788986371.072788:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993515264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986371.072843:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993515264:12345-0@lo:400:kworker.0 Request processed in 56us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986371.072853:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:1.0:1788986371.072875:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:1.0:1788986371.072882:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993514880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986371.072895:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993515136:0@lo:400:kworker.0 00000100:00100000:1.0:1788986371.072915:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993514880:12345-0@lo:400:kworker.0 Request processed in 32us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986371.072922:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:2.0:1788986371.072939:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986371.072974:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993514880:0@lo:400:kworker.0 00000100:00100000:2.0:1788986371.072983:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986371.072992:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f430700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993515264:0@lo:400:kworker.0 00000100:00100000:2.0:1788986371.072994:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993515008:0@lo:400:kworker.0 00000100:00100000:2.0:1788986371.073026:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986371.073057:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993515008 00000100:00100000:1.0:1788986371.073061:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993515008 00000100:00100000:1.0:1788986371.073120:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:1.0:1788986371.073129:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993515008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986371.073135:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993515392 00000100:00100000:2.0:1788986371.073141:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993515392 00000100:00100000:1.0:1788986371.073173:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993515008:12345-0@lo:400:kworker.0 Request processed in 46us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986371.073180:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993515136 00000100:00100000:1.0:1788986371.073181:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:2.0:1788986371.073186:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993515136 00000100:00100000:2.0:1788986371.073218:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1788986371.073226:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993515392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986371.073229:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1788986371.073242:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993515136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986371.073277:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993515392:12345-0@lo:400:kworker.0 Request processed in 52us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986371.073289:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1788986371.073290:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993515136:12345-0@lo:400:kworker.0 Request processed in 48us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986371.073300:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1788986371.073741:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993515008:0@lo:400:kworker.0 00000100:00100000:2.0:1788986371.073752:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993515136:0@lo:400:kworker.0 00000100:00100000:2.0:1788986371.073953:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993515392:0@lo:400:kworker.0 00000100:00080000:2.0:1788986371.074131:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986371.074137:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1788986371.350031:0:81754:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffb12a74e0 20000000:00000080:3.0:1788986371.350055:0:81754:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76001400 uarg=0000000000000000 00010000:00010000:3.0:1788986371.352187:0:81754:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986371.352561:0:81754:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986371.352594:0:81754:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986371.352620:0:81754:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548ab6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986371.352639:0:81754:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548ab6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986371.352652:0:81754:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548ab6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986371.352665:0:81754:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548ab6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986371.352673:0:81754:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548ab6 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986371.352681:0:81754:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548ab6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986371.352688:0:81754:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986371.352693:0:81754:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548ab6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986371.352701:0:81754:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548ab6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986371.352716:0:81754:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548ab6 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986371.352724:0:81754:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548ab6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986371.352730:0:81754:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548ab6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81754 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986371.586650:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993515520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986371.586747:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986371.586906:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993515520 00000100:00100000:3.0:1788986371.586916:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993515520 00000100:00100000:3.0:1788986371.586983:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 769 00000100:00100000:3.0:1788986371.586994:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993515520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986371.587038:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986371.587118:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993515520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986371.587126:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 769 00000100:00100000:2.0:1788986371.588466:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993515520:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1788986371.648603:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986371.648613:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986371.648619:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986371.648679:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986371.648693:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986371.648707:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986371.648737:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993515648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986371.648823:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986371.648898:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a432fcc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788986371.649532:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993515648 00000100:00100000:0.0:1788986371.649543:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993515648 00000100:00100000:0.0:1788986371.649609:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:0.0:1788986371.649620:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993515648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986371.649635:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986371.649652:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548ac4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548abd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986371.649680:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548ac4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548abd expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986371.649692:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548ac4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548abd expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986371.649702:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788986371.649756:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993515648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986371.649763:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:1.0:1788986371.649877:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993515648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986371.649895:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548ac4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986371.649911:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548ac4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986371.649934:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986371.649940:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548ac4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986371.649948:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548ac4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986372.034074:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986372.313083:0:81802:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd5dd5a810 20000000:00000080:2.0:1788986372.313142:0:81802:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0941d3a000 uarg=0000000000000000 00010000:00010000:2.0:1788986372.313435:0:81802:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986372.313455:0:81802:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986372.313479:0:81802:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986372.313503:0:81802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986372.313524:0:81802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548ac4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548abd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986372.313720:0:81802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986372.313777:0:81802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548ac4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548abd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986372.313796:0:81802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548ac4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548abd expref: 18 pid: 5846 timeout: 2256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986372.314029:0:81802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81802:1875885993515776:0@lo:104: 00000100:00100000:2.0:1788986372.314255:0:81802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986372.314547:0:81802:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a432fcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788986372.314675:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993515776 00000100:00100000:0.0:1788986372.314686:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993515776 00000100:00100000:0.0:1788986372.314884:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:0.0:1788986372.314896:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:81802:x1875885993515776:12345-0@lo:104: 00010000:00010000:0.0:1788986372.314914:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548ac4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986372.315038:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986372.315045:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:81802:x1875885993515776:12345-0@lo:104: Request processed in 152us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986372.315053:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00010000:00010000:3.0:1788986372.315131:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986372.315140:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548ac4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315148:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986372.315153:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548ac4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315163:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548ac4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986372.315170:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548ac4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986372.315176:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986372.315319:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548ac4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315328:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986372.315371:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548ac4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315380:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548abd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548ac4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315400:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986372.315402:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986372.315404:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986372.315421:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986372.315435:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993515904:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986372.315487:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986372.315531:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993515904 00000100:00100000:3.0:1788986372.315536:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993515904 00010000:00010000:3.0:1788986372.315561:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548ac4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548abd expref: 19 pid: 5846 timeout: 2256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986372.315586:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:3.0:1788986372.315594:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993515904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986372.315605:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986372.315611:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548ac4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548abd expref: 19 pid: 5846 timeout: 2256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315862:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548ac4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548abd expref: 19 pid: 5846 timeout: 2256 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315882:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315892:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315911:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315919:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315927:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315939:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315945:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986372.315950:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315959:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315969:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986372.315980:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986372.316024:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993515904:12345-0@lo:103:ldlm_bl.0 Request processed in 430us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986372.316031:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788986372.316067:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993515904:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986372.316372:0:81802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf548ac4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548abd expref: 18 pid: 5846 timeout: 2256 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986372.316385:0:81802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:81802:1875885993515776:0@lo:104: 00010000:00010000:2.0:1788986372.316399:0:81802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986372.316421:0:81802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986372.316428:0:81802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986372.316435:0:81802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548acb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 81802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986373.059180:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986373.195894:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967599 is committed 00000100:00100000:3.0:1788986373.237895:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986373.237974:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986373.238014:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986373.238035:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986373.238076:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971304064 00000100:00100000:1.0:1788986373.238105:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971304064 00000100:00100000:1.0:1788986373.238163:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971304192 00000100:00100000:1.0:1788986373.238166:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971304192 00000100:00100000:1.0:1788986373.238190:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1109 00000100:00100000:1.0:1788986373.238199:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971304064:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986373.238266:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971304064:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986373.238273:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1109 00000100:00100000:1.0:1788986373.238288:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1110 00000100:00100000:1.0:1788986373.238294:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971304192:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986373.238317:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971304192:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986373.238322:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1110 00000100:00100000:1.0:1788986373.238351:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971303936 00000100:00100000:1.0:1788986373.238355:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971303936 00000100:00100000:1.0:1788986373.238388:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1518 00000100:00100000:1.0:1788986373.238394:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971303936:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986373.238395:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971303808 00000100:00100000:0.0:1788986373.238402:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971303808 00000100:00100000:1.0:1788986373.238435:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971303936:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 41us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986373.238439:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1216 00000100:00100000:1.0:1788986373.238448:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1518 00000100:00100000:0.0:1788986373.238454:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971303808:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986373.238484:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971303808:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986373.238491:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1216 00000100:00080000:3.0:1788986373.238652:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986373.238657:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986373.238659:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1788986373.440194:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986373.440202:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986373.440207:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986373.440253:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986373.440265:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986373.440276:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986373.440301:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993516032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986373.440380:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986373.440438:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a50309540 going to sleep for 11 seconds 00000100:00100000:2.0:1788986373.440522:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993516032 00000100:00100000:2.0:1788986373.440529:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993516032 00000100:00100000:2.0:1788986373.440580:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1217 00000100:00100000:2.0:1788986373.440589:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993516032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986373.440602:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986373.440614:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548ad9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548ad2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986373.440637:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548ad9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548ad2 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986373.440647:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548ad9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548ad2 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986373.440655:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0a00, rc 0) 00000100:00100000:2.0:1788986373.440713:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993516032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986373.440719:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1217 00000100:00100000:1.0:1788986373.440878:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993516032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986373.440894:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548ad9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986373.440903:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548ad9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986373.440922:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986373.440927:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548ad9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986373.440934:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548ad9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986374.089447:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986375.104968:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986375.168314:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993516160:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986375.168403:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986375.168616:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993516160 00000100:00100000:3.0:1788986375.168625:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993516160 00000100:00100000:3.0:1788986375.168689:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1788986375.168699:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993516160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986375.168732:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986375.168780:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993516160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986375.168787:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 770 00000100:00100000:3.0:1788986375.168838:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993516160:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986375.168887:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1788986376.104374:0:82000:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0d787d60 20000000:00000080:0.0:1788986376.104390:0:82000:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f4c5400 uarg=0000000000000000 00010000:00010000:0.0:1788986376.105425:0:82000:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986376.105442:0:82000:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986376.105461:0:82000:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986376.105480:0:82000:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986376.105497:0:82000:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548ad9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548ad2 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986376.105505:0:82000:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986376.105541:0:82000:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548ad9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548ad2 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986376.105556:0:82000:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548ad9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548ad2 expref: 18 pid: 5849 timeout: 2260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986376.105569:0:82000:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82000:1875885993516288:0@lo:104: 00000100:00100000:0.0:1788986376.106551:0:82000:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986376.106616:0:82000:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c61840 going to sleep for 11 seconds 00000100:00100000:3.0:1788986376.106769:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993516288 00000100:00100000:3.0:1788986376.106779:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993516288 00000100:00100000:3.0:1788986376.106839:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:3.0:1788986376.106848:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:82000:x1875885993516288:12345-0@lo:104: 00010000:00010000:3.0:1788986376.106862:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548ad9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986376.106941:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986376.106948:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:82000:x1875885993516288:12345-0@lo:104: Request processed in 101us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986376.106954:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788986376.107029:0:82000:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82000:1875885993516288:0@lo:104: 00010000:00010000:1.0:1788986376.107051:0:82000:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107112:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986376.107120:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548ad9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107127:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986376.107131:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548ad9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107139:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548ad9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986376.107145:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548ad9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986376.107151:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986376.107185:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548ad9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107192:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986376.107220:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548ad9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107228:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf548ad2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548ad9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107245:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986376.107246:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986376.107248:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986376.107255:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986376.107266:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993516416:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986376.107302:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986376.107355:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993516416 00000100:00100000:2.0:1788986376.107360:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993516416 00010000:00010000:2.0:1788986376.107382:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548ad9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548ad2 expref: 19 pid: 5849 timeout: 2260 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986376.107405:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788986376.107412:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993516416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986376.107422:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986376.107427:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548ad9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548ad2 expref: 19 pid: 5849 timeout: 2260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107437:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548ad9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548ad2 expref: 19 pid: 5849 timeout: 2260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107450:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf548ad9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548ad2 expref: 19 pid: 5849 timeout: 2260 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107463:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107472:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107486:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107494:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107500:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107507:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107512:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986376.107517:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107523:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107534:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.107542:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986376.107572:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993516416:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986376.107579:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:2.0:1788986376.107612:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993516416:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986376.107704:0:82000:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986376.107717:0:82000:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986376.107723:0:82000:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf548ae0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82000 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986376.130753:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986376.208389:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993516544:0@lo:400:kworker.0 00000100:00100000:3.0:1788986376.208454:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986376.208510:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993517056:0@lo:400:kworker.0 00000100:00100000:3.0:1788986376.208536:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986376.208561:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986376.208568:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993516672:0@lo:400:kworker.0 00000100:00100000:3.0:1788986376.208929:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986376.209005:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993516928:0@lo:400:kworker.0 00000100:00100000:3.0:1788986376.209032:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986376.209133:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993516800:0@lo:400:kworker.0 00000100:00100000:2.0:1788986376.209162:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986376.209411:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993517056 00000100:00100000:2.0:1788986376.209419:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993517056 00000100:00100000:2.0:1788986376.209462:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993516800 00000100:00100000:2.0:1788986376.209465:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993516800 00000100:00100000:2.0:1788986376.209488:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1788986376.209496:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993517056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986376.209552:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993517056:12345-0@lo:400:kworker.0 Request processed in 54us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986376.209559:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1788986376.209595:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1788986376.209603:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993516800:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788986376.210176:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986376.210405:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993516800:12345-0@lo:400:kworker.0 Request processed in 802us (1240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986376.210413:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1788986376.210459:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942b0dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993517056:0@lo:400:kworker.0 00000100:00100000:0.0:1788986376.211941:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993516800:0@lo:400:kworker.0 00000100:00100000:1.0:1788986376.218284:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993516544 00000100:00100000:1.0:1788986376.218297:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993516544 00000100:00100000:3.0:1788986376.218397:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993516672 00000100:00100000:3.0:1788986376.218402:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993516672 00000100:00100000:3.0:1788986376.218461:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993516928 00000100:00100000:3.0:1788986376.218465:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993516928 00000100:00100000:3.0:1788986376.218492:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519 00000100:00100000:3.0:1788986376.218501:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993516672:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788986376.218759:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986376.218882:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1788986376.218893:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993516928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986376.219000:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993516672:0@lo:400:kworker.0 00000100:00100000:0.0:1788986376.219137:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993516928:12345-0@lo:400:kworker.0 Request processed in 247us (10102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986376.219148:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:0.0:1788986376.219199:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:0.0:1788986376.219206:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993516544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986376.219244:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993516544:12345-0@lo:400:kworker.0 Request processed in 40us (10791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986376.219250:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:0.0:1788986376.219286:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993516544:0@lo:400:kworker.0 00000100:00100000:2.0:1788986376.219770:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993516928:0@lo:400:kworker.0 00000100:00100000:3.0:1788986376.224053:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993516672:12345-0@lo:400:kworker.0 Request processed in 5542us (15113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986376.224067:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519 00000100:00100000:0.0:1788986376.705009:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993517184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986376.705080:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986376.705217:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993517184 00000100:00100000:3.0:1788986376.705229:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993517184 00000100:00100000:3.0:1788986376.705282:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 771 00000100:00100000:3.0:1788986376.705292:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993517184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986376.705336:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986376.705383:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993517184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986376.705390:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 771 00000100:00100000:0.0:1788986376.707948:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993517184:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986377.158754:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788986377.344749:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986377.344757:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986377.344762:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986377.344818:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986377.344830:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986377.344841:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986377.344866:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993517312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986377.344928:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986377.344990:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a52ecdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788986377.345118:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993517312 00000100:00100000:0.0:1788986377.345129:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993517312 00000100:00100000:0.0:1788986377.345183:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1218 00000100:00100000:0.0:1788986377.345192:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993517312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986377.345204:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986377.345217:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf548aee lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548ae7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986377.345240:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf548aee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548ae7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986377.345251:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf548aee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548ae7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986377.345260:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee000, rc 0) 00000100:00100000:0.0:1788986377.345319:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993517312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986377.345326:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1218 00000100:00100000:1.0:1788986377.345881:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993517312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986377.345897:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548aee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986377.345907:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548aee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986377.345926:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986377.345930:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548aee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986377.345937:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548aee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986378.178331:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986378.360940:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986378.362854:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986378.362886:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986378.362958:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971304320 00000100:00100000:3.0:1788986378.362967:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971304320 00000100:00100000:3.0:1788986378.363026:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1219 00000100:00100000:3.0:1788986378.363036:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971304320:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986378.363120:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971304320:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 86us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986378.363128:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1219 00000100:00100000:1.0:1788986378.364517:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986378.364565:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971304576 00000100:00100000:0.0:1788986378.364573:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971304576 00000100:00100000:0.0:1788986378.364676:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971304704 00000100:00100000:0.0:1788986378.364680:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971304704 00000100:00080000:1.0:1788986378.364726:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986378.364730:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986378.364987:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971304448 00000100:00100000:2.0:1788986378.364992:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971304448 00000100:00100000:2.0:1788986378.365038:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1522 00000100:00100000:2.0:1788986378.365047:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971304448:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986378.365129:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971304448:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 83us (4198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986378.365136:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1522 00000100:00080000:1.0:1788986378.365277:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986378.365507:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1113 00000100:00100000:3.0:1788986378.365517:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971304576:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986378.365564:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971304576:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 49us (2678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986378.365572:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1113 00000100:00100000:3.0:1788986378.365588:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1114 00000100:00100000:3.0:1788986378.365595:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971304704:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986378.365620:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f430700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971304704:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986378.365626:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1114 00010000:00010000:0.0:1788986379.202617:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986380.226108:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986380.288455:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986380.288477:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993517440:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986380.288541:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986380.290155:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993517440 00000100:00100000:3.0:1788986380.290165:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993517440 00000100:00100000:3.0:1788986380.290498:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 772 00000100:00100000:3.0:1788986380.290512:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993517440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986380.290550:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986380.290619:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993517440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (2078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986380.290626:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 772 00000100:00100000:3.0:1788986380.290683:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993517440:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986380.290775:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986381.248260:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986381.312463:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993517696:0@lo:400:kworker.0 00000100:00100000:1.0:1788986381.312546:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986381.312602:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993518208:0@lo:400:kworker.0 00000100:00100000:1.0:1788986381.312627:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986381.312650:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986381.312669:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993517824:0@lo:400:kworker.0 00000100:00100000:1.0:1788986381.312690:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986381.312717:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993517696 00000100:00100000:1.0:1788986381.312724:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993517696 00000100:00100000:1.0:1788986381.312771:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993517824 00000100:00100000:1.0:1788986381.312774:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993517824 00000100:00100000:1.0:1788986381.312803:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:1.0:1788986381.312811:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993517696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986381.312859:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993517696:12345-0@lo:400:kworker.0 Request processed in 49us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986381.312866:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:1.0:1788986381.312881:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:1.0:1788986381.312887:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993517824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986381.312911:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993517824:12345-0@lo:400:kworker.0 Request processed in 25us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986381.312917:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00080000:1.0:1788986381.312943:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986381.312976:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993517824:0@lo:400:kworker.0 00000100:00100000:1.0:1788986381.312987:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993517696:0@lo:400:kworker.0 00000100:00100000:0.0:1788986381.313241:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993517952:0@lo:400:kworker.0 00000100:00100000:0.0:1788986381.313274:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986381.313313:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788986381.313319:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993517568:0@lo:400:kworker.0 00000100:00100000:0.0:1788986381.313343:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986381.313364:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993518080:0@lo:400:kworker.0 00000100:00100000:0.0:1788986381.313384:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986381.313412:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993517568 00000100:00100000:0.0:1788986381.313416:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993517568 00000100:00100000:0.0:1788986381.313441:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1788986381.313456:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993517568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986381.313502:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993517568:12345-0@lo:400:kworker.0 Request processed in 54us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986381.313508:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00100000:0.0:1788986381.313535:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993518080 00000100:00100000:0.0:1788986381.313538:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993518080 00000100:00100000:0.0:1788986381.313561:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:0.0:1788986381.313567:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993518080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986381.313591:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993518080:12345-0@lo:400:kworker.0 Request processed in 24us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986381.313596:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00080000:0.0:1788986381.313607:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986381.313618:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993517568:0@lo:400:kworker.0 00000100:00100000:0.0:1788986381.313634:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993518080:0@lo:400:kworker.0 00000100:00100000:3.0:1788986381.313860:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993518208 00000100:00100000:3.0:1788986381.313865:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993518208 00000100:00100000:3.0:1788986381.313907:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993517952 00000100:00100000:3.0:1788986381.313911:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993517952 00000100:00100000:3.0:1788986381.313939:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1788986381.313946:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993518208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986381.313985:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993518208:12345-0@lo:400:kworker.0 Request processed in 40us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986381.313991:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1788986381.314005:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1788986381.314012:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993517952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986381.314043:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993517952:12345-0@lo:400:kworker.0 Request processed in 32us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986381.314048:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:3.0:1788986381.314083:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993517952:0@lo:400:kworker.0 00000100:00100000:3.0:1788986381.314130:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993518208:0@lo:400:kworker.0 00000100:00080000:0.0:1788986381.315357:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986381.824333:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986381.824354:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993518336:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986381.824411:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986381.824462:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993518336 00000100:00100000:0.0:1788986381.824469:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993518336 00000100:00100000:0.0:1788986381.824510:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 773 00000100:00100000:0.0:1788986381.824519:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993518336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986381.824550:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986381.824589:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993518336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986381.824596:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 773 00000100:00100000:0.0:1788986381.824640:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993518336:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986382.273223:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986383.296362:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986383.477168:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986383.477205:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986383.477234:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986383.477258:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986383.477305:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971305216 00000100:00100000:3.0:1788986383.477317:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971305216 00000100:00100000:2.0:1788986383.477396:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971304960 00000100:00100000:2.0:1788986383.477401:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971304960 00000100:00100000:1.0:1788986383.481893:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971304832 00000100:00100000:1.0:1788986383.481915:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971304832 00000100:00100000:1.0:1788986383.481998:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1221 00000100:00100000:1.0:1788986383.482011:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971304832:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986383.482136:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971304832:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 127us (4900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986383.482158:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1221 00000100:00100000:3.0:1788986383.484066:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971305088 00000100:00100000:3.0:1788986383.484081:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971305088 00000100:00100000:1.0:1788986383.484177:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1117 00000100:00100000:1.0:1788986383.484193:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971305216:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986383.484298:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971305216:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 108us (7089us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986383.484306:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1117 00000100:00100000:2.0:1788986383.491932:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1526 00000100:00100000:2.0:1788986383.491955:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971304960:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986383.492074:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971304960:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 127us (14917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986383.492105:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1526 00000100:00100000:3.0:1788986383.492680:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1118 00000100:00100000:3.0:1788986383.492691:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971305088:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986383.492738:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971305088:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 49us (15478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986383.492745:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1118 00000100:00080000:0.0:1788986383.494578:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986383.494634:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986383.494640:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788986384.323765:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986385.345451:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986385.412429:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993518464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986385.412534:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986385.412753:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993518464 00000100:00100000:0.0:1788986385.412764:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993518464 00000100:00100000:0.0:1788986385.412849:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1788986385.412860:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993518464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986385.412906:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986385.412965:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993518464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986385.412973:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 774 00000100:00100000:0.0:1788986385.413034:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993518464:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986385.413489:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:0.0:1788986386.125856:0:82345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 20: test nodemap mapped_admin fileops ========================================================== 16:39:44 (1788986384) 00010000:00010000:1.0:1788986386.370676:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986386.433195:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993518592:0@lo:400:kworker.0 00000100:00100000:1.0:1788986386.433276:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986386.438327:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993518592 00000100:00100000:2.0:1788986386.438340:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993518592 00000100:00100000:2.0:1788986386.438398:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1222 00000100:00100000:2.0:1788986386.438408:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993518592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.443014:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993518976:0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.443081:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986386.443133:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986386.443139:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993519104:0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.443165:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986386.443195:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993518720:0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.443218:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986386.443239:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993519232:0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.443273:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986386.443293:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986386.443299:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993518848:0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.443321:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986386.443378:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993519104 00000100:00100000:0.0:1788986386.443384:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993519104 00000100:00100000:0.0:1788986386.443429:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993518720 00000100:00100000:0.0:1788986386.443432:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993518720 00000100:00100000:0.0:1788986386.443450:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993518848 00000100:00100000:0.0:1788986386.443453:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993518848 00000100:00100000:0.0:1788986386.443468:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:0.0:1788986386.443474:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993519104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.443517:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993519104:12345-0@lo:400:kworker.0 Request processed in 43us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986386.443523:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:0.0:1788986386.443537:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:0.0:1788986386.443542:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993518720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.443570:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993518720:12345-0@lo:400:kworker.0 Request processed in 28us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986386.443575:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:0.0:1788986386.443584:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:0.0:1788986386.443589:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993518848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.443608:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993518848:12345-0@lo:400:kworker.0 Request processed in 20us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986386.443612:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00100000:0.0:1788986386.443631:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993518976 00000100:00100000:0.0:1788986386.443635:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993518976 00000100:00100000:0.0:1788986386.443653:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993519232 00000100:00100000:0.0:1788986386.443655:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993519232 00000100:00100000:0.0:1788986386.443671:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1788986386.443676:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993518976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.443699:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993518976:12345-0@lo:400:kworker.0 Request processed in 24us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986386.443704:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1788986386.443713:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1788986386.443718:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993519232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.443737:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993519232:12345-0@lo:400:kworker.0 Request processed in 20us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986386.443741:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00080000:0.0:1788986386.444133:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986386.444137:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986386.444221:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993518848:0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.444290:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993519104:0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.444299:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993518976:0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.444326:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993518720:0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.444335:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993519232:0@lo:400:kworker.0 00000100:00100000:2.0:1788986386.446319:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993518592:12345-0@lo:400:kworker.0 Request processed in 7906us (13036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986386.446331:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1222 00000100:00100000:3.0:1788986386.454158:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993518592:0@lo:400:kworker.0 00000100:00100000:0.0:1788986386.945187:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993519360:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986386.945286:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986386.945380:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993519360 00000100:00100000:0.0:1788986386.945389:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993519360 00000100:00100000:0.0:1788986386.945450:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 775 00000100:00100000:0.0:1788986386.945460:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993519360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986386.945990:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986386.946068:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993519360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 609us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986386.946076:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 775 00000100:00100000:2.0:1788986386.946580:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993519360:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986387.398431:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:2.0:1788986387.498399:0:82393:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1788986387.513389:0:82393:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:1.0:1788986388.425516:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986388.484555:0:82441:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf673e030 20000000:00000080:2.0:1788986388.484570:0:82441:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7673dc00 uarg=0000000000000000 10000000:01000000:2.0:1788986388.485502:0:82441:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986388.485521:0:82441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.485539:0:82441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf548aee lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548ae7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.485547:0:82441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.485582:0:82441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf548aee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548ae7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.485595:0:82441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf548aee lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548ae7 expref: 18 pid: 5846 timeout: 2272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986388.485609:0:82441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82441:1875885993519488:0@lo:104: 00000100:00100000:2.0:1788986388.485670:0:82441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986388.485763:0:82441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788986388.485808:0:7642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788986388.485820:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993519488 00000100:00100000:3.0:1788986388.485827:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993519488 00000100:00100000:3.0:1788986388.485901:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:3.0:1788986388.485911:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a6067b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:82441:x1875885993519488:12345-0@lo:104: 00010000:00010000:3.0:1788986388.485922:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548aee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986388.485976:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986388.485981:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a6067b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:82441:x1875885993519488:12345-0@lo:104: Request processed in 73us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986388.485988:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00010000:00010000:1.0:1788986388.486062:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986388.486068:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548aee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986388.486076:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986388.486080:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548aee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986388.486109:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548aee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986388.486117:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548aee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986388.486123:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986388.486149:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548aee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986388.486155:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986388.486172:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548aee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986388.486184:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548ae7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548aee expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986388.486198:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986388.486200:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986388.486201:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986388.486316:0:82441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82441:1875885993519488:0@lo:104: 00010000:00010000:2.0:1788986388.486331:0:82441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986388.486445:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993519616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986388.486474:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986388.486873:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993519616 00000100:00100000:2.0:1788986388.486879:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993519616 00010000:00010000:2.0:1788986388.486901:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf548aee lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548ae7 expref: 19 pid: 5846 timeout: 2272 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986388.486961:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:2.0:1788986388.486969:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993519616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986388.486979:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986388.486984:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf548aee lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548ae7 expref: 19 pid: 5846 timeout: 2272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.487006:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf548aee lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548ae7 expref: 19 pid: 5846 timeout: 2272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.487019:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf548aee lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548ae7 expref: 19 pid: 5846 timeout: 2272 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.487032:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.487040:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.487054:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.487061:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.487068:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.487075:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.487080:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986388.487083:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.490770:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.490803:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986388.490818:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986388.490907:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993519616:12345-0@lo:103:ldlm_bl.0 Request processed in 3937us (4429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986388.490916:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00010000:00010000:1.0:1788986388.490984:0:82441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986388.490999:0:82441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986388.491006:0:82441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf548af5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986388.494730:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993519616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986388.592490:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986388.592535:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986388.592599:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971305472 00000100:00100000:3.0:1788986388.592609:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971305472 00000100:00100000:3.0:1788986388.592676:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1530 00000100:00100000:3.0:1788986388.592686:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971305472:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986388.592758:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971305472:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 73us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986388.592766:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1530 00000100:00100000:1.0:1788986388.592899:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971305344 00000100:00100000:1.0:1788986388.592903:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971305344 00000100:00100000:1.0:1788986388.592941:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1223 00000100:00100000:1.0:1788986388.592950:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971305344:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986388.592983:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971305344:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986388.592990:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1223 00000100:00080000:0.0:1788986388.593113:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986388.611877:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986388.612877:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986388.614395:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971305600 00000100:00100000:2.0:1788986388.614405:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971305600 00000100:00100000:0.0:1788986388.614475:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971305728 00000100:00100000:0.0:1788986388.614479:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971305728 00000100:00100000:0.0:1788986388.614569:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 440 00000100:00100000:0.0:1788986388.614579:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971305728:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:0.0:1788986388.614606:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf548450 00000100:00080000:0.0:1788986388.614615:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9b0943718000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788986388.614651:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967347 00000100:00100000:0.0:1788986388.614914:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971305728:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 335us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986388.614921:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 440 00010000:00010000:0.0:1788986388.615016:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788986388.615169:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986388.615173:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986388.615596:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 441 00000100:00100000:3.0:1788986388.615607:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971305600:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788986388.615624:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf5483a1 00000100:00080000:3.0:1788986388.615632:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b0a489ef000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788986388.615701:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967347 00000100:00100000:3.0:1788986388.615883:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971305600:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 278us (4014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986388.615891:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 441 00010000:00010000:3.0:1788986388.615910:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986389.406790:0:82489:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed4f86d80 20000000:00000080:2.0:1788986389.406805:0:82489:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76000c00 uarg=0000000000000000 10000000:01000000:2.0:1788986389.407035:0:82489:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986389.407053:0:82489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf548afc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986389.407067:0:82489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf548afc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986389.407077:0:82489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf548afc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986389.407084:0:82489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf548afc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986389.407125:0:82489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf548afc lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986389.407132:0:82489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf548afc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986389.407138:0:82489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986389.407142:0:82489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf548afc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986389.407150:0:82489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf548afc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986389.407163:0:82489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf548afc lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986389.407171:0:82489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf548afc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986389.407178:0:82489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf548afc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986389.446169:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788986390.310082:0:82537:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc9b52dcc0 20000000:00000080:1.0:1788986390.310513:0:82537:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80854000 uarg=0000000000000000 10000000:01000000:1.0:1788986390.310691:0:82537:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986390.310788:0:82537:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf548b03 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986390.310808:0:82537:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030200/0xc20d828fcf548b03 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986390.310819:0:82537:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf548b03 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986390.310826:0:82537:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf548b03 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986390.310832:0:82537:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf548b03 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986390.310839:0:82537:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030200/0xc20d828fcf548b03 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986390.310845:0:82537:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986390.310849:0:82537:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf548b03 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986390.310856:0:82537:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf548b03 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986390.310868:0:82537:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030200/0xc20d828fcf548b03 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986390.310875:0:82537:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030200/0xc20d828fcf548b03 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986390.310880:0:82537:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf548b03 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82537 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986390.465365:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788986390.528353:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986390.528360:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986390.528365:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986390.528403:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986390.528414:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986390.528425:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986390.528447:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993519744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986390.528510:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986390.528552:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a457dc300 going to sleep for 11 seconds 00000100:00100000:0.0:1788986390.528668:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986390.528681:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993519872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986390.528788:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986390.528823:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993519872 00000100:00100000:0.0:1788986390.528830:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993519872 00000100:00100000:0.0:1788986390.528881:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 776 00000100:00100000:0.0:1788986390.528889:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993519872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986390.528918:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986390.528957:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993519872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986390.528967:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 776 00000100:00080000:0.0:1788986390.528985:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986390.529015:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993519872:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986390.529674:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993519744 00000100:00100000:3.0:1788986390.529680:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993519744 00000100:00100000:3.0:1788986390.529720:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:3.0:1788986390.529728:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993519744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986390.529737:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986390.529752:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548b11 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548b0a expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986390.529773:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548b11 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548b0a expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986390.529785:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548b11 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548b0a expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986390.529793:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788986390.529843:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993519744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (1332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986390.529849:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:0.0:1788986390.530392:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993519744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986390.530410:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b11 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986390.530419:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548b11 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986390.530436:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986390.530440:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b11 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986390.530447:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b11 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788986391.105975:0:82586:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe09965de0 20000000:00000080:0.0:1788986391.105990:0:82586:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f3e7800 uarg=0000000000000000 10000000:01000000:0.0:1788986391.106341:0:82586:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986391.106361:0:82586:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986391.106378:0:82586:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548b11 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548b0a expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986391.106386:0:82586:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986391.106427:0:82586:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548b11 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548b0a expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986391.106439:0:82586:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548b11 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548b0a expref: 18 pid: 5848 timeout: 2275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986391.106454:0:82586:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82586:1875885993520000:0@lo:104: 00000100:00100000:0.0:1788986391.106510:0:82586:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986391.106614:0:82586:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c1480 going to sleep for 11 seconds 00000100:00100000:2.0:1788986391.106656:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993520000 00000100:00100000:2.0:1788986391.106665:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993520000 00000100:00100000:2.0:1788986391.112436:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:2.0:1788986391.112454:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:82586:x1875885993520000:12345-0@lo:104: 00010000:00010000:2.0:1788986391.112472:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548b11 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.112583:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986391.112589:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:82586:x1875885993520000:12345-0@lo:104: Request processed in 144us (6080us total) trans 0 rc 0/0 00010000:00010000:0.0:1788986391.112592:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788986391.112600:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00010000:00010000:0.0:1788986391.112603:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548b11 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986391.112614:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986391.112618:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548b11 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986391.112628:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548b11 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986391.112636:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548b11 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986391.112643:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986391.112687:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b11 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986391.112694:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986391.112728:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b11 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986391.112736:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf548b0a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b11 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986391.112755:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986391.112759:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986391.112761:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986391.112771:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986391.112785:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993520128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986391.112825:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986391.112952:0:82586:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82586:1875885993520000:0@lo:104: 00010000:00010000:1.0:1788986391.112974:0:82586:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986391.113035:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993520128 00000100:00100000:2.0:1788986391.113044:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993520128 00010000:00010000:2.0:1788986391.113071:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548b11 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548b0a expref: 19 pid: 5848 timeout: 2275 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986391.113121:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:2.0:1788986391.113130:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993520128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986391.113142:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986391.113148:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548b11 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548b0a expref: 19 pid: 5848 timeout: 2275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.113159:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548b11 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548b0a expref: 19 pid: 5848 timeout: 2275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.113179:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf548b11 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548b0a expref: 19 pid: 5848 timeout: 2275 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.113198:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.113206:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.113221:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.113228:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.113256:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.113264:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.113269:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986391.113274:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.113282:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.113303:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986391.113317:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986391.113466:0:82586:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986391.113475:0:82586:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986391.113481:0:82586:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b18 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82586 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986391.114146:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993520128:12345-0@lo:103:ldlm_bl.0 Request processed in 1015us (1317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986391.114155:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788986391.114519:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993520128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986391.488248:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986391.552470:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993520384:0@lo:400:kworker.0 00000100:00100000:0.0:1788986391.552546:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986391.552596:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986391.552603:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993520512:0@lo:400:kworker.0 00000100:00100000:0.0:1788986391.552639:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986391.552669:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993520384 00000100:00100000:0.0:1788986391.552675:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993520384 00000100:00100000:1.0:1788986391.552839:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993520640:0@lo:400:kworker.0 00000100:00100000:1.0:1788986391.552869:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986391.552889:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788986391.552894:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993520256:0@lo:400:kworker.0 00000100:00100000:1.0:1788986391.552914:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986391.552929:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993520768:0@lo:400:kworker.0 00000100:00100000:1.0:1788986391.552954:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986391.553115:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:0.0:1788986391.553127:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993520384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986391.553175:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993520384:12345-0@lo:400:kworker.0 Request processed in 52us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986391.553182:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:0.0:1788986391.553198:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993520640 00000100:00100000:0.0:1788986391.553201:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993520640 00000100:00100000:0.0:1788986391.553223:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993520256 00000100:00100000:0.0:1788986391.553226:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993520256 00000100:00100000:1.0:1788986391.553347:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:1.0:1788986391.553356:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993520640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986391.553393:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993520640:12345-0@lo:400:kworker.0 Request processed in 39us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986391.553399:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:1.0:1788986391.553441:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993520640:0@lo:400:kworker.0 00000100:00100000:0.0:1788986391.553867:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:0.0:1788986391.553875:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993520256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986391.553915:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993520256:12345-0@lo:400:kworker.0 Request processed in 41us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986391.553921:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00100000:2.0:1788986391.558192:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993520512 00000100:00100000:2.0:1788986391.558207:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993520512 00000100:00100000:2.0:1788986391.558271:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993520768 00000100:00100000:2.0:1788986391.558275:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993520768 00000100:00100000:2.0:1788986391.558305:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1788986391.558315:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993520512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986391.558407:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993520512:12345-0@lo:400:kworker.0 Request processed in 93us (5766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986391.558414:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1788986391.558430:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:2.0:1788986391.558435:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993520768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986391.558465:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993520768:12345-0@lo:400:kworker.0 Request processed in 30us (5510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986391.558470:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00080000:2.0:1788986391.558491:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986391.558497:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986391.558694:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80912300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993520512:0@lo:400:kworker.0 00000100:00100000:2.0:1788986391.558829:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993520384:0@lo:400:kworker.0 00000100:00100000:0.0:1788986391.561751:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993520256:0@lo:400:kworker.0 00000100:00100000:0.0:1788986391.561766:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993520768:0@lo:400:kworker.0 00000001:00100000:3.0:1788986391.649073:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:3.0:1788986391.649081:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b094371f000/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788986391.649237:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff9b094371f000/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0001 00000020:00000080:2.0:1788986391.649286:0:489:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0943718000 for lustre-OST0001 00000001:00100000:2.0:1788986391.655065:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788986391.655074:0:6721:0:(genops.c:885:class_export_put()) final put ffff9b0a489e9000/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788986391.655126:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a489e9000/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0000 00000020:00000080:2.0:1788986391.655162:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a489ef000 for lustre-OST0000 00000020:00000080:3.0:1788986391.954573:0:82634:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2fbd3c30 20000000:00000080:3.0:1788986391.954588:0:82634:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76607c00 uarg=0000000000000000 10000000:01000000:3.0:1788986391.954908:0:82634:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986391.954928:0:82634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b1f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986391.954943:0:82634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b1f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986391.954955:0:82634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b1f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986391.954961:0:82634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b1f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986391.954968:0:82634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b1f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986391.954976:0:82634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b1f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986391.954982:0:82634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986391.954986:0:82634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b1f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986391.954993:0:82634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b1f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986391.955004:0:82634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b1f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986391.955011:0:82634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b1f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986391.955017:0:82634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b1f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986392.069278:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986392.069303:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993520896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986392.069373:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986392.069437:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993520896 00000100:00100000:1.0:1788986392.069444:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993520896 00000100:00100000:1.0:1788986392.069488:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1788986392.069497:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993520896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986392.069527:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986392.069569:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993520896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986392.069575:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 777 00000100:00100000:1.0:1788986392.069619:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993520896:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1788986392.256355:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986392.256364:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986392.256370:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986392.256414:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986392.256425:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986392.256437:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986392.256461:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993521024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986392.256525:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986392.256597:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7600 going to sleep for 11 seconds 00000100:00100000:3.0:1788986392.256684:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993521024 00000100:00100000:3.0:1788986392.256691:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993521024 00000100:00100000:3.0:1788986392.257068:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1225 00000100:00100000:3.0:1788986392.257078:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993521024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986392.257131:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986392.257146:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b2d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548b26 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986392.257168:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548b26 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986392.257178:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548b26 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986392.257185:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986392.257245:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993521024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986392.257251:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1225 00000100:00100000:2.0:1788986392.257326:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993521024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986392.257340:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b2d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986392.257348:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548b2d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986392.257367:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986392.257372:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b2d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986392.257384:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b2d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986392.517766:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986392.785038:0:82682:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc83f368b0 20000000:00000080:3.0:1788986392.785053:0:82682:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7601b000 uarg=0000000000000000 10000000:01000000:3.0:1788986392.785271:0:82682:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986392.785290:0:82682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986392.785305:0:82682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b2d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548b26 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986392.785327:0:82682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986392.785362:0:82682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b2d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548b26 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986392.785384:0:82682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b2d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548b26 expref: 18 pid: 5849 timeout: 2276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986392.785398:0:82682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d36d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82682:1875885993521152:0@lo:104: 00000100:00100000:3.0:1788986392.785452:0:82682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986392.785500:0:82682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094395f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986392.785955:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993521152 00000100:00100000:2.0:1788986392.785963:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993521152 00000100:00100000:2.0:1788986392.786015:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:2.0:1788986392.786024:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:82682:x1875885993521152:12345-0@lo:104: 00010000:00010000:2.0:1788986392.786036:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548b2d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986392.786127:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986392.786133:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:82682:x1875885993521152:12345-0@lo:104: Request processed in 110us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986392.786140:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00010000:00010000:1.0:1788986392.786197:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986392.786204:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548b2d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786211:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986392.786215:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548b2d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786233:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548b2d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986392.786241:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548b2d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986392.786247:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986392.786278:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b2d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786285:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986392.786317:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b2d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786325:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf548b26 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b2d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786339:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986392.786341:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986392.786342:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986392.786356:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993521280:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986392.786388:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986392.786423:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993521280 00000100:00100000:1.0:1788986392.786427:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993521280 00010000:00010000:1.0:1788986392.786445:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b2d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548b26 expref: 19 pid: 5849 timeout: 2276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986392.786466:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788986392.786473:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993521280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986392.786483:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986392.786488:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b2d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548b26 expref: 19 pid: 5849 timeout: 2276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786497:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b2d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548b26 expref: 19 pid: 5849 timeout: 2276 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786513:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786520:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786533:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786541:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786548:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786555:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786560:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986392.786565:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786573:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786580:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986392.786589:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986392.786617:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993521280:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986392.786623:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00000100:00100000:1.0:1788986392.786683:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993521280:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986392.789931:0:82682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548b2d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548b26 expref: 18 pid: 5849 timeout: 2276 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986392.789948:0:82682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d36d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82682:1875885993521152:0@lo:104: 00010000:00010000:3.0:1788986392.789970:0:82682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986392.789980:0:82682:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986392.789986:0:82682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986392.789992:0:82682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b34 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986393.538486:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986393.712849:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986393.713003:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971305856 00000100:00100000:2.0:1788986393.713012:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971305856 00000100:00100000:2.0:1788986393.713067:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1226 00000100:00100000:2.0:1788986393.713077:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971305856:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986393.713161:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971305856:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 86us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986393.713168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1226 00000100:00100000:2.0:1788986393.714619:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986393.714759:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971305984 00000100:00100000:1.0:1788986393.714766:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971305984 00000100:00100000:1.0:1788986393.714916:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1534 00000100:00100000:1.0:1788986393.714926:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971305984:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986393.714992:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971305984:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986393.714999:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1534 00000100:00080000:2.0:1788986393.715453:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:2.0:1788986394.048859:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986394.048869:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986394.048875:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986394.048932:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986394.048948:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986394.048962:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986394.048994:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993521408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986394.049081:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986394.049805:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788986394.049864:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993521408 00000100:00100000:1.0:1788986394.049873:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993521408 00000100:00100000:1.0:1788986394.049938:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:1.0:1788986394.049948:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993521408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986394.049966:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986394.049983:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030600/0xc20d828fcf548b42 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548b3b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986394.050013:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030600/0xc20d828fcf548b42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548b3b expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986394.050024:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf548b42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548b3b expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986394.050034:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986394.050125:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993521408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986394.050429:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993521408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986394.050447:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b42 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986394.050457:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548b42 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986394.050480:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986394.050486:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b42 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986394.050494:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b42 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986394.050755:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00010000:00010000:1.0:1788986394.562293:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986395.553770:0:82831:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcf6c7b5f0 20000000:00000080:3.0:1788986395.553793:0:82831:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7601bc00 uarg=0000000000000000 10000000:01000000:3.0:1788986395.554456:0:82831:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986395.554484:0:82831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986395.554506:0:82831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf548b42 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548b3b expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986395.554516:0:82831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986395.554563:0:82831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030600/0xc20d828fcf548b42 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548b3b expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986395.554581:0:82831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf548b42 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548b3b expref: 18 pid: 5849 timeout: 2279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986395.554598:0:82831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d36d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82831:1875885993521536:0@lo:104: 00000100:00100000:3.0:1788986395.554748:0:82831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986395.554814:0:82831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094395f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986395.554906:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993521536 00000100:00100000:2.0:1788986395.554915:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993521536 00000100:00100000:2.0:1788986395.555015:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 338 00000100:00100000:2.0:1788986395.555028:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:82831:x1875885993521536:12345-0@lo:104: 00010000:00010000:2.0:1788986395.555045:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548b42 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986395.555166:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986395.555173:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:82831:x1875885993521536:12345-0@lo:104: Request processed in 148us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986395.555181:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 338 00010000:00010000:0.0:1788986395.555249:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986395.555257:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548b42 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555265:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986395.555270:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548b42 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555281:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548b42 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986395.555289:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548b42 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986395.555295:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986395.555332:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b42 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555339:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986395.555364:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b42 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555371:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b3b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b42 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555390:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986395.555392:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986395.555394:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986395.555415:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993521664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986395.555452:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986395.555497:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993521664 00000100:00100000:0.0:1788986395.555500:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993521664 00010000:00010000:0.0:1788986395.555523:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030600/0xc20d828fcf548b42 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548b3b expref: 19 pid: 5849 timeout: 2279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986395.555548:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788986395.555555:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993521664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986395.555568:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986395.555574:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030600/0xc20d828fcf548b42 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548b3b expref: 19 pid: 5849 timeout: 2279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555585:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030600/0xc20d828fcf548b42 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548b3b expref: 19 pid: 5849 timeout: 2279 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555603:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555612:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555629:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555638:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555645:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555652:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555658:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986395.555663:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555671:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555701:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.555710:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986395.555739:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993521664:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986395.555746:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788986395.555783:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993521664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986395.555886:0:82831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf548b42 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548b3b expref: 18 pid: 5849 timeout: 2279 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986395.555900:0:82831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d36d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:82831:1875885993521536:0@lo:104: 00010000:00010000:1.0:1788986395.555919:0:82831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986395.555928:0:82831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986395.555935:0:82831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986395.555941:0:82831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf548b49 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986395.588272:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986395.659321:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986395.659351:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993521792:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986395.659443:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986395.659624:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993521792 00000100:00100000:1.0:1788986395.659634:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993521792 00000100:00100000:1.0:1788986395.659717:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 778 00000100:00100000:1.0:1788986395.659729:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993521792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986395.659773:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986395.659830:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993521792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986395.659838:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 778 00000100:00100000:1.0:1788986395.659898:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993521792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986395.659957:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788986396.497059:0:82879:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7f3d3920 20000000:00000080:1.0:1788986396.497076:0:82879:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76000c00 uarg=0000000000000000 10000000:01000000:1.0:1788986396.497449:0:82879:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986396.497468:0:82879:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b50 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 82879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986396.497484:0:82879:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b50 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 82879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986396.497495:0:82879:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b50 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 82879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986396.497502:0:82879:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b50 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986396.497508:0:82879:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b50 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 82879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986396.497574:0:82879:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b50 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986396.497580:0:82879:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986396.497585:0:82879:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b50 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 82879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986396.497597:0:82879:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b50 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 82879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986396.497676:0:82879:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b50 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986396.497691:0:82879:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b50 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986396.497698:0:82879:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b50 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 82879 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986396.608708:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986396.680835:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993521920:0@lo:400:kworker.0 00000100:00100000:1.0:1788986396.680907:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986396.680954:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993522432:0@lo:400:kworker.0 00000100:00100000:1.0:1788986396.680983:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986396.681008:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788986396.681014:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094268e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993522048:0@lo:400:kworker.0 00000100:00100000:1.0:1788986396.681034:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986396.681048:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993522560:0@lo:400:kworker.0 00000100:00100000:1.0:1788986396.681068:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986396.681118:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993522176:0@lo:400:kworker.0 00000100:00100000:1.0:1788986396.681142:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986396.681159:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986396.681165:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993522304:0@lo:400:kworker.0 00000100:00100000:1.0:1788986396.681188:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986396.681886:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993521920 00000100:00100000:0.0:1788986396.681895:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993521920 00000100:00100000:0.0:1788986396.681965:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1788986396.681975:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993521920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986396.682034:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993521920:12345-0@lo:400:kworker.0 Request processed in 61us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986396.682041:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1788986396.682074:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993522432 00000100:00100000:0.0:1788986396.682077:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993522432 00000100:00100000:0.0:1788986396.682128:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993522048 00000100:00100000:0.0:1788986396.682132:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993522048 00000100:00100000:0.0:1788986396.682149:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993522176 00000100:00100000:0.0:1788986396.682152:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993522176 00000100:00100000:0.0:1788986396.682167:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00100000:0.0:1788986396.682173:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993522432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986396.682212:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993522432:12345-0@lo:400:kworker.0 Request processed in 30us (1219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986396.682221:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00100000:0.0:1788986396.682233:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:0.0:1788986396.682238:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993522048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986396.682899:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:2.0:1788986396.682910:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993522176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986396.682965:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993522176:12345-0@lo:400:kworker.0 Request processed in 59us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986396.682972:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00100000:2.0:1788986396.682999:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993522560 00000100:00100000:2.0:1788986396.683003:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993522560 00000100:00100000:2.0:1788986396.683048:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993522304 00000100:00100000:2.0:1788986396.683051:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993522304 00000100:00100000:2.0:1788986396.683074:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1788986396.683081:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993522560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986396.683132:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993522560:12345-0@lo:400:kworker.0 Request processed in 51us (2062us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986396.683138:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:2.0:1788986396.683151:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1788986396.683157:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993522304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986396.683185:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993522304:12345-0@lo:400:kworker.0 Request processed in 29us (1996us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986396.683190:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1788986396.683736:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993522048:12345-0@lo:400:kworker.0 Request processed in 1496us (2698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986396.683743:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00080000:0.0:1788986396.683766:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986396.683771:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986396.683808:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993522048:0@lo:400:kworker.0 00000100:00100000:0.0:1788986396.683821:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993522560:0@lo:400:kworker.0 00000100:00100000:0.0:1788986396.683831:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094268f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993521920:0@lo:400:kworker.0 00000100:00100000:0.0:1788986396.683841:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993522432:0@lo:400:kworker.0 00000100:00100000:2.0:1788986396.692961:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993522304:0@lo:400:kworker.0 00000100:00100000:2.0:1788986396.692980:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993522176:0@lo:400:kworker.0 10000000:01000000:0.0:1788986397.120323:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986397.120330:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986397.120335:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986397.120381:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986397.120393:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986397.120404:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986397.120429:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80911880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993522688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986397.120494:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986397.120548:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a511f8240 going to sleep for 11 seconds 00000100:00100000:2.0:1788986397.120606:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993522688 00000100:00100000:2.0:1788986397.120614:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993522688 00000100:00100000:2.0:1788986397.120664:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1229 00000100:00100000:2.0:1788986397.120682:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993522688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986397.120695:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986397.120708:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf548b5e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548b57 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986397.120729:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf548b5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548b57 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986397.120738:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf548b5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548b57 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986397.120747:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986397.120802:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993522688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986397.120808:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1229 00000100:00100000:1.0:1788986397.120901:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80911880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993522688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986397.120916:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b5e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986397.120924:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548b5e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986397.120940:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986397.120945:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b5e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986397.120952:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b5e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986397.187946:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986397.187967:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993522816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986397.188033:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986397.188079:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993522816 00000100:00100000:1.0:1788986397.188107:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993522816 00000100:00100000:1.0:1788986397.188150:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1788986397.188158:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993522816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986397.188190:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986397.188243:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993522816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986397.188263:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 779 00000100:00100000:1.0:1788986397.188309:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993522816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986397.636861:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986398.657000:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986398.831905:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986398.831954:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986398.832128:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971306112 00000100:00100000:1.0:1788986398.832138:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971306112 00000100:00100000:1.0:1788986398.832212:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1230 00000100:00100000:1.0:1788986398.832221:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971306112:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986398.832291:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971306112:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 71us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986398.832299:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1230 00000100:00100000:2.0:1788986398.833216:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971306240 00000100:00100000:2.0:1788986398.833223:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971306240 00000100:00100000:2.0:1788986398.833273:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1538 00000100:00100000:2.0:1788986398.833282:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971306240:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:0.0:1788986398.833295:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986398.833337:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971306240:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 56us (1440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986398.833344:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1538 00010000:00010000:0.0:1788986399.680254:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788986399.876822:0:83077:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe84a5ca40 20000000:00000080:0.0:1788986399.876839:0:83077:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f3e7800 uarg=0000000000000000 00010000:00010000:0.0:1788986399.877550:0:83077:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986399.877565:0:83077:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986399.877577:0:83077:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986399.877595:0:83077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986399.877611:0:83077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf548b5e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548b57 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986399.877619:0:83077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986399.877655:0:83077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf548b5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548b57 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986399.877668:0:83077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf548b5e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548b57 expref: 18 pid: 5846 timeout: 2283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986399.877682:0:83077:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80911180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83077:1875885993522944:0@lo:104: 00000100:00100000:0.0:1788986399.877739:0:83077:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986399.877845:0:83077:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a511f8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788986399.877892:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993522944 00000100:00100000:2.0:1788986399.877899:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993522944 00000100:00100000:2.0:1788986399.877976:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 339 00000100:00100000:2.0:1788986399.877986:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:83077:x1875885993522944:12345-0@lo:104: 00010000:00010000:2.0:1788986399.877998:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548b5e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986399.878133:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986399.878140:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80912a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:83077:x1875885993522944:12345-0@lo:104: Request processed in 157us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986399.878147:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 339 00000100:00100000:0.0:1788986399.878227:0:83077:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80911180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83077:1875885993522944:0@lo:104: 00010000:00010000:0.0:1788986399.878245:0:83077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878318:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986399.878325:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548b5e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878333:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986399.878337:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548b5e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878344:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548b5e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986399.878351:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548b5e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986399.878356:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986399.878424:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b5e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878431:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986399.878464:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b5e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878476:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf548b57 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b5e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878491:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986399.878493:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986399.878495:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986399.878501:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986399.878513:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993523072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986399.878546:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986399.878580:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993523072 00000100:00100000:1.0:1788986399.878584:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993523072 00010000:00010000:1.0:1788986399.878604:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf548b5e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548b57 expref: 19 pid: 5846 timeout: 2283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986399.878625:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788986399.878633:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993523072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986399.878644:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986399.878649:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf548b5e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548b57 expref: 19 pid: 5846 timeout: 2283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878659:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf548b5e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548b57 expref: 19 pid: 5846 timeout: 2283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878671:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf548b5e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548b57 expref: 19 pid: 5846 timeout: 2283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878682:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878695:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878708:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878715:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878722:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878728:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878734:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efe00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986399.878738:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878745:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878758:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986399.878765:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986399.878793:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993523072:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986399.878799:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00000100:00100000:1.0:1788986399.878827:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993523072:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986399.878900:0:83077:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986399.878908:0:83077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986399.878914:0:83077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf548b65 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986400.705213:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986400.770273:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986400.770293:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993523200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986400.770351:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986400.770396:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993523200 00000100:00100000:3.0:1788986400.770405:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993523200 00000100:00100000:3.0:1788986400.770455:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 780 00000100:00100000:3.0:1788986400.770463:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993523200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986400.770494:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986400.770541:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993523200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986400.770547:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 780 00000100:00100000:1.0:1788986400.770583:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993523200:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986400.774631:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1788986401.157766:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986401.157776:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986401.157781:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986401.157841:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986401.157856:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986401.157870:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986401.157902:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993523328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986401.157990:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986401.161233:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788986401.162702:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993523328 00000100:00100000:2.0:1788986401.162718:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993523328 00000100:00100000:2.0:1788986401.162805:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:2.0:1788986401.162816:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993523328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986401.162838:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986401.162863:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf548b73 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548b6c expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986401.162896:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf548b73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548b6c expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986401.162910:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf548b73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548b6c expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986401.162920:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1800, rc 0) 00000100:00100000:2.0:1788986401.163022:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993523328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (5032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986401.163030:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:0.0:1788986401.163215:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993523328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986401.163235:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986401.163245:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548b73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986401.163272:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986401.163278:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986401.163286:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986401.729263:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986401.800869:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993523456:0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.800958:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986401.801015:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993523968:0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.801044:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986401.801071:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986401.801077:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993523840:0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.801122:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986401.801156:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993523584:0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.801197:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986401.801217:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986401.801223:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993523712:0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.801246:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986401.801281:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993523456 00000100:00100000:1.0:1788986401.801289:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993523456 00000100:00100000:1.0:1788986401.801336:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993523840 00000100:00100000:1.0:1788986401.801340:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993523840 00000100:00100000:1.0:1788986401.801368:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993523584 00000100:00100000:1.0:1788986401.801371:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993523584 00000100:00100000:1.0:1788986401.801389:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:1.0:1788986401.801398:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993523456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.801455:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993523456:12345-0@lo:400:kworker.0 Request processed in 57us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986401.801464:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:1.0:1788986401.801482:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:1.0:1788986401.801488:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993523840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.801514:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993523840:12345-0@lo:400:kworker.0 Request processed in 27us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986401.801520:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:1.0:1788986401.801531:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:1.0:1788986401.801536:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993523584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.801562:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993523584:12345-0@lo:400:kworker.0 Request processed in 26us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986401.801568:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:1.0:1788986401.801587:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993523968 00000100:00100000:1.0:1788986401.801590:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993523968 00000100:00100000:1.0:1788986401.801619:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993523712 00000100:00100000:1.0:1788986401.801622:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993523712 00000100:00100000:1.0:1788986401.801640:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1788986401.801661:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993523968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.801693:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993523968:12345-0@lo:400:kworker.0 Request processed in 34us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986401.801699:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1788986401.801897:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1788986401.801903:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993523712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.801931:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993523712:12345-0@lo:400:kworker.0 Request processed in 29us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986401.801937:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00080000:1.0:1788986401.801970:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986401.801975:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986401.802016:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993523712:0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.802027:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993523584:0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.802057:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993523840:0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.802068:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993523456:0@lo:400:kworker.0 00000100:00100000:1.0:1788986401.802077:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993523968:0@lo:400:kworker.0 00000100:00100000:2.0:1788986402.305998:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993524096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986402.306117:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986402.306280:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993524096 00000100:00100000:1.0:1788986402.306291:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993524096 00000100:00100000:1.0:1788986402.306360:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 781 00000100:00100000:1.0:1788986402.306370:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993524096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986402.306419:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986402.306488:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993524096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986402.306497:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 781 00000100:00100000:2.0:1788986402.306538:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993524096:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986402.752756:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986403.273562:0:83273:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd76f20350 20000000:00000080:3.0:1788986403.273580:0:83273:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a8085fc00 uarg=0000000000000000 00010000:00010000:3.0:1788986403.273798:0:83273:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986403.273813:0:83273:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986403.273826:0:83273:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986403.273843:0:83273:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.273860:0:83273:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf548b73 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548b6c expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.273868:0:83273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.273902:0:83273:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf548b73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548b6c expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.273916:0:83273:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf548b73 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548b6c expref: 18 pid: 5848 timeout: 2287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986403.273929:0:83273:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83273:1875885993524224:0@lo:104: 00000100:00100000:3.0:1788986403.273987:0:83273:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986403.274579:0:83273:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c61840 going to sleep for 11 seconds 00000100:00100000:2.0:1788986403.274645:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993524224 00000100:00100000:2.0:1788986403.274821:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993524224 00000100:00100000:2.0:1788986403.274871:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 340 00000100:00100000:2.0:1788986403.274880:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:83273:x1875885993524224:12345-0@lo:104: 00010000:00010000:2.0:1788986403.274894:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548b73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986403.275057:0:83273:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83273:1875885993524224:0@lo:104: 00010000:00010000:0.0:1788986403.275079:0:83273:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986403.275197:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986403.275204:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:83273:x1875885993524224:12345-0@lo:104: Request processed in 326us (1217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986403.275214:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 340 00010000:00010000:1.0:1788986403.278825:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986403.278840:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548b73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986403.278850:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986403.278854:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548b73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986403.278864:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548b73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986403.278870:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548b73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986403.278875:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986403.278983:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986403.278990:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986403.279023:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986403.279031:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548b6c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b73 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986403.279051:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986403.279053:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986403.279055:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986403.279426:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993524352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986403.279488:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986403.281121:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993524352 00000100:00100000:0.0:1788986403.281133:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993524352 00010000:00010000:0.0:1788986403.281182:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf548b73 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548b6c expref: 19 pid: 5848 timeout: 2287 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986403.281221:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788986403.281231:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993524352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986403.281243:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986403.281249:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf548b73 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548b6c expref: 19 pid: 5848 timeout: 2287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.281260:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf548b73 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548b6c expref: 19 pid: 5848 timeout: 2287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.281275:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf548b73 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548b6c expref: 19 pid: 5848 timeout: 2287 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.281291:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.281299:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.281316:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.281324:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.281331:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.281339:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.281346:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986403.281350:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.281359:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.281375:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.281385:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986403.281436:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993524352:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (1947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986403.281443:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788986403.281529:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993524352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986403.281611:0:83273:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986403.281621:0:83273:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986403.281628:0:83273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf548b7a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83273 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986403.777295:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986403.951552:0:83322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc555d98f0 20000000:00000080:3.0:1788986403.951569:0:83322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a8085ec00 uarg=0000000000000000 10000000:01000000:3.0:1788986403.951612:0:83322:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986403.951631:0:83322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b81 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.951651:0:83322:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b81 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.951662:0:83322:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b81 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.951669:0:83322:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b81 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.951676:0:83322:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b81 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.951683:0:83322:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b81 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.951693:0:83322:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986403.951697:0:83322:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b81 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.951704:0:83322:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b81 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.951715:0:83322:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b81 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.951722:0:83322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b81 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986403.951728:0:83322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b81 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986403.953539:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986403.954065:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971306496 00000100:00100000:2.0:1788986403.954276:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971306496 00000100:00100000:2.0:1788986403.954373:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1542 00000100:00100000:2.0:1788986403.954383:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971306496:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986403.954445:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971306496:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 64us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986403.954452:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1542 00000100:00080000:0.0:1788986403.954507:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986403.956789:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986403.956852:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971306368 00000100:00100000:3.0:1788986403.956860:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971306368 00000100:00100000:3.0:1788986403.956906:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1232 00000100:00100000:3.0:1788986403.956916:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971306368:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986403.956978:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971306368:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 63us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986403.956984:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1232 00010000:00010000:1.0:1788986404.800437:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788986405.121199:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986405.121211:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986405.121217:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986405.121277:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986405.121293:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986405.121306:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986405.121340:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993524480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986405.121439:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986405.121515:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09429d0540 going to sleep for 11 seconds 00000100:00100000:0.0:1788986405.121827:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993524480 00000100:00100000:0.0:1788986405.121838:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993524480 00000100:00100000:0.0:1788986405.121915:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1788986405.121927:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993524480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986405.121943:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986405.121959:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b8f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548b88 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986405.121988:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b8f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548b88 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986405.122002:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b8f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548b88 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986405.122013:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee800, rc 0) 00000100:00100000:0.0:1788986405.122063:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993524480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986405.122071:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1233 00000100:00100000:0.0:1788986405.122407:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993524480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986405.122490:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986405.122504:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548b8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986405.122530:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986405.122535:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986405.122544:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548b8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986405.827915:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986405.890193:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986405.890227:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993524608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986405.890317:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986405.890401:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993524608 00000100:00100000:1.0:1788986405.890411:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993524608 00000100:00100000:1.0:1788986405.890676:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 782 00000100:00100000:1.0:1788986405.890687:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993524608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986405.890736:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986405.890793:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993524608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986405.890800:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 782 00000100:00080000:1.0:1788986405.890824:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986405.891194:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993524608:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986406.849140:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986406.912459:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993524864:0@lo:400:kworker.0 00000100:00100000:3.0:1788986406.912517:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993524736:0@lo:400:kworker.0 00000100:00100000:1.0:1788986406.912525:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986406.912595:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993525120:0@lo:400:kworker.0 00000100:00100000:3.0:1788986406.913133:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986406.913191:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993525248:0@lo:400:kworker.0 00000100:00100000:3.0:1788986406.913216:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986406.913289:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993524736 00000100:00100000:2.0:1788986406.913297:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993524736 00000100:00100000:2.0:1788986406.913390:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1234 00000100:00100000:2.0:1788986406.913399:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993524736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986406.913466:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993524736:12345-0@lo:400:kworker.0 Request processed in 68us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986406.913474:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1234 00000100:00100000:0.0:1788986406.913477:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986406.913538:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993525120 00000100:00100000:0.0:1788986406.913542:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993525120 00000100:00100000:0.0:1788986406.913573:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:0.0:1788986406.913580:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993525120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986406.913630:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993525120:12345-0@lo:400:kworker.0 Request processed in 51us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986406.913637:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1788986406.913660:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993524736:0@lo:400:kworker.0 00000100:00100000:0.0:1788986406.913661:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993525120:0@lo:400:kworker.0 00000100:00100000:0.0:1788986406.913693:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993524864 00000100:00100000:0.0:1788986406.913697:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993524864 00000100:00100000:0.0:1788986406.913718:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:0.0:1788986406.913724:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993524864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986406.913756:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993524864:12345-0@lo:400:kworker.0 Request processed in 32us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986406.913762:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:0.0:1788986406.913773:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993525248 00000100:00100000:0.0:1788986406.913775:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993525248 00000100:00100000:0.0:1788986406.913815:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:0.0:1788986406.913821:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993525248:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788986406.913822:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986406.913860:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993525248:12345-0@lo:400:kworker.0 Request processed in 39us (643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986406.913866:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:0.0:1788986406.913885:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993524992:0@lo:400:kworker.0 00000100:00100000:3.0:1788986406.913892:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993525248:0@lo:400:kworker.0 00000100:00100000:0.0:1788986406.913910:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986406.913948:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993524992 00000100:00100000:0.0:1788986406.913952:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993524992 00000100:00100000:0.0:1788986406.913975:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:0.0:1788986406.913980:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993524992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986406.914009:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993524992:12345-0@lo:400:kworker.0 Request processed in 29us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986406.914015:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:0.0:1788986406.914038:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993524992:0@lo:400:kworker.0 00000100:00080000:0.0:1788986406.914064:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986406.916071:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993524864:0@lo:400:kworker.0 00000100:00100000:1.0:1788986406.916085:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a457ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993525376:0@lo:400:kworker.0 00000100:00100000:1.0:1788986406.916144:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986406.916209:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993525376 00000100:00100000:1.0:1788986406.916215:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993525376 00000100:00100000:1.0:1788986406.916253:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:1.0:1788986406.916271:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993525376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986406.916316:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993525376:12345-0@lo:400:kworker.0 Request processed in 56us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986406.916323:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00080000:1.0:1788986406.916346:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986406.916371:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a457ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993525376:0@lo:400:kworker.0 00000100:00100000:0.0:1788986407.424427:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a457ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993525504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986407.424498:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986407.424642:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993525504 00000100:00100000:1.0:1788986407.424650:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993525504 00000100:00100000:1.0:1788986407.424716:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 783 00000100:00100000:1.0:1788986407.424729:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993525504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986407.424763:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986407.424823:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993525504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986407.424829:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 783 00000100:00100000:2.0:1788986407.424970:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a457ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993525504:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986407.879149:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986408.901587:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986409.079389:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986409.079432:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986409.080787:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971306624 00000100:00100000:0.0:1788986409.080801:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971306624 00000100:00100000:0.0:1788986409.080862:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1235 00000100:00100000:0.0:1788986409.080873:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971306624:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986409.080945:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971306624:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 74us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986409.080952:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1235 00000100:00100000:1.0:1788986409.081358:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971306752 00000100:00100000:1.0:1788986409.081363:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971306752 00000100:00100000:1.0:1788986409.081449:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1546 00000100:00100000:1.0:1788986409.081470:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971306752:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986409.081510:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971306752:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 54us (2077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986409.081517:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1546 00000100:00080000:3.0:1788986409.088642:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1788986409.135587:0:83615:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffb5aff9e0 20000000:00000080:3.0:1788986409.135606:0:83615:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0942b5a000 uarg=0000000000000000 10000000:01000000:3.0:1788986409.135651:0:83615:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986409.135669:0:83615:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986409.135686:0:83615:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b8f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548b88 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986409.135694:0:83615:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986409.135732:0:83615:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b8f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548b88 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986409.135744:0:83615:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b8f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548b88 expref: 18 pid: 5849 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986409.135757:0:83615:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943819180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83615:1875885993525632:0@lo:104: 00000100:00100000:3.0:1788986409.135813:0:83615:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986409.135873:0:83615:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a45664e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788986409.136103:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993525632 00000100:00100000:2.0:1788986409.136112:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993525632 00000100:00100000:2.0:1788986409.136163:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 341 00000100:00100000:2.0:1788986409.136172:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094381b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:83615:x1875885993525632:12345-0@lo:104: 00010000:00010000:2.0:1788986409.136186:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548b8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136259:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986409.136265:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094381b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:83615:x1875885993525632:12345-0@lo:104: Request processed in 95us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986409.136272:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 341 00010000:00010000:2.0:1788986409.136292:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986409.136298:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548b8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136305:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986409.136309:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548b8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136318:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548b8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986409.136324:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548b8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986409.136333:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986409.136360:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136367:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986409.136386:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136393:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf548b88 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548b8f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136407:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986409.136409:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986409.136410:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986409.136441:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993525760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986409.136470:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986409.136509:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993525760 00000100:00100000:2.0:1788986409.136513:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993525760 00010000:00010000:2.0:1788986409.136530:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b8f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548b88 expref: 19 pid: 5849 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986409.136552:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788986409.136559:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993525760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986409.136568:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986409.136573:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b8f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548b88 expref: 19 pid: 5849 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136583:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b8f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548b88 expref: 19 pid: 5849 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136596:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136603:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136616:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136623:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136630:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136636:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136641:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986409.136645:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136652:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136660:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986409.136669:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986409.136699:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993525760:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986409.136707:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00000100:00100000:2.0:1788986409.136744:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993525760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986409.136878:0:83615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf548b8f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548b88 expref: 18 pid: 5849 timeout: 2293 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986409.136893:0:83615:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943819180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83615:1875885993525632:0@lo:104: 00010000:00010000:1.0:1788986409.136907:0:83615:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986409.136915:0:83615:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986409.136921:0:83615:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986409.136926:0:83615:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf548b96 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83615 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986409.920807:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788986410.062950:0:83663:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe14514bc0 20000000:00000080:1.0:1788986410.062969:0:83663:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a49822c00 uarg=0000000000000000 00010000:00010000:1.0:1788986410.063919:0:83663:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788986410.063937:0:83663:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788986410.063952:0:83663:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986410.063971:0:83663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b9d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986410.063986:0:83663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b9d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986410.063998:0:83663:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b9d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986410.064006:0:83663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b9d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986410.064018:0:83663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b9d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986410.064026:0:83663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b9d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986410.064033:0:83663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986410.064038:0:83663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b9d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986410.064047:0:83663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b9d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986410.064059:0:83663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b9d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986410.064066:0:83663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b9d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986410.064072:0:83663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf548b9d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986410.692748:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986410.692755:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986410.692760:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986410.692801:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986410.692813:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986410.692823:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986410.692847:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943818700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993525888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986410.692906:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986410.692946:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a75d74cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788986410.694908:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993525888 00000100:00100000:3.0:1788986410.694922:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993525888 00000100:00100000:3.0:1788986410.694981:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1788986410.694991:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993525888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986410.695015:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986410.695035:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548bab lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548ba4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986410.695060:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548bab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548ba4 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986410.695071:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548bab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548ba4 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986410.695079:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986410.695166:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993525888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 177us (2259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986410.695173:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1788986410.695219:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943818700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993525888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986410.695234:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548bab expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986410.695243:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548bab expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986410.695262:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986410.695267:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548bab expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986410.695274:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548bab expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986410.949756:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986411.009306:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993526016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986411.009373:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986411.009487:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993526016 00000100:00100000:1.0:1788986411.009495:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993526016 00000100:00100000:1.0:1788986411.009555:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 784 00000100:00100000:1.0:1788986411.009577:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993526016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986411.009619:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788986411.011000:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986411.011305:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993526016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1737us (1927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986411.011319:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 784 00000100:00100000:2.0:1788986411.011468:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943818700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993526016:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986411.970916:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986412.039966:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a45109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993526272:0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.040062:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986412.040153:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a45109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993526784:0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.040184:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986412.040216:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788986412.040222:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a457ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993526144:0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.040254:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986412.040294:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a45108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993526656:0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.040318:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986412.040345:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a45108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993526400:0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.040376:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986412.040396:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986412.040400:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a4510b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993526528:0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.040424:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986412.040460:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993526272 00000100:00100000:1.0:1788986412.040470:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993526272 00000100:00100000:1.0:1788986412.040537:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993526656 00000100:00100000:1.0:1788986412.040541:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993526656 00000100:00100000:1.0:1788986412.040572:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993526400 00000100:00100000:1.0:1788986412.040575:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993526400 00000100:00100000:1.0:1788986412.040601:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:1.0:1788986412.040611:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4510b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993526272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.040671:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4510b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993526272:12345-0@lo:400:kworker.0 Request processed in 62us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986412.040679:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00100000:1.0:1788986412.040699:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:1.0:1788986412.040708:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993526656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.040737:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993526656:12345-0@lo:400:kworker.0 Request processed in 32us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986412.040742:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00100000:1.0:1788986412.040755:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:1.0:1788986412.040762:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993526400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.040792:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993526400:12345-0@lo:400:kworker.0 Request processed in 32us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986412.040798:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:1.0:1788986412.040817:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993526784 00000100:00100000:1.0:1788986412.040821:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993526784 00000100:00100000:1.0:1788986412.040848:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993526528 00000100:00100000:1.0:1788986412.040851:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993526528 00000100:00100000:1.0:1788986412.040868:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1788986412.040875:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993526784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.040908:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993526784:12345-0@lo:400:kworker.0 Request processed in 33us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986412.040914:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:1.0:1788986412.040925:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1788986412.040932:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993526528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.040961:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993526528:12345-0@lo:400:kworker.0 Request processed in 32us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986412.040967:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:1.0:1788986412.040986:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993526144 00000100:00100000:1.0:1788986412.040990:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993526144 00000100:00100000:1.0:1788986412.041019:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:1.0:1788986412.041027:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993526144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.041058:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993526144:12345-0@lo:400:kworker.0 Request processed in 32us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986412.041064:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00080000:1.0:1788986412.041254:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986412.041259:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986412.041311:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a4510b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993526528:0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.041325:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a45108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993526400:0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.041357:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a457ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993526144:0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.041368:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a45108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993526656:0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.041379:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a45109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993526272:0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.041388:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a45109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993526784:0@lo:400:kworker.0 00000100:00100000:1.0:1788986412.546433:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986412.546462:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a457ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993526912:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986412.546552:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986412.546698:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993526912 00000100:00100000:0.0:1788986412.546709:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993526912 00000100:00100000:0.0:1788986412.546779:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 785 00000100:00100000:0.0:1788986412.546790:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993526912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986412.546834:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986412.546902:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993526912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986412.546910:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 785 00000100:00100000:1.0:1788986412.548068:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a457ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993526912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986412.997564:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986413.394223:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986413.394321:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971306880 00000100:00100000:1.0:1788986413.394331:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971306880 00000100:00100000:1.0:1788986413.394481:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 805 00000100:00100000:1.0:1788986413.394495:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49129:x1875885971306880:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986413.394514:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986413.394536:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548bb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11e0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986413.394600:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548bb9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986413.394613:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986413.394624:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986413.394659:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788986413.394662:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986413.394684:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986413.394708:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548bb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11e0 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986413.394727:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11e0 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986413.394734:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:1.0:1788986413.394737:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986413.394740:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031a00, rc 0) 00000100:00100000:1.0:1788986413.394798:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49129:x1875885971306880:12345-192.168.206.21@tcp:101:rm.0 Request processed in 307us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986413.394805:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 805 00000100:00080000:0.0:1788986413.395075:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986413.396964:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986413.397035:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971307008 00000100:00100000:0.0:1788986413.397044:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971307008 00000100:00100000:0.0:1788986413.397127:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 806 00000100:00100000:0.0:1788986413.397137:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49129:x1875885971307008:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986413.397154:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986413.397171:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548bc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11e7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397221:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548bc7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397233:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548bc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397244:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548bc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397257:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548bce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397265:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548bce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397271:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548bce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397462:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548bc7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397470:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548bc7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397477:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397483:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986413.397487:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548bc7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397494:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548bc7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397506:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:0.0:1788986413.397509:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986413.397513:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548bc7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397519:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf548bc7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397531:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548bce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397537:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548bce lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397543:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548bce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397548:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986413.397550:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548bce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397556:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548bce lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397566:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a4823b100) 00010000:00010000:0.0:1788986413.397568:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986413.397571:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548bce lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397576:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548bce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397603:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548bc0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11e7 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397613:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:0.0:1788986413.397615:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986413.397618:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548bc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11e7 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.397626:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eec00, rc 0) 00000100:00100000:0.0:1788986413.397686:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49129:x1875885971307008:12345-192.168.206.21@tcp:101:rm.0 Request processed in 549us (728us total) trans 0 rc 301/301 00000100:00100000:0.0:1788986413.397693:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 806 00000100:00100000:3.0:1788986413.448002:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986413.448900:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986413.449291:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971307136 00000100:00100000:3.0:1788986413.449305:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971307136 00000100:00100000:3.0:1788986413.449383:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971307392 00000100:00100000:3.0:1788986413.449387:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971307392 00000100:00100000:3.0:1788986413.449429:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 807 00000100:00100000:3.0:1788986413.449446:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971307136:12345-192.168.206.21@tcp:41:mkdir.0 00000004:00000024:3.0:1788986413.449503:0:15241:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788986413.449608:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971307136:12345-192.168.206.21@tcp:41:mkdir.0 Request processed in 169us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986413.449616:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 807 00000100:00100000:3.0:1788986413.449636:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 808 00000100:00100000:3.0:1788986413.449643:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49133:x1875885971307392:12345-192.168.206.21@tcp:36:mkdir.0 00010000:00010000:3.0:1788986413.449685:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986413.449718:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548bb9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11e0 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.449745:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:3.0:1788986413.449759:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986413.450036:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548bd5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.450052:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548bd5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.450069:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548bd5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.450083:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548bdc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.450162:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548bdc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.450169:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548bdc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986413.451367:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00010000:00010000:3.0:1788986413.451394:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548bd5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.451411:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548bd5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.451419:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548bd5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.451426:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986413.451431:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548bd5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.451445:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548bd5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.451462:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:3.0:1788986413.451465:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986413.451472:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548bd5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.451479:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548bd5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986413.451502:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000704c2ed0 reply state 00000000cf6b2bbb transno 4294967600 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548bdc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986413.451512:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986413.451636:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942b0dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49133:x1875885971307392:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 1982us (2729us total) trans 4294967600 rc 0/0 00000100:00100000:3.0:1788986413.451645:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 808 00010000:00010000:0.0:1788986413.458052:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548bdc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.458077:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548bdc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.458157:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548bdc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.458171:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986413.458184:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548bdc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.458194:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548bdc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.458226:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a55745100) 00010000:00010000:0.0:1788986413.458230:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986413.458237:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548bdc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986413.458244:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf548bdc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986413.512739:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986413.517212:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971307520 00000100:00100000:3.0:1788986413.517227:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971307520 00000100:00100000:3.0:1788986413.517347:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 809 00000100:00100000:3.0:1788986413.517357:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49137:x1875885971307520:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:3.0:1788986413.517390:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986413.517413:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548be3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11ee expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.517470:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548bea lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.517483:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.517505:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986413.517550:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788986413.517554:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986413.517572:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548bea lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.517604:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548be3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11ee expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.517623:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548bea lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11ee expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.517632:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:3.0:1788986413.517634:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986413.517638:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788986413.517710:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49137:x1875885971307520:12345-192.168.206.21@tcp:101:chown.0 Request processed in 354us (4978us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986413.517717:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 809 00000100:00100000:2.0:1788986413.522676:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986413.522767:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971307648 00000100:00100000:3.0:1788986413.522775:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971307648 00000100:00100000:3.0:1788986413.522824:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 810 00000100:00100000:3.0:1788986413.522834:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49137:x1875885971307648:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:3.0:1788986413.522852:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986413.522870:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548bf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11f5 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.522928:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548bf8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.522942:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.522956:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.522972:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548bff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.522980:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548bff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.522988:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548bff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523134:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548c06 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523144:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523153:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986413.523189:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:3.0:1788986413.523193:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986413.523216:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548c06 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523229:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548bf8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523236:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548bf8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523248:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523255:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986413.523260:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548bf8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523270:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548bf8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523283:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:3.0:1788986413.523287:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986413.523290:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548bf8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523296:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548bf8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523311:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548bff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523317:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548bff lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523322:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548bff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523326:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986413.523329:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548bff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523337:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548bff lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523539:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a55745a00) 00010000:00010000:3.0:1788986413.523542:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986413.523546:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548bff lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523551:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548bff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523921:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548bf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11f5 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523939:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548c06 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11f5 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.523946:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:3.0:1788986413.523949:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986413.523951:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3200, rc 0) 00000100:00100000:3.0:1788986413.524007:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49137:x1875885971307648:12345-192.168.206.21@tcp:101:chown.0 Request processed in 1173us (1338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986413.524015:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 810 00000100:00100000:2.0:1788986413.529348:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986413.532482:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971307904 00000100:00100000:1.0:1788986413.532505:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971307904 00000100:00100000:1.0:1788986413.532782:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 811 00000100:00100000:1.0:1788986413.532805:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49137:x1875885971307904:12345-192.168.206.21@tcp:36:chown.0 00010000:00010000:1.0:1788986413.532856:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986413.532882:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548c06 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11f5 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986413.532905:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:1.0:1788986413.532916:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986413.532939:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c0d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986413.532952:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986413.532963:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986413.533193:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005f17885d reply state 00000000e5bc8ce8 transno 4294967601 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986413.533202:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986413.533210:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000100:00100000:1.0:1788986413.533296:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:49137:x1875885971307904:12345-192.168.206.21@tcp:36:chown.0 Request processed in 504us (3956us total) trans 4294967601 rc 0/0 00000100:00100000:1.0:1788986413.533303:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 811 00010000:00010000:3.0:1788986413.541755:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c0d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.541768:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c0d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.541779:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.541784:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986413.541788:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c0d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.541795:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c0d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.541810:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316b00) 00010000:00010000:3.0:1788986413.541812:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986413.541816:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c0d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986413.541821:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c0d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986414.018419:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986414.190885:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967601 is committed 00000100:00100000:2.0:1788986414.193564:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986414.193717:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986414.194233:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971308160 00000100:00100000:3.0:1788986414.194246:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971308160 00000100:00100000:3.0:1788986414.194319:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1550 00000100:00100000:3.0:1788986414.194332:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971308160:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986414.194440:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971308160:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 111us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986414.194449:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1550 00000100:00100000:0.0:1788986414.197701:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971308032 00000100:00100000:0.0:1788986414.197721:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971308032 00000100:00100000:0.0:1788986414.198390:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1238 00000100:00100000:0.0:1788986414.198406:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971308032:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986414.198517:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971308032:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 116us (4966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986414.198526:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1238 00000020:00000080:3.0:1788986414.499651:0:83859:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcafd947e0 20000000:00000080:3.0:1788986414.499675:0:83859:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0942b58400 uarg=0000000000000000 10000000:01000000:3.0:1788986414.499741:0:83859:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986414.499834:0:83859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986414.499860:0:83859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548bab lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548ba4 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986414.499869:0:83859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986414.499921:0:83859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548bab lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548ba4 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986414.499939:0:83859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548bab lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548ba4 expref: 18 pid: 5849 timeout: 2298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986414.499957:0:83859:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943819180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83859:1875885993527040:0@lo:104: 00000100:00100000:3.0:1788986414.500213:0:83859:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986414.500332:0:83859:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c4540 going to sleep for 11 seconds 00000100:00100000:2.0:1788986414.500444:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788986414.500460:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993527040 00000100:00100000:2.0:1788986414.500467:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993527040 00000100:00100000:2.0:1788986414.500590:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788986414.500602:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:83859:x1875885993527040:12345-0@lo:104: 00010000:00010000:2.0:1788986414.500617:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548bab expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986414.500705:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986414.500712:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:83859:x1875885993527040:12345-0@lo:104: Request processed in 113us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986414.500720:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00010000:00010000:1.0:1788986414.500827:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986414.500836:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548bab expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.500849:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986414.500854:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548bab expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.500863:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548bab expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986414.500870:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548bab expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986414.500877:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986414.500915:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548bab expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.500923:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986414.500947:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548bab expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.500954:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf548ba4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548bab expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.500986:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986414.500989:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986414.500991:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986414.501014:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a45108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993527168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986414.501051:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986414.501134:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993527168 00000100:00100000:1.0:1788986414.501138:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993527168 00010000:00010000:1.0:1788986414.501163:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548bab lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548ba4 expref: 19 pid: 5849 timeout: 2298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986414.501191:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788986414.501198:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993527168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986414.501209:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986414.501215:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548bab lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548ba4 expref: 19 pid: 5849 timeout: 2298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.501226:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548bab lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548ba4 expref: 19 pid: 5849 timeout: 2298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.501243:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.501251:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.501267:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.501275:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.501282:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.501288:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.501294:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986414.501310:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.501320:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.501329:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986414.501339:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986414.501371:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993527168:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986414.501378:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788986414.501421:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a45108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993527168:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986414.501526:0:83859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf548bab lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548ba4 expref: 18 pid: 5849 timeout: 2298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986414.501538:0:83859:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943819180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:83859:1875885993527040:0@lo:104: 00010000:00010000:3.0:1788986414.501552:0:83859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986414.501562:0:83859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986414.501569:0:83859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986414.501580:0:83859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548c14 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986415.042334:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986415.648885:0:83907:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc84c6a970 20000000:00000080:2.0:1788986415.649024:0:83907:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094197c800 uarg=0000000000000000 00010000:00010000:2.0:1788986415.649967:0:83907:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788986415.650016:0:83907:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:2.0:1788986415.650021:0:83907:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986415.650035:0:83907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548bea lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11ee expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986415.650064:0:83907:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1788986415.650083:0:83907:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986415.650303:0:83907:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf548c1b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 83907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986415.650320:0:83907:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf548c1b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 83907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986415.650334:0:83907:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf548c1b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 83907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986415.650341:0:83907:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf548c1b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986415.650348:0:83907:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf548c1b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 83907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986415.650356:0:83907:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf548c1b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986415.650363:0:83907:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986415.650368:0:83907:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf548c1b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 83907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986415.650377:0:83907:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf548c1b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 83907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986415.650392:0:83907:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf548c1b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986415.650401:0:83907:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf548c1b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986415.650408:0:83907:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf548c1b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 83907 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986416.064333:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986416.134775:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986416.142330:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993527296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986416.142434:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986416.142753:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993527296 00000100:00100000:2.0:1788986416.142765:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993527296 00000100:00100000:2.0:1788986416.142864:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 786 00000100:00100000:2.0:1788986416.142876:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993527296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986416.142924:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986416.142991:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993527296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986416.142998:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 786 00000100:00080000:1.0:1788986416.143067:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986416.143162:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943819180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993527296:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1788986416.448200:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986416.448211:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986416.448217:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986416.448274:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986416.448288:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986416.448301:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986416.448339:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a4510b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993527424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986416.448432:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986416.448498:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094395f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986416.448606:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993527424 00000100:00100000:2.0:1788986416.448617:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993527424 00000100:00100000:2.0:1788986416.448683:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:2.0:1788986416.448694:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993527424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986416.448709:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986416.448732:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf548c29 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548c22 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986416.448761:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf548c29 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548c22 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986416.448778:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf548c29 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548c22 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986416.448788:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1600, rc 0) 00000100:00100000:2.0:1788986416.448850:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993527424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986416.448858:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:0.0:1788986416.457309:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a4510b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993527424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986416.457346:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548c29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986416.457361:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548c29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986416.457390:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986416.457397:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548c29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986416.457405:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548c29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986417.088374:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986417.158845:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a4510b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993527552:0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.159249:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986417.159306:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993528064:0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.159334:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986417.159366:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986417.159373:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993527936:0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.159398:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986417.159432:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a457ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993527680:0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.159459:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986417.159481:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993528192:0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.159505:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986417.159524:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986417.159530:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993527808:0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.159552:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986417.159712:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993527552 00000100:00100000:0.0:1788986417.159723:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993527552 00000100:00100000:0.0:1788986417.159888:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:0.0:1788986417.159900:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993527552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986417.166017:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993527552:12345-0@lo:400:kworker.0 Request processed in 6104us (6754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986417.166037:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:1.0:1788986417.166497:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993528064 00000100:00100000:1.0:1788986417.166509:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993528064 00000100:00100000:1.0:1788986417.166593:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:1.0:1788986417.166606:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993528064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.166697:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993528064:12345-0@lo:400:kworker.0 Request processed in 95us (7361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986417.166704:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:1.0:1788986417.166718:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993527680 00000100:00100000:1.0:1788986417.166722:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993527680 00000100:00100000:1.0:1788986417.166743:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993527808 00000100:00100000:1.0:1788986417.166746:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993527808 00000100:00100000:1.0:1788986417.166782:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:1.0:1788986417.166788:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993527680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.166826:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993527680:12345-0@lo:400:kworker.0 Request processed in 37us (7365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986417.166832:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00100000:1.0:1788986417.166844:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00100000:1.0:1788986417.166850:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993527808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.166879:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993527808:12345-0@lo:400:kworker.0 Request processed in 30us (7326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986417.166884:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00100000:1.0:1788986417.166906:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993527936 00000100:00100000:1.0:1788986417.166909:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993527936 00000100:00100000:1.0:1788986417.166936:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993528192 00000100:00100000:1.0:1788986417.166939:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993528192 00000100:00100000:1.0:1788986417.167117:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1788986417.167127:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993527936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.167162:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993527936:12345-0@lo:400:kworker.0 Request processed in 38us (7764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986417.167169:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1788986417.167180:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1788986417.167185:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993528192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.167210:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993528192:12345-0@lo:400:kworker.0 Request processed in 25us (7705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986417.167219:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:1.0:1788986417.167309:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993527808:0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.167324:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a457ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993527680:0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.167335:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993528192:0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.167383:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993527936:0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.167396:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a4510b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993527552:0@lo:400:kworker.0 00000100:00100000:1.0:1788986417.167407:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993528064:0@lo:400:kworker.0 00000100:00080000:3.0:1788986417.167512:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986417.167519:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986417.665276:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993528320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986417.665360:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986417.665400:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993528320 00000100:00100000:2.0:1788986417.665412:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993528320 00000100:00100000:2.0:1788986417.665482:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 787 00000100:00100000:2.0:1788986417.665496:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993528320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986417.665541:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986417.665637:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993528320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 145us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986417.665644:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 787 00000100:00100000:0.0:1788986417.669678:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f430a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993528320:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986418.113409:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986418.930052:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986418.930210:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971308288 00000100:00100000:1.0:1788986418.930224:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971308288 00000100:00080000:3.0:1788986418.930315:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986418.930339:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 13 00000100:00100000:1.0:1788986418.930351:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5588:x1875885971308288:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986418.930371:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986418.930374:0:5840:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf548bea) 00010000:00010000:1.0:1788986418.930376:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986418.930448:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5588:x1875885971308288:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 99us (411us total) trans 0 rc 116/116 00000100:00100000:1.0:1788986418.930456:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 13 00010000:00010000:1.0:1788986419.138491:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986419.313829:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986419.313881:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971308416 00000100:00100000:2.0:1788986419.313894:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971308416 00000100:00100000:2.0:1788986419.313957:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1241 00000100:00100000:2.0:1788986419.313969:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971308416:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986419.314062:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971308416:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 95us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986419.314072:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1241 00000100:00100000:0.0:1788986419.931952:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986419.932175:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971308544 00000100:00100000:3.0:1788986419.932189:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971308544 00000100:00100000:3.0:1788986419.932266:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 812 00000100:00100000:3.0:1788986419.932277:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49243:x1875885971308544:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986419.932304:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986419.932334:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548c30 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d11fc expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986419.932423:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548c37 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986419.932440:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548c37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986419.932456:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548c37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986419.932504:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788986419.932509:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986419.932535:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548c37 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986419.932563:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548c30 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11fc expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986419.932586:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548c37 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11fc expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986419.932595:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:3.0:1788986419.932598:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986419.932603:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986419.932675:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49243:x1875885971308544:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 400us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986419.932683:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 812 00000100:00100000:2.0:1788986419.941435:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986419.941542:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971308672 00000100:00100000:0.0:1788986419.941554:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971308672 00000100:00100000:0.0:1788986419.941624:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 813 00000100:00100000:0.0:1788986419.941641:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49243:x1875885971308672:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986419.941668:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986419.941695:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548c3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1203 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.941765:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548c45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.941781:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548c45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.941795:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548c45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.941811:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548c4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.941818:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548c4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.941825:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548c4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942207:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548c53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942217:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942225:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986419.942267:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:0.0:1788986419.942271:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986419.942295:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548c53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942308:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548c45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942316:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548c45 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942323:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548c45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942330:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986419.942334:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548c45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942343:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548c45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942355:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:0.0:1788986419.942358:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986419.942363:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548c45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942369:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548c45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942382:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548c4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942393:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548c4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942399:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548c4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942404:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986419.942407:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548c4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942412:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548c4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942419:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a4823b100) 00010000:00010000:0.0:1788986419.942421:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986419.942423:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548c4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942428:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548c4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942461:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548c3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1203 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942476:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548c53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1203 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986419.942483:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823bb00) 00010000:00010000:0.0:1788986419.942486:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986419.942489:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee000, rc 0) 00000100:00100000:0.0:1788986419.942570:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f432300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49243:x1875885971308672:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 934us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986419.942577:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 813 00000100:00100000:3.0:1788986419.959396:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986419.959498:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971308928 00000100:00100000:1.0:1788986419.959510:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971308928 00000100:00100000:1.0:1788986419.959574:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 814 00000100:00100000:1.0:1788986419.959585:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49243:x1875885971308928:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986419.959651:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986419.959685:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548c53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1203 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986419.959705:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823bb00) 00010000:00010000:1.0:1788986419.959717:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986419.959747:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986419.959761:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986419.959772:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788986419.992412:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967602 is committed 00000004:00010000:1.0:1788986419.992606:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006658bce1 reply state 0000000022673ff3 transno 4294967602 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986419.992623:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986419.992642:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00010000:00080000:1.0:1788986419.992771:0:15241:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788986419.992793:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49243:x1875885971308928:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 33202us (33404us total) trans 4294967602 rc 0/0 00000100:00100000:1.0:1788986419.992804:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 814 00010000:00010000:2.0:1788986419.993377:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986419.993390:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986419.993398:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986419.993405:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986419.993411:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986419.993420:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986419.993438:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316d00) 00010000:00010000:2.0:1788986419.993441:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986419.993448:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986419.993455:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986420.066835:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986420.066958:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971309056 00000100:00100000:1.0:1788986420.066970:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971309056 00000100:00100000:1.0:1788986420.067059:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 815 00000100:00100000:1.0:1788986420.067072:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094381b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49247:x1875885971309056:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986420.067168:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986420.067195:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548c61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d120a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067274:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548c68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067292:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548c68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067304:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548c68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067322:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067329:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067335:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067699:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548c76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067711:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067720:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986420.067755:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:1.0:1788986420.067760:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986420.067783:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548c76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067802:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548c68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067809:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548c68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067817:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548c68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067825:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986420.067830:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548c68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067840:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548c68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067854:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:1.0:1788986420.067858:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986420.067864:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548c68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067871:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548c68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067887:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067893:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067899:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067905:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986420.067908:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067914:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067921:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a45316700) 00010000:00010000:1.0:1788986420.067923:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986420.067926:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067932:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548c6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067967:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548c61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d120a expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067983:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548c76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d120a expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.067991:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:1.0:1788986420.067994:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986420.067996:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788986420.068144:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094381b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49247:x1875885971309056:12345-192.168.206.21@tcp:101:touch.0 Request processed in 1075us (1323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986420.068152:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 815 00000100:00080000:3.0:1788986420.068425:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986420.070675:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986420.070826:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971309312 00000100:00100000:2.0:1788986420.070839:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971309312 00000100:00100000:2.0:1788986420.070915:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 816 00000100:00100000:2.0:1788986420.070927:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49247:x1875885971309312:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986420.070954:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986420.070981:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548c7d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1211 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.071509:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548c84 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.071528:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548c84 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.071540:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548c84 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.071853:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548c8b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.071877:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.071890:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986420.073672:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1a:0x0], index 0: 0 00010000:00010000:2.0:1788986420.073974:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548c92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.073991:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548c92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.074003:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548c92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.074041:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548c84 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.074052:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548c84 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.074058:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548c84 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.074064:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986420.074069:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548c84 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.074126:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548c84 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.074139:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:2.0:1788986420.074142:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986420.074147:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548c84 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.074152:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548c84 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986420.074167:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c636c1f5 reply state 000000000f80541b transno 4294967603 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986420.074177:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986420.074214:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548c7d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1211 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.074230:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548c92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1211 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.074244:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:2.0:1788986420.074247:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986420.074250:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0c00, rc 0) 00000100:00100000:2.0:1788986420.074330:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49247:x1875885971309312:12345-192.168.206.21@tcp:101:touch.0 Request processed in 3404us (3664us total) trans 4294967603 rc 0/0 00000100:00100000:2.0:1788986420.074341:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 816 00010000:00010000:3.0:1788986420.078263:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548c8b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986420.078288:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:3.0:1788986420.078297:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548c8b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986420.078308:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548c8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986420.078316:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986420.078322:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548c8b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986420.078332:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548c8b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986420.078360:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a45acac00) 00010000:00010000:3.0:1788986420.078364:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986420.078370:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548c8b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986420.078378:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548c8b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986420.079358:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971309568 00000100:00100000:1.0:1788986420.079374:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971309568 00000100:00100000:1.0:1788986420.079473:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 817 00000100:00100000:1.0:1788986420.079489:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:49247:x1875885971309568:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:1.0:1788986420.079568:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986420.079596:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548c92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1211 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.079615:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:1.0:1788986420.079627:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986420.079682:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ca0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.079698:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.079711:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986420.079878:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ce558f6d reply state 0000000045abd63d transno 4294967604 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986420.079889:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986420.080015:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49247:x1875885971309568:12345-192.168.206.21@tcp:36:touch.0 Request processed in 529us (1747us total) trans 4294967604 rc 0/0 00000100:00100000:1.0:1788986420.080022:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 817 00010000:00010000:2.0:1788986420.086511:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ca0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.086529:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ca0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.086537:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ca0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.086544:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986420.086548:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ca0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.086556:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ca0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.086572:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9b0a45316700) 00010000:00010000:2.0:1788986420.086574:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986420.086579:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ca0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.086586:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ca0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986420.093716:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986420.093921:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971309696 00000100:00100000:0.0:1788986420.093933:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971309696 00000100:00100000:0.0:1788986420.093991:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 818 00000100:00100000:0.0:1788986420.094001:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:49247:x1875885971309696:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788986420.094026:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986420.094049:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548ca7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1218 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986420.094160:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548ca7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1218 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986420.094175:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548ca7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x43:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1218 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986420.094192:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:0.0:1788986420.094195:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788986420.094199:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986420.094248:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49247:x1875885971309696:12345-192.168.206.21@tcp:101:touch.0 Request processed in 249us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986420.094255:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 818 00000100:00100000:3.0:1788986420.097195:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986420.097311:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971309824 00000100:00100000:1.0:1788986420.097327:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971309824 00000100:00100000:1.0:1788986420.097397:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 442 00000100:00100000:1.0:1788986420.097405:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1875885971309824:12345-192.168.206.21@tcp:8:touch.0 00010000:00080000:1.0:1788986420.097435:0:8478:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 2203 last 0 00000020:00000080:1.0:1788986420.097463:0:8478:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf548cae 00002000:00100000:1.0:1788986420.097503:0:8478:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b0a43d17000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788986420.097528:0:8478:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788986420.097755:0:8478:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788986420.097787:0:8478:0:(import.c:65:import_set_state_nolock()) ffff9b0a43d13800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788986420.097858:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971309824:12345-192.168.206.21@tcp:8:touch.0 Request processed in 451us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986420.097865:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 442 00000100:00100000:1.0:1788986420.100359:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986420.100495:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971309952 00000100:00100000:2.0:1788986420.100508:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971309952 00000100:00100000:2.0:1788986420.100593:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 443 00000100:00100000:2.0:1788986420.100604:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:0:x1875885971309952:12345-192.168.206.21@tcp:2:touch.0 00000100:00080000:3.0:1788986420.100911:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986420.160463:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986420.168436:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:0:x1875885971309952:12345-192.168.206.21@tcp:2:touch.0 Request processed in 67821us (68082us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788986420.168454:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 443 00000001:00100000:0.0:1788986420.168555:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000001:00080000:0.0:1788986420.168576:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967348 is committed 00000100:00100000:3.0:1788986420.181072:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986420.188640:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971310208 00000100:00100000:1.0:1788986420.188659:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971310208 00000100:00100000:1.0:1788986420.188753:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:1.0:1788986420.188766:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49247:x1875885971310208:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:1.0:1788986420.189275:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49247:x1875885971310208:12345-192.168.206.21@tcp:35:touch.0 Request processed in 509us (8217us total) trans 4294967605 rc 0/0 00000100:00100000:1.0:1788986420.189284:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 82 00000100:00100000:3.0:1788986420.274728:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986420.274852:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971310336 00000100:00100000:2.0:1788986420.274864:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971310336 00000100:00100000:2.0:1788986420.274940:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 819 00000100:00100000:2.0:1788986420.274952:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49251:x1875885971310336:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986420.274986:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986420.275011:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548cb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d121f expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275316:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548cbc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275466:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548cbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275484:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548cbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275503:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548cc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275516:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275523:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275634:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548cca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275643:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275651:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986420.275692:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x43:0x0]: returning size 0 00000004:00200000:2.0:1788986420.275698:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986420.275721:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275735:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548cca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275745:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548cbc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275752:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548cbc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275759:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548cbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275771:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986420.275776:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548cbc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275785:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548cbc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275798:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:2.0:1788986420.275802:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986420.275807:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548cbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275814:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548cbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275829:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548cc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275834:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548cc3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275840:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275846:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986420.275849:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548cc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275855:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548cc3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275867:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a45aca500) 00010000:00010000:2.0:1788986420.275870:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986420.275872:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548cc3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275878:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548cc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275915:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548cb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d121f expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275930:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548cca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d121f expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.275938:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:2.0:1788986420.275941:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986420.275943:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986420.276030:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49251:x1875885971310336:12345-192.168.206.21@tcp:101:rm.0 Request processed in 1080us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986420.276039:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 819 00000100:00100000:1.0:1788986420.282310:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986420.282502:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971310464 00000100:00100000:2.0:1788986420.282516:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971310464 00000100:00100000:2.0:1788986420.282685:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 444 00000100:00100000:2.0:1788986420.282697:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971310464:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986420.282721:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986420.282751:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040203d0e/0xc20d828fcf548cd1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1226 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788986420.282795:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x6aa1c433, atime: 0x6aa1c433, ctime: 0x6aa1c433, blocks: 0x1 00010000:00010000:2.0:1788986420.282825:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=2204s v=(0 0) 00010000:00010000:2.0:1788986420.282830:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986420.282844:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040203d0e/0xc20d828fcf548cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1226 expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.282867:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000040203d0e/0xc20d828fcf548cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1226 expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986420.282884:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0400, rc 0) 00000100:00100000:2.0:1788986420.283018:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971310464:12345-192.168.206.21@tcp:101:rm.0 Request processed in 323us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986420.283027:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 444 00000100:00100000:3.0:1788986420.305547:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986420.305700:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971310720 00000100:00100000:1.0:1788986420.305712:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971310720 00000100:00100000:1.0:1788986420.305791:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 820 00000100:00100000:1.0:1788986420.305802:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49251:x1875885971310720:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788986420.305867:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986420.305902:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548cca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x43:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d121f expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.305933:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548ca7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x43:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1218 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.305944:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:1.0:1788986420.305956:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986420.305981:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548cd8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.305997:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.306007:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.306021:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548cdf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.306027:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548cdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.306034:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548cdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.306227:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548ce6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.306235:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548ce6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.306241:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548ce6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986420.306923:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].26, 64 off9856 00000004:00080000:1.0:1788986420.306937:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2204209847541ns, next at 2205209844263ns, rc = 0 00010000:00010000:1.0:1788986420.307011:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ced lrc: 3/0,1 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307024:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307035:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ced lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307043:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ced lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307050:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ced lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307056:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ced lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307140:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986420.307166:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548ce6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307172:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548ce6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307179:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548ce6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307185:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986420.307191:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548ce6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307200:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548ce6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307211:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:1.0:1788986420.307215:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986420.307220:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548ce6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307226:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548ce6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x43:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307248:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548cd8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307253:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548cd8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307258:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548cd8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307263:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986420.307265:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548cd8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307271:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548cd8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307277:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:1.0:1788986420.307279:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986420.307283:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548cd8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.307288:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548cd8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986420.307298:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dd6f3efd reply state 000000003ae1be6e transno 4294967606 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548cdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986420.307307:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986420.307407:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49251:x1875885971310720:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1603us (1870us total) trans 4294967606 rc 0/0 00000100:00100000:1.0:1788986420.307417:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 820 00010000:00010000:3.0:1788986420.309578:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986420.309595:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ced lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986420.309607:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986420.309612:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ced lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986420.309623:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ced lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986420.309644:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x43:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:3.0:1788986420.309648:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986420.309653:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ced lrc: 1/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986420.309659:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ced lrc: 0/0,0 mode: --/PW res: [0x200000401:0x43:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986420.309708:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986420.309710:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986420.309712:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986420.311446:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548cdf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.311468:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548cdf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.311476:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548cdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.311483:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986420.311488:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548cdf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.311496:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548cdf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.311513:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a45316f00) 00010000:00010000:1.0:1788986420.311517:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986420.311523:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548cdf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986420.311531:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548cdf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.184456:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986421.248444:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986421.248466:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a4510b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993528448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986421.248532:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986421.248757:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993528448 00000100:00100000:1.0:1788986421.248766:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993528448 00000100:00100000:1.0:1788986421.248823:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 788 00000100:00100000:1.0:1788986421.248832:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993528448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986421.248868:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986421.248922:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993528448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986421.248929:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 788 00000100:00080000:1.0:1788986421.248948:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986421.248985:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a4510b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993528448:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986421.281043:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986421.281156:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971310848 00000100:00100000:0.0:1788986421.281167:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971310848 00000100:00100000:0.0:1788986421.281232:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 821 00000100:00100000:0.0:1788986421.281243:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4510b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49266:x1875885971310848:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986421.281266:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986421.281290:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548cf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d122d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.281352:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548cfb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.281365:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548cfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.281376:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548cfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986421.281407:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:0.0:1788986421.281411:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986421.281430:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548cfb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.281455:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548cf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d122d expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.281469:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548cfb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d122d expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.281477:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:0.0:1788986421.281480:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986421.281484:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788986421.281539:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4510b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49266:x1875885971310848:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 298us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986421.281546:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 821 00000100:00100000:0.0:1788986421.290976:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986421.291037:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971311104 00000100:00100000:1.0:1788986421.291045:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971311104 00000100:00100000:1.0:1788986421.291122:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 822 00000100:00100000:1.0:1788986421.291131:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49266:x1875885971311104:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986421.291180:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986421.291213:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548cfb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d122d expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.291232:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548c76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d120a expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.291243:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:1.0:1788986421.291253:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986421.291274:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.291286:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.291295:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986421.377510:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ab48ee34 reply state 000000002b880b4b transno 4294967607 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986421.377528:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986421.377542:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000100:00100000:1.0:1788986421.377638:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80910380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49266:x1875885971311104:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 86504us (86666us total) trans 4294967607 rc 0/0 00000100:00100000:1.0:1788986421.377646:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 822 00000001:00080000:1.0:1788986421.377688:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967607 is committed 00000004:00080000:1.0:1788986421.377698:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 68 committed 00010000:00010000:1.0:1788986421.377828:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.377837:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.377843:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.377849:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986421.377853:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.377865:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.377879:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316f00) 00010000:00010000:1.0:1788986421.377882:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986421.377886:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.377892:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986421.378019:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993528576:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788986421.378065:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986421.378161:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993528576 00000100:00100000:1.0:1788986421.378167:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993528576 00000100:00100000:1.0:1788986421.378202:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:1.0:1788986421.378210:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993528576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788986421.378233:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:26 count 1 00010000:00010000:1.0:1788986421.378252:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.378268:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040203d0e/0xc20d828fcf548cd1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1226 expref: 5 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.378278:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788986421.378282:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986421.378286:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.378317:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040203d0e/0xc20d828fcf548cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1226 expref: 5 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.378330:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040203d0e/0xc20d828fcf548cd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1226 expref: 5 pid: 8478 timeout: 2305 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986421.378342:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875885993528704:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986421.378379:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788986421.391346:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875885993528704:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788986421.391378:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986421.399177:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986421.399212:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971311232 00000100:00100000:0.0:1788986421.399221:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971311232 00010000:00010000:0.0:1788986421.399257:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040203d0e/0xc20d828fcf548cd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1226 expref: 6 pid: 8478 timeout: 2305 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986421.399290:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 391 00000100:00100000:0.0:1788986421.399300:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971311232:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986421.399326:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986421.399334:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040203d0e/0xc20d828fcf548cd1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1226 expref: 6 pid: 8478 timeout: 2305 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.399348:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040203d0e/0xc20d828fcf548cd1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1226 expref: 6 pid: 8478 timeout: 2305 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.399370:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040203d0e/0xc20d828fcf548cd1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1226 expref: 6 pid: 8478 timeout: 2305 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.399383:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986421.399388:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986421.399393:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.399409:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.399443:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986421.399492:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971311232:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 193us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986421.399500:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 391 00010000:00010000:2.0:1788986421.399630:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986421.399642:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986421.399652:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986421.399665:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986421.399684:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788986421.400318:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993528576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22106us (22250us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788986421.400326:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00010000:00010000:3.0:1788986421.401182:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986421.401192:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.401205:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986421.401210:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.401221:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.401239:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.401248:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf548d09 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.401268:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986421.401270:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986421.401272:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788986421.401718:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7fb33800/2, rc 0, transno 4294967349 00000100:00100000:1.0:1788986421.401727:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993528576:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788986421.468312:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986421.468560:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971311360 00000100:00100000:0.0:1788986421.468570:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971311360 00000100:00100000:0.0:1788986421.468630:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 823 00000100:00100000:0.0:1788986421.468641:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49270:x1875885971311360:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788986421.468664:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986421.468684:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548d10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1234 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.468743:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548d17 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.468757:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548d17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.468768:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548d17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.468779:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548d1e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.468785:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548d1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.468792:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548d1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469127:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548d25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469137:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469143:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986421.469179:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:0.0:1788986421.469183:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986421.469201:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548d25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469212:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548d17 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469218:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548d17 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469225:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548d17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469230:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986421.469234:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548d17 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469241:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548d17 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469253:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:0.0:1788986421.469256:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986421.469260:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548d17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469266:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548d17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469277:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548d1e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469283:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548d1e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469288:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548d1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469292:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986421.469295:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548d1e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469302:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548d1e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469309:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a4823b800) 00010000:00010000:0.0:1788986421.469312:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986421.469315:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548d1e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469321:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf548d1e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469352:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548d10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1234 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469365:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548d25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1234 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.469372:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:0.0:1788986421.469375:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986421.469377:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee000, rc 0) 00000100:00100000:0.0:1788986421.469431:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49270:x1875885971311360:12345-192.168.206.21@tcp:101:touch.0 Request processed in 792us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986421.469438:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 823 00000100:00100000:0.0:1788986421.482214:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986421.482308:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971311616 00000100:00100000:1.0:1788986421.482317:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971311616 00000100:00100000:1.0:1788986421.482380:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 824 00000100:00100000:1.0:1788986421.482390:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49270:x1875885971311616:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986421.482406:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986421.482424:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d2c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d123b expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.482652:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d33 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.482667:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.482682:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.482695:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.482701:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.482708:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788986421.484041:0:15241:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1a:0x0], index 1: 0 00010000:00010000:1.0:1788986421.484846:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.484864:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.484875:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.484911:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d33 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.484918:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d33 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.484925:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.484930:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986421.485249:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d33 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.485260:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d33 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.485274:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:1.0:1788986421.485277:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986421.485282:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d33 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.485289:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d33 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986421.485306:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b64fc074 reply state 00000000e0070e75 transno 4294967608 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986421.485315:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986421.485363:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d123b expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.485379:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d123b expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.485385:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788986421.485387:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986421.485389:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788986421.485465:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49270:x1875885971311616:12345-192.168.206.21@tcp:101:touch.0 Request processed in 3076us (3259us total) trans 4294967608 rc 0/0 00000100:00100000:1.0:1788986421.485474:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 824 00010000:00010000:3.0:1788986421.487854:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.487876:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.487883:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.487889:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986421.487894:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.487902:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.487919:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a45316f00) 00010000:00010000:3.0:1788986421.487922:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986421.487927:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.487934:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548d3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986421.491446:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986421.491535:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971311872 00000100:00100000:1.0:1788986421.491550:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971311872 00000100:00100000:1.0:1788986421.491606:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 825 00000100:00100000:1.0:1788986421.491616:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:49270:x1875885971311872:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:1.0:1788986421.491669:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986421.491694:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d123b expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.491714:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788986421.491724:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986421.491762:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.491775:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.491785:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986421.491937:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f69bddbb reply state 00000000e40aca61 transno 4294967609 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986421.491957:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986421.492053:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49270:x1875885971311872:12345-192.168.206.21@tcp:36:touch.0 Request processed in 438us (615us total) trans 4294967609 rc 0/0 00000100:00100000:1.0:1788986421.492061:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 825 00000100:00100000:1.0:1788986421.499413:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:2.0:1788986421.499692:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986421.499705:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986421.499712:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986421.499718:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986421.499722:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986421.499730:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d4f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986421.499746:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:2.0:1788986421.499749:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986421.499753:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d4f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986421.499760:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548d4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986421.500624:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971312000 00000100:00100000:3.0:1788986421.500634:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971312000 00000100:00100000:3.0:1788986421.500726:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 826 00000100:00100000:3.0:1788986421.500737:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:49270:x1875885971312000:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:3.0:1788986421.500760:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986421.500779:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548d56 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1242 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.500841:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548d56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1242 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.500853:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548d56 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1242 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986421.500869:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:3.0:1788986421.500872:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788986421.500875:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3c00, rc 0) 00000100:00100000:3.0:1788986421.500945:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49270:x1875885971312000:12345-192.168.206.21@tcp:101:touch.0 Request processed in 210us (1620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986421.500953:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 826 00000100:00100000:2.0:1788986421.505763:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986421.505857:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971312128 00000100:00100000:1.0:1788986421.505867:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971312128 00000100:00100000:1.0:1788986421.505951:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 446 00000100:00100000:1.0:1788986421.505960:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1875885971312128:12345-192.168.206.21@tcp:8:touch.0 00010000:00080000:1.0:1788986421.505991:0:8478:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 2205 last 0 00000020:00000080:1.0:1788986421.506025:0:8478:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf548d5d 00002000:00100000:1.0:1788986421.506037:0:8478:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b0a43d11800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788986421.506060:0:8478:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788986421.506523:0:8478:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788986421.506632:0:8478:0:(import.c:65:import_set_state_nolock()) ffff9b0a43d11000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788986421.506745:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971312128:12345-192.168.206.21@tcp:8:touch.0 Request processed in 784us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986421.506753:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 446 00000100:00100000:0.0:1788986421.509794:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986421.509897:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971312256 00000100:00100000:1.0:1788986421.509905:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971312256 00000100:00080000:3.0:1788986421.510024:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986421.510213:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 447 00000100:00100000:1.0:1788986421.510225:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:0:x1875885971312256:12345-192.168.206.21@tcp:2:touch.0 00000001:00080000:3.0:1788986421.539464:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967348 is committed 00000001:00100000:3.0:1788986421.539480:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:0.0:1788986421.540671:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:0:x1875885971312256:12345-192.168.206.21@tcp:2:touch.0 Request processed in 30443us (30878us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1788986421.540682:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 447 00000100:00100000:0.0:1788986421.544425:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986421.544574:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971312512 00000100:00100000:1.0:1788986421.544584:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971312512 00000100:00100000:1.0:1788986421.544639:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 83 00000100:00100000:1.0:1788986421.544649:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49270:x1875885971312512:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:1.0:1788986421.544973:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49270:x1875885971312512:12345-192.168.206.21@tcp:35:touch.0 Request processed in 324us (556us total) trans 4294967610 rc 0/0 00000100:00100000:1.0:1788986421.544981:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 83 00000100:00100000:2.0:1788986421.640061:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986421.640282:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971312640 00000100:00100000:1.0:1788986421.640292:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971312640 00000100:00100000:1.0:1788986421.640359:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 827 00000100:00100000:1.0:1788986421.640370:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49274:x1875885971312640:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986421.640392:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986421.640410:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1249 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640465:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640478:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640489:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640502:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640509:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640516:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640728:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548d79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640737:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640744:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986421.640775:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x44:0x0]: returning size 0 00000004:00200000:1.0:1788986421.640779:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986421.640796:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640808:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548d79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640815:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640822:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640829:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640835:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986421.640839:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640846:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640856:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:1.0:1788986421.640869:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986421.640874:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640881:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640894:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640904:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640910:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640914:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986421.640917:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640922:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640929:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a45316c00) 00010000:00010000:1.0:1788986421.640931:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986421.640934:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.640939:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.641221:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1249 expref: 13 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.641237:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548d79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1249 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.641244:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:1.0:1788986421.641246:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986421.641249:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788986421.641312:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49274:x1875885971312640:12345-192.168.206.21@tcp:101:rm.0 Request processed in 944us (1258us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986421.641320:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 827 00000100:00100000:0.0:1788986421.647509:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986421.647706:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971312768 00000100:00100000:2.0:1788986421.647717:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971312768 00000100:00100000:2.0:1788986421.647768:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 448 00000100:00100000:2.0:1788986421.647778:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971312768:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986421.647793:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986421.647813:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf548d80 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1250 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788986421.647839:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x6aa1c435, atime: 0x6aa1c435, ctime: 0x6aa1c435, blocks: 0x1 00010000:00010000:2.0:1788986421.647858:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=2205s v=(0 0) 00010000:00010000:2.0:1788986421.647862:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986421.647871:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf548d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1250 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986421.647889:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf548d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1250 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986421.647902:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0800, rc 0) 00000100:00100000:2.0:1788986421.647983:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80912a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971312768:12345-192.168.206.21@tcp:101:rm.0 Request processed in 206us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986421.647990:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 448 00000100:00100000:0.0:1788986421.652723:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986421.652816:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971313024 00000100:00100000:1.0:1788986421.652825:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971313024 00000100:00100000:1.0:1788986421.652886:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 828 00000100:00100000:1.0:1788986421.652896:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49274:x1875885971313024:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788986421.652948:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986421.652980:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548d79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x44:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1249 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.653001:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548d56 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x44:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1242 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.653012:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:1.0:1788986421.653023:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986421.653042:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d87 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.653055:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.653077:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.653136:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d8e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.653145:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.653153:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.653245:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d95 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.653253:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.653259:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986421.654242:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].26, 64 off9856 00000004:00080000:1.0:1788986421.654252:0:7899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2205557162717ns, next at 2206557160879ns, rc = 0 00010000:00010000:1.0:1788986421.654312:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548d9c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654473:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548d9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654487:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548d9c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654496:0:7899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548d9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654502:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548d9c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654509:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548d9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654688:0:7899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986421.654712:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d95 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654719:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d95 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654725:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654731:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986421.654736:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d95 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654742:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d95 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654752:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788986421.654755:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986421.654759:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d95 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654765:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548d95 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x44:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654783:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d87 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654790:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d87 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654800:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654805:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986421.654808:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d87 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654813:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d87 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654821:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:1.0:1788986421.654823:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986421.654826:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d87 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.654831:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548d87 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986421.654841:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004081f217 reply state 0000000022c02e85 transno 4294967611 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986421.654848:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986421.654947:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80913b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49274:x1875885971313024:12345-192.168.206.21@tcp:36:rm.0 Request processed in 2042us (2222us total) trans 4294967611 rc 0/0 00000100:00100000:1.0:1788986421.654962:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 828 00010000:00010000:0.0:1788986421.656681:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986421.656693:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548d9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.656703:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986421.656708:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548d9c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.656718:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548d9c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.656731:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x44:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:0.0:1788986421.656734:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788986421.656739:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548d9c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.656746:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548d9c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x44:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986421.656768:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986421.656770:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986421.656772:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986421.657726:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d8e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.657739:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d8e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.657752:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.657758:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986421.657762:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d8e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.657769:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d8e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.657781:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a45316c00) 00010000:00010000:1.0:1788986421.657784:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986421.657788:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d8e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986421.657794:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548d8e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986422.210993:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986422.273530:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993528960:0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.273598:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986422.273723:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993529472:0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.273751:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986422.273788:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788986422.273795:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993528832:0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.273823:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986422.273846:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993529344:0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.273868:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986422.273896:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993529088:0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.273918:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986422.273937:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986422.273943:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993529216:0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.273964:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986422.273989:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993528960 00000100:00100000:0.0:1788986422.273996:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993528960 00000100:00100000:0.0:1788986422.274034:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993529344 00000100:00100000:0.0:1788986422.274037:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993529344 00000100:00100000:0.0:1788986422.274077:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993529088 00000100:00100000:0.0:1788986422.274080:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993529088 00000100:00100000:0.0:1788986422.274117:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:0.0:1788986422.274124:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993528960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.274172:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993528960:12345-0@lo:400:kworker.0 Request processed in 48us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986422.275997:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00080000:3.0:1788986422.276152:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986422.276230:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993529472 00000100:00100000:2.0:1788986422.276238:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993529472 00000100:00100000:2.0:1788986422.276284:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993529216 00000100:00100000:2.0:1788986422.276288:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993529216 00000100:00100000:2.0:1788986422.276307:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1788986422.276315:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993529472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986422.276400:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993529472:12345-0@lo:400:kworker.0 Request processed in 86us (2648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986422.276407:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1788986422.276419:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:2.0:1788986422.276425:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993529216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986422.276459:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993529216:12345-0@lo:400:kworker.0 Request processed in 35us (2494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986422.276465:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00080000:2.0:1788986422.276480:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986422.277048:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:1.0:1788986422.277061:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993529344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986422.277133:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993529344:12345-0@lo:400:kworker.0 Request processed in 77us (3264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986422.277346:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1788986422.277997:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1788986422.278012:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993529088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.278057:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993529088:12345-0@lo:400:kworker.0 Request processed in 52us (4137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986422.278075:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1788986422.278151:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993529344:0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.278167:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993528960:0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.278186:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993529472:0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.278228:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993529216:0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.278238:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993529088:0@lo:400:kworker.0 00000100:00100000:3.0:1788986422.279516:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993528832 00000100:00100000:3.0:1788986422.279526:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993528832 00000100:00100000:3.0:1788986422.279571:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:3.0:1788986422.279579:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993528832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986422.279649:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993528832:12345-0@lo:400:kworker.0 Request processed in 71us (5824us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986422.279655:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:0.0:1788986422.279851:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993528832:0@lo:400:kworker.0 00000100:00100000:0.0:1788986422.734041:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986422.737166:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971313152 00000100:00100000:3.0:1788986422.737179:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971313152 00000100:00100000:3.0:1788986422.737772:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 829 00000100:00100000:3.0:1788986422.737784:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49288:x1875885971313152:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986422.737806:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986422.737825:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548da3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1257 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986422.737884:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548daa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986422.737898:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986422.737911:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788986422.738031:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1788986422.740455:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:3.0:1788986422.740464:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986422.740500:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548daa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986422.740541:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548da3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1257 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986422.740562:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548daa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1257 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986422.740571:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:3.0:1788986422.740574:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986422.740577:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3800, rc 0) 00000100:00100000:3.0:1788986422.740653:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49288:x1875885971313152:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 2870us (6620us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986422.740662:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 829 00000100:00100000:3.0:1788986422.752285:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986422.752425:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971313408 00000100:00100000:0.0:1788986422.752434:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971313408 00000100:00100000:0.0:1788986422.752494:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 830 00000100:00100000:0.0:1788986422.752506:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49288:x1875885971313408:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788986422.752568:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986422.752595:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548daa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1257 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986422.752618:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548d25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1234 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986422.752630:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:0.0:1788986422.752640:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986422.752662:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf548db1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986422.752675:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf548db1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986422.752685:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf548db1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986422.752895:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000dc3bee78 reply state 00000000281006d7 transno 4294967612 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf548db1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986422.752905:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788986422.752913:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000100:00100000:0.0:1788986422.753453:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49288:x1875885971313408:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 948us (1174us total) trans 4294967612 rc 0/0 00000100:00100000:0.0:1788986422.753462:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 830 00010000:00010000:1.0:1788986422.773437:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf548db1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986422.773455:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf548db1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986422.773469:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf548db1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986422.773475:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efe00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986422.773480:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf548db1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986422.773487:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf548db1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986422.773503:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823b800) 00010000:00010000:1.0:1788986422.773506:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986422.773511:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf548db1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986422.773517:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf548db1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986422.787669:0:7935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2206690576956ns, next at 2207690574679ns, rc = 0 00000100:00100000:0.0:1788986422.787695:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7988f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993529600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986422.787752:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986422.790355:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993529600 00000100:00100000:1.0:1788986422.790367:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993529600 00000100:00100000:1.0:1788986422.790425:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 789 00000100:00100000:1.0:1788986422.790434:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993529600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986422.790458:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986422.791120:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993529600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 656us (3336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986422.791129:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 789 00000100:00100000:1.0:1788986422.791180:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7988f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993529600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986422.916620:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986422.916717:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971313536 00000100:00100000:2.0:1788986422.916728:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971313536 00000100:00100000:2.0:1788986422.916787:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 831 00000100:00100000:2.0:1788986422.916796:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49300:x1875885971313536:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986422.916884:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49300:x1875885971313536:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 88us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986422.916891:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 831 00000100:00100000:0.0:1788986422.923708:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986422.923875:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971313664 00000100:00100000:2.0:1788986422.923885:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971313664 00000100:00100000:2.0:1788986422.923959:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 449 00000100:00100000:2.0:1788986422.923971:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49300:x1875885971313664:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986422.924390:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49300:x1875885971313664:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 421us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986422.924403:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 449 00000100:00080000:3.0:1788986422.924825:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986422.927358:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986422.927452:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971313792 00000100:00100000:2.0:1788986422.927461:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971313792 00000100:00100000:2.0:1788986422.927534:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 450 00000100:00100000:2.0:1788986422.927748:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49300:x1875885971313792:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986422.928374:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49300:x1875885971313792:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 629us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986422.928384:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 450 00000100:00100000:1.0:1788986422.936181:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986422.936346:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971313920 00000100:00100000:3.0:1788986422.936355:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971313920 00000100:00100000:3.0:1788986422.936417:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 832 00000100:00100000:3.0:1788986422.936427:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49300:x1875885971313920:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986422.936851:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49300:x1875885971313920:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 424us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986422.936860:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 832 00000100:00100000:0.0:1788986422.941842:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986422.941939:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971314048 00000100:00100000:1.0:1788986422.941948:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971314048 00000100:00100000:1.0:1788986422.942001:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 833 00000100:00100000:1.0:1788986422.942011:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49300:x1875885971314048:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986422.942144:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49300:x1875885971314048:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 134us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986422.942152:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 833 00000100:00100000:0.0:1788986422.944442:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986422.944538:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971314176 00000100:00100000:2.0:1788986422.944547:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971314176 00000100:00100000:2.0:1788986422.944597:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 451 00000100:00100000:2.0:1788986422.944605:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49300:x1875885971314176:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986422.944953:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49300:x1875885971314176:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 347us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986422.944961:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 451 00000100:00100000:3.0:1788986422.947624:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986422.947717:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971314304 00000100:00100000:0.0:1788986422.947726:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971314304 00000100:00100000:0.0:1788986422.947779:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 452 00000100:00100000:0.0:1788986422.947790:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49300:x1875885971314304:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986422.948240:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49300:x1875885971314304:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 452us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986422.948247:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 452 00000100:00100000:3.0:1788986422.956318:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986422.956488:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971314432 00000100:00100000:1.0:1788986422.956499:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971314432 00000100:00100000:1.0:1788986422.956559:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 834 00000100:00100000:1.0:1788986422.956568:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49300:x1875885971314432:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986422.956996:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49300:x1875885971314432:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 427us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986422.957004:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 834 00000100:00100000:3.0:1788986423.054410:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986423.054637:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971314560 00000100:00100000:2.0:1788986423.054647:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971314560 00000100:00100000:2.0:1788986423.054792:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 835 00000100:00100000:2.0:1788986423.054804:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49304:x1875885971314560:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788986423.054824:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986423.054842:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548db8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d125e expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.054897:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548dbf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.054915:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548dbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.054925:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548dbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.054952:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548dc6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.054959:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.054966:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055200:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548dcd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055208:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548dcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055216:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548dcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986423.055239:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:2.0:1788986423.055242:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986423.055258:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548dcd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055269:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548dbf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055279:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548dbf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055285:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548dbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055290:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986423.055295:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548dbf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055302:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548dbf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055314:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:2.0:1788986423.055317:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986423.055321:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548dbf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055327:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548dbf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055338:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548dc6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055344:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548dc6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055349:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055354:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986423.055357:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548dc6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055363:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548dc6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055370:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a45aca900) 00010000:00010000:2.0:1788986423.055372:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986423.055375:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548dc6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055381:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548dc6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055408:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548db8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d125e expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055420:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548dcd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d125e expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.055427:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:2.0:1788986423.055429:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986423.055431:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788986423.055490:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49304:x1875885971314560:12345-192.168.206.21@tcp:101:dd.0 Request processed in 689us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986423.055497:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 835 00000100:00100000:0.0:1788986423.062436:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986423.074230:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971314816 00000100:00100000:1.0:1788986423.074247:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971314816 00000100:00100000:2.0:1788986423.074378:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 836 00000100:00100000:2.0:1788986423.074391:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49304:x1875885971314816:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788986423.074414:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986423.074436:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548dd4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1265 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.075790:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548ddb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.075812:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548ddb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.075825:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548ddb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.075841:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548de2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.075848:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548de2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.075855:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548de2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986423.076459:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1b:0x0], index 0: 0 00010000:00010000:2.0:1788986423.077437:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548de9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.077456:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548de9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.077467:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548de9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.077507:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548ddb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.077519:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548ddb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.077526:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548ddb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.077532:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986423.077536:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548ddb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.077544:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548ddb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.077555:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:2.0:1788986423.077558:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986423.077562:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548ddb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.077569:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf548ddb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986423.077583:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006e8e953a reply state 0000000047b9e479 transno 4294967613 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548de2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986423.077718:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986423.077754:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548dd4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1265 expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.077771:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548de9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1265 expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.077784:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:2.0:1788986423.077787:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986423.077790:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788986423.077874:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+15:49304:x1875885971314816:12345-192.168.206.21@tcp:101:dd.0 Request processed in 3485us (15445us total) trans 4294967613 rc 0/0 00000100:00100000:2.0:1788986423.077882:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 836 00010000:00010000:1.0:1788986423.081550:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548de2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986423.081565:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548de2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986423.081572:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548de2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986423.081578:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986423.081583:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548de2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986423.081601:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548de2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986423.081617:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a45aca700) 00010000:00010000:1.0:1788986423.081620:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986423.081624:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548de2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986423.081630:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548de2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986423.083786:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986423.083865:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971314944 00000100:00100000:2.0:1788986423.083874:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971314944 00000100:00100000:2.0:1788986423.083929:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 453 00000100:00100000:2.0:1788986423.083940:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49304:x1875885971314944:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788986423.083958:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986423.083978:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf548df7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d126c expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788986423.084004:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788986423.084024:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=2206s v=(0 0) 00010000:00010000:2.0:1788986423.084030:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986423.084038:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf548df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d126c expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.084055:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf548df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d126c expref: 6 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986423.084079:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986423.084164:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f430e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49304:x1875885971314944:12345-192.168.206.21@tcp:101:dd.0 Request processed in 225us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986423.084171:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 453 00000100:00100000:0.0:1788986423.111499:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986423.111602:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971315072 00000100:00100000:1.0:1788986423.111611:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971315072 00002000:00100000:1.0:1788986423.111659:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff9b0a797f8700 x1875885971315072/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:344/0 lens 488/0 e 0 to 0 dl 1788986434 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788986423.111671:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a797f8700 with x1875885971315072 ext(0->1048575) 00002000:00010000:1.0:1788986423.111676:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0a797f8700 00000100:00100000:1.0:1788986423.111707:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:1.0:1788986423.111717:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971315072:12345-192.168.206.21@tcp:4:dd.0 00000100:00100000:2.0:1788986423.150054:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971315072:12345-192.168.206.21@tcp:4:dd.0 Request processed in 38325us (38550us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788986423.150080:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00002000:00100000:2.0:1788986423.150109:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x1b:0x0] (0->1048575) req@ffff9b0a797f8700 x1875885971315072/t4294967350(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:344/0 lens 488/448 e 0 to 0 dl 1788986434 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788986423.150120:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a797f8700 with x1875885971315072 ext(0->1048575) 00002000:00010000:2.0:1788986423.150127:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0a797f8700 00000100:00100000:3.0:1788986423.154589:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986423.154702:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971315200 00000100:00100000:0.0:1788986423.154712:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971315200 00000100:00100000:0.0:1788986423.154781:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 837 00000100:00100000:0.0:1788986423.154793:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+14:49304:x1875885971315200:12345-192.168.206.21@tcp:44:dd.0 00000100:00100000:0.0:1788986423.215053:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+14:49304:x1875885971315200:12345-192.168.206.21@tcp:44:dd.0 Request processed in 60253us (60464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986423.215075:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 837 00000004:00080000:0.0:1788986423.216860:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 70 committed 00000001:00080000:0.0:1788986423.216890:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967612 is committed 00000004:00080000:0.0:1788986423.216903:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 69 committed 00000001:00080000:0.0:1788986423.216916:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967613 is committed 00000100:00100000:3.0:1788986423.217135:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993529728:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788986423.217191:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986423.218594:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993529728 00000100:00100000:0.0:1788986423.218604:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993529728 00000100:00100000:0.0:1788986423.218664:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:0.0:1788986423.218672:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993529728:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788986423.218704:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:26 count 1 00010000:00010000:0.0:1788986423.218727:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986423.218747:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf548d80 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1250 expref: 5 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986423.218756:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788986423.218761:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986423.218765:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986423.218792:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf548d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1250 expref: 5 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986423.218806:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf548d80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1250 expref: 5 pid: 6698 timeout: 2307 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986423.218819:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875885993529856:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986423.218885:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788986423.223073:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986423.224256:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971315328 00000100:00100000:3.0:1788986423.224269:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971315328 00000100:00100000:3.0:1788986423.224329:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 455 00000100:00100000:3.0:1788986423.224340:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971315328:12345-192.168.206.21@tcp:16:dd.0 00000100:00100000:3.0:1788986423.233139:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875885993529856:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788986423.233171:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.233237:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986423.235241:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986423.235402:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971315456 00000100:00100000:3.0:1788986423.235410:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971315456 00010000:00010000:3.0:1788986423.235554:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf548d80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1250 expref: 6 pid: 6698 timeout: 2307 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986423.235608:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 392 00000100:00100000:3.0:1788986423.235618:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971315456:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986423.235633:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986423.235638:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf548d80 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1250 expref: 6 pid: 6698 timeout: 2307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.235651:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf548d80 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1250 expref: 6 pid: 6698 timeout: 2307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.235672:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf548d80 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1250 expref: 6 pid: 6698 timeout: 2307 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.235686:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986423.235691:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986423.235696:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.235706:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.235732:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986423.235777:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971315456:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 160us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986423.235783:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 392 00010000:00010000:3.0:1788986423.235877:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.235887:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.235897:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.235905:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.235921:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788986423.236509:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993529728:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17836us (19316us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788986423.236519:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00010000:00010000:3.0:1788986423.236545:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986423.236551:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.236560:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986423.236565:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.236576:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.236590:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.236597:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf548dfe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986423.236613:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986423.236615:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986423.236616:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986423.236659:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0942cc3480/2, rc 0, transno 4294967349 00000100:00100000:3.0:1788986423.236666:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993529728:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1788986423.236970:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986423.261399:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971315328:12345-192.168.206.21@tcp:16:dd.0 Request processed in 37051us (38336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986423.261412:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 455 00000001:00080000:1.0:1788986423.262712:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967350 is committed 00000001:00080000:1.0:1788986423.262728:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967349 is committed 00000100:00100000:1.0:1788986423.264568:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986423.264649:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971315712 00000100:00100000:3.0:1788986423.264658:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971315712 00000100:00100000:3.0:1788986423.264716:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 84 00000100:00100000:3.0:1788986423.264729:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49304:x1875885971315712:12345-192.168.206.21@tcp:35:dd.0 00000100:00100000:3.0:1788986423.265238:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:49304:x1875885971315712:12345-192.168.206.21@tcp:35:dd.0 Request processed in 512us (676us total) trans 4294967614 rc 0/0 00000100:00100000:3.0:1788986423.265247:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 84 00010000:00010000:0.0:1788986424.257477:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986424.433620:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986424.433653:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986424.433683:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986424.433708:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986424.433738:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971316224 00000100:00100000:3.0:1788986424.433747:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971316224 00000100:00100000:3.0:1788986424.433797:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971316096 00000100:00100000:3.0:1788986424.433800:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971316096 00000100:00100000:3.0:1788986424.433832:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1135 00000100:00100000:3.0:1788986424.433841:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971316224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986424.433904:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971316224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 63us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986424.433911:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1135 00000100:00100000:3.0:1788986424.433928:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1136 00000100:00100000:3.0:1788986424.433935:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971316096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986424.433959:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971316096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986424.433965:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1136 00000100:00100000:3.0:1788986424.433982:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971315840 00000100:00100000:3.0:1788986424.433986:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971315840 00000100:00100000:3.0:1788986424.434010:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1243 00000100:00100000:3.0:1788986424.434015:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971315840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986424.434039:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971315840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986424.434045:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1243 00000100:00080000:3.0:1788986424.434107:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986424.434153:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971315968 00000100:00100000:1.0:1788986424.434158:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971315968 00000100:00100000:1.0:1788986424.434205:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1557 00000100:00100000:1.0:1788986424.434212:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:2349:x1875885971315968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:3.0:1788986424.434217:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986424.434270:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:2349:x1875885971315968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 59us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986424.434277:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1557 00000001:00080000:0.0:1788986424.605063:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967614 is committed 00010000:00010000:3.0:1788986425.280310:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788986425.813110:0:84300:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2209715997013ns, next at 2205209844263ns, rc = 0 00000004:00080000:0.0:1788986425.813221:0:84300:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2209716131529ns, next at 2207690574679ns, rc = 0 00000004:00080000:2.0:1788986425.816257:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 71 committed 00000004:00080000:2.0:1788986425.816285:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 69 committed 00010000:00010000:0.0:1788986426.306228:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986426.369159:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986426.369183:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993529984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986426.369250:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986426.369386:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993529984 00000100:00100000:1.0:1788986426.369395:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993529984 00000100:00100000:1.0:1788986426.369475:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1788986426.369484:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993529984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986426.369518:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788986426.369569:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993529984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986426.369576:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 790 00000100:00100000:1.0:1788986426.369624:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:1.0:1788986426.369635:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7fb33800, transno 4294967349 00000100:00100000:1.0:1788986426.369653:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993529984:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986426.371843:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1788986426.965627:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967349 is committed 00000100:00100000:3.0:1788986427.192934:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986427.193016:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971316352 00000100:00100000:1.0:1788986427.193033:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971316352 00000100:00100000:1.0:1788986427.193126:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 838 00000100:00100000:1.0:1788986427.193136:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49497:x1875885971316352:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986427.193225:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49497:x1875885971316352:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 90us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986427.193232:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 838 00000100:00080000:3.0:1788986427.193366:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986427.195445:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986427.195509:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971316480 00000100:00100000:1.0:1788986427.195517:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971316480 00000100:00100000:1.0:1788986427.195569:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 456 00000100:00100000:1.0:1788986427.195578:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49497:x1875885971316480:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986427.195899:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49497:x1875885971316480:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 320us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986427.195907:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 456 00000100:00080000:3.0:1788986427.196047:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986427.208502:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986427.208711:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971316608 00000100:00100000:3.0:1788986427.208721:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971316608 00000100:00100000:3.0:1788986427.208782:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 457 00000100:00100000:3.0:1788986427.208791:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49497:x1875885971316608:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986427.209130:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49497:x1875885971316608:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 339us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986427.209139:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 457 00000100:00080000:0.0:1788986427.210625:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986427.214858:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986427.216349:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971316736 00000100:00100000:3.0:1788986427.216362:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971316736 00000100:00100000:3.0:1788986427.216440:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 839 00000100:00100000:3.0:1788986427.216450:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49497:x1875885971316736:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986427.216867:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49497:x1875885971316736:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 417us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986427.216874:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 839 00000100:00100000:0.0:1788986427.226281:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986427.226613:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971316864 00000100:00100000:1.0:1788986427.226623:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971316864 00000100:00100000:1.0:1788986427.226677:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 840 00000100:00100000:1.0:1788986427.226688:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49497:x1875885971316864:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986427.226770:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49497:x1875885971316864:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 84us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986427.226777:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 840 00000100:00100000:3.0:1788986427.231932:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986427.240344:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971316992 00000100:00100000:1.0:1788986427.240360:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971316992 00000100:00100000:1.0:1788986427.241162:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 458 00000100:00100000:1.0:1788986427.241174:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49497:x1875885971316992:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986427.242033:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49497:x1875885971316992:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 858us (10106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986427.242054:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 458 00000100:00100000:0.0:1788986427.251194:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986427.251357:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971317120 00000100:00100000:3.0:1788986427.251366:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971317120 00000100:00100000:3.0:1788986427.254447:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 459 00000100:00100000:3.0:1788986427.254466:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49497:x1875885971317120:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986427.254809:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49497:x1875885971317120:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 349us (3622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986427.254817:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 459 00000100:00100000:1.0:1788986427.261810:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986427.261872:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971317248 00000100:00100000:3.0:1788986427.261882:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971317248 00000100:00100000:3.0:1788986427.261939:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 841 00000100:00100000:3.0:1788986427.261949:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49497:x1875885971317248:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986427.262943:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49497:x1875885971317248:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 991us (1137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986427.262953:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 841 00010000:00010000:3.0:1788986427.328490:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986427.369585:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986427.369685:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971317504 00000100:00100000:0.0:1788986427.369695:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971317504 00000100:00100000:0.0:1788986427.369757:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 842 00000100:00100000:0.0:1788986427.369768:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49501:x1875885971317504:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1788986427.369823:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986427.369850:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf548de9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x45:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1265 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.369869:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:0.0:1788986427.369879:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986427.369912:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548e05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.369926:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548e05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.369935:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548e05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.369953:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548e0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.369961:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548e0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.369968:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548e0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.370352:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548e13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.370362:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548e13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.370370:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548e13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788986427.371184:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].27, 64 off9920 00000004:00080000:0.0:1788986427.371196:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2211274106133ns, next at 2212274103621ns, rc = 0 00010000:00010000:0.0:1788986427.371296:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548e1a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371308:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548e1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371317:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548e1a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371326:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548e1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371336:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548e1a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371341:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548e1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371359:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788986427.371379:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548e13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371385:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548e13 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371391:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548e13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371396:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986427.371400:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548e13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371407:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548e13 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371417:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:0.0:1788986427.371420:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788986427.371425:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548e13 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371431:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548e13 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x45:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371446:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548e05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371452:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548e05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371457:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548e05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371461:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986427.371464:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548e05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371469:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548e05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371476:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:0.0:1788986427.371478:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986427.371481:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548e05 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986427.371486:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf548e05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986427.371496:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ef2464c4 reply state 000000001dac3a98 transno 4294967615 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548e0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986427.371504:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986427.371580:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:49501:x1875885971317504:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1811us (2000us total) trans 4294967615 rc 0/0 00000100:00100000:0.0:1788986427.371588:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 842 00010000:00010000:2.0:1788986427.373132:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986427.373144:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548e1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986427.373153:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986427.373158:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548e1a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986427.373168:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548e1a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986427.373187:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x45:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:2.0:1788986427.373190:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788986427.373195:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548e1a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986427.373201:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf548e1a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x45:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986427.373222:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986427.373224:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986427.373225:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986427.374704:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548e0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986427.374721:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548e0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986427.374728:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548e0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986427.374734:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986427.374739:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548e0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986427.374747:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548e0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986427.374760:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a4823b500) 00010000:00010000:2.0:1788986427.374763:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986427.374768:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548e0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986427.374775:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf548e0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986427.393122:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993530368:0@lo:400:kworker.0 00000100:00100000:3.0:1788986427.393189:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986427.393253:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788986427.393260:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993530240:0@lo:400:kworker.0 00000100:00100000:3.0:1788986427.393285:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986427.393305:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993530752:0@lo:400:kworker.0 00000100:00100000:3.0:1788986427.393350:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986427.393383:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993530368 00000100:00100000:3.0:1788986427.393402:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993530368 00000100:00100000:3.0:1788986427.393617:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993530240 00000100:00100000:3.0:1788986427.393622:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993530240 00000100:00100000:3.0:1788986427.393644:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:3.0:1788986427.393652:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993530368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986427.393701:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993530368:12345-0@lo:400:kworker.0 Request processed in 49us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986427.393708:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00100000:3.0:1788986427.393725:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:3.0:1788986427.393731:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993530240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986427.393758:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993530240:12345-0@lo:400:kworker.0 Request processed in 28us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986427.393764:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00080000:3.0:1788986427.393781:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986427.394355:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993530496:0@lo:400:kworker.0 00000100:00100000:0.0:1788986427.394400:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986427.394437:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788986427.394444:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993530112:0@lo:400:kworker.0 00000100:00100000:0.0:1788986427.394470:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986427.394491:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993530624:0@lo:400:kworker.0 00000100:00100000:0.0:1788986427.394519:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986427.394543:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993530112 00000100:00100000:0.0:1788986427.394548:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993530112 00000100:00100000:0.0:1788986427.394574:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1788986427.394581:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993530112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986427.394622:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993530112:12345-0@lo:400:kworker.0 Request processed in 41us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986427.394628:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00100000:0.0:1788986427.394662:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993530112:0@lo:400:kworker.0 00000100:00100000:2.0:1788986427.394841:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993530752 00000100:00100000:2.0:1788986427.394846:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993530752 00000100:00100000:2.0:1788986427.394885:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993530496 00000100:00100000:2.0:1788986427.394888:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993530496 00000100:00100000:2.0:1788986427.394908:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1788986427.394915:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993530752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986427.394954:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993530752:12345-0@lo:400:kworker.0 Request processed in 40us (1604us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986427.394961:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:2.0:1788986427.394974:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1788986427.394980:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993530496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986427.395014:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993530496:12345-0@lo:400:kworker.0 Request processed in 35us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986427.395020:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1138 00000100:00100000:2.0:1788986427.395058:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993530496:0@lo:400:kworker.0 00000100:00080000:0.0:1788986427.395213:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986427.395334:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993530624 00000100:00100000:1.0:1788986427.395339:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993530624 00000100:00100000:1.0:1788986427.395386:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:1.0:1788986427.395404:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993530624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986427.395444:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993530624:12345-0@lo:400:kworker.0 Request processed in 42us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986427.395450:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000100:00100000:1.0:1788986427.395477:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993530624:0@lo:400:kworker.0 00000100:00080000:0.0:1788986427.395660:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986427.396010:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993530240:0@lo:400:kworker.0 00000100:00100000:3.0:1788986427.396029:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967349 gen 2 00000004:00080000:3.0:1788986427.396044:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0942cc3480, transno 4294967349 00000100:00100000:3.0:1788986427.396478:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993530752:0@lo:400:kworker.0 00000100:00100000:3.0:1788986427.396497:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993530368:0@lo:400:kworker.0 00000100:00100000:2.0:1788986427.905380:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986427.905402:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993530880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986427.905468:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986427.905790:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993530880 00000100:00100000:1.0:1788986427.905799:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993530880 00000100:00100000:1.0:1788986427.905859:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 791 00000100:00100000:1.0:1788986427.905869:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993530880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986427.906438:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986427.906498:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993530880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 630us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986427.906506:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 791 00000100:00100000:0.0:1788986427.906626:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993530880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986428.352264:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986429.378299:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986429.556428:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986429.556541:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986429.556573:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986429.556601:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986429.556710:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971317632 00000100:00100000:1.0:1788986429.556724:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971317632 00000100:00100000:1.0:1788986429.556798:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1245 00000100:00100000:1.0:1788986429.556808:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971317632:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986429.556903:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971317632:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 96us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986429.556910:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1245 00000100:00100000:0.0:1788986429.557119:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971317760 00000100:00100000:0.0:1788986429.557123:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971317760 00000100:00100000:0.0:1788986429.557170:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1561 00000100:00100000:0.0:1788986429.557179:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971317760:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986429.557220:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971317760:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 43us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986429.557231:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1561 00000100:00100000:0.0:1788986429.557257:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971317888 00000100:00100000:0.0:1788986429.557261:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971317888 00000100:00100000:0.0:1788986429.557302:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971318016 00000100:00100000:0.0:1788986429.557305:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971318016 00000100:00100000:0.0:1788986429.557328:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1139 00000100:00100000:0.0:1788986429.557335:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971317888:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986429.557361:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971317888:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986429.557367:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1139 00000100:00100000:0.0:1788986429.557379:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1140 00000100:00100000:0.0:1788986429.557385:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971318016:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986429.557409:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971318016:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986429.557414:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1140 00000100:00080000:0.0:1788986429.558111:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986429.558118:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986429.558121:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788986429.575792:0:84448:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2213478698526ns, next at 2212274103621ns, rc = 0 00000004:00080000:2.0:1788986429.650461:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 71 committed 00000001:00080000:2.0:1788986429.650503:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967615 is committed 00000004:00080000:2.0:1788986429.650509:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 70 committed 00000100:00100000:2.0:1788986429.650960:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993531008:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788986429.651066:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986429.651367:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993531008 00000100:00100000:1.0:1788986429.651386:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993531008 00000100:00100000:1.0:1788986429.651466:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 460 00000100:00100000:1.0:1788986429.651477:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993531008:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1788986429.654678:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788986429.654891:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:27 count 1 00010000:00010000:1.0:1788986429.654931:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986429.654962:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf548df7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d126c expref: 5 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986429.654977:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1b:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1788986429.654982:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986429.654988:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986429.655050:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf548df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d126c expref: 5 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986429.655069:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf548df7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d126c expref: 5 pid: 6697 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986429.655113:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875885993531136:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986429.655222:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788986429.658200:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875885993531136:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788986429.658237:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986429.660688:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986429.663723:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971318144 00000100:00100000:1.0:1788986429.663742:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971318144 00010000:00010000:1.0:1788986429.664265:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf548df7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d126c expref: 6 pid: 6697 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986429.664440:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 393 00000100:00100000:1.0:1788986429.664457:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971318144:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986429.664480:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986429.664499:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf548df7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d126c expref: 6 pid: 6697 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986429.664516:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf548df7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d126c expref: 6 pid: 6697 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986429.664546:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf548df7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d126c expref: 6 pid: 6697 timeout: 2313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986429.664566:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986429.664571:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986429.664578:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986429.664590:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986429.664629:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986429.664709:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971318144:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 258us (4035us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986429.664718:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 393 00010000:00010000:0.0:1788986429.666654:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986429.666678:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986429.666697:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986429.666706:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986429.666748:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788986429.667969:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993531008:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16311us (16721us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1788986429.667987:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 460 00010000:00010000:2.0:1788986429.668146:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986429.668156:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986429.668167:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986429.668172:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986429.668183:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986429.668208:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986429.668217:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf548e21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986429.668246:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986429.668248:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986429.668250:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986429.668470:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0941d19180/2, rc 0, transno 4294967351 00000100:00100000:3.0:1788986429.668631:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993531008:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788986429.670656:0:84448:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2213573563368ns, next at 2207690574679ns, rc = 0 00000004:00080000:2.0:1788986429.678572:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 72 committed 00010000:00010000:0.0:1788986430.404696:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986431.424301:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986431.488624:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993531264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986431.488696:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986431.488914:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993531264 00000100:00100000:1.0:1788986431.488923:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993531264 00000100:00100000:1.0:1788986431.488998:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1788986431.489008:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993531264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986431.489055:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788986431.489126:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993531264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986431.489133:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 792 00000100:00100000:1.0:1788986431.489177:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993531264:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986431.489294:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986432.450447:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986432.512398:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993531392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.512509:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986432.512567:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993531904:0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.512606:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986432.512646:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788986432.512653:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993531520:0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.512678:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986432.512696:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993532032:0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.512725:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986432.512793:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993531648:0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.512830:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986432.512863:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986432.512872:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993531776:0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.513085:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986432.513159:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993531392 00000100:00100000:3.0:1788986432.513168:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993531392 00000100:00100000:3.0:1788986432.513235:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:3.0:1788986432.513248:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993531392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.513318:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993531904 00000100:00100000:3.0:1788986432.513322:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993531904 00000100:00100000:3.0:1788986432.513377:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993531520 00000100:00100000:3.0:1788986432.513382:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993531520 00000100:00100000:3.0:1788986432.513583:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993531648 00000100:00100000:3.0:1788986432.513588:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993531648 00000100:00100000:3.0:1788986432.513614:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:3.0:1788986432.513621:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993531904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.513678:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993531904:12345-0@lo:400:kworker.0 Request processed in 57us (1074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986432.513686:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:3.0:1788986432.513706:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:3.0:1788986432.513713:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993531520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.513745:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993531520:12345-0@lo:400:kworker.0 Request processed in 33us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986432.513752:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:3.0:1788986432.513774:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1788986432.513857:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993531648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.514750:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993531648:12345-0@lo:400:kworker.0 Request processed in 893us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986432.514760:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1788986432.514875:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993532032 00000100:00100000:3.0:1788986432.514953:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993532032 00000100:00100000:3.0:1788986432.515001:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993531776 00000100:00100000:3.0:1788986432.515004:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993531776 00000100:00100000:3.0:1788986432.515038:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1788986432.515264:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993532032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.515315:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993532032:12345-0@lo:400:kworker.0 Request processed in 270us (2589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986432.515323:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:3.0:1788986432.515338:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1142 00000100:00100000:3.0:1788986432.515345:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993531776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.515376:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993531776:12345-0@lo:400:kworker.0 Request processed in 32us (2291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986432.515382:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1142 00000100:00080000:3.0:1788986432.515411:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986432.515416:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986432.515468:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993531392:12345-0@lo:400:kworker.0 Request processed in 2223us (2960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986432.515537:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00100000:3.0:1788986432.515616:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993531776:0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.515632:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993531648:0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.515678:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993531520:0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.515693:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993532032:0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.515703:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993531392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986432.515722:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993531904:0@lo:400:kworker.0 00000001:00080000:1.0:1788986432.567213:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967351 is committed 00000100:00100000:2.0:1788986433.025320:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986433.029919:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993532160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986433.029996:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986433.031715:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993532160 00000100:00100000:3.0:1788986433.031726:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993532160 00000100:00100000:3.0:1788986433.031780:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 793 00000100:00100000:3.0:1788986433.031790:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993532160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986433.031826:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986433.031904:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993532160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (1907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986433.031912:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 793 00000100:00100000:1.0:1788986433.031997:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993532160:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986433.474335:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986434.496417:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986434.673687:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986434.673722:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986434.673756:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986434.674012:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986434.674057:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971318656 00000100:00100000:0.0:1788986434.674066:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971318656 00000100:00100000:0.0:1788986434.674143:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971318528 00000100:00100000:0.0:1788986434.674146:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971318528 00000100:00100000:0.0:1788986434.674170:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1143 00000100:00100000:0.0:1788986434.674179:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971318656:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986434.674243:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971318656:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986434.674251:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1143 00000100:00100000:0.0:1788986434.674267:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1144 00000100:00100000:0.0:1788986434.674274:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971318528:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986434.674450:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971318528:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 175us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986434.674458:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1144 00000100:00100000:0.0:1788986434.674594:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971318272 00000100:00100000:0.0:1788986434.674599:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971318272 00000100:00100000:0.0:1788986434.674623:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1247 00000100:00100000:0.0:1788986434.674630:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971318272:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986434.674658:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971318272:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986434.674665:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1247 00000100:00080000:0.0:1788986434.674693:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986434.674697:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986434.675365:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971318400 00000100:00100000:1.0:1788986434.675372:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971318400 00000100:00100000:1.0:1788986434.675419:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1565 00000100:00100000:1.0:1788986434.675427:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971318400:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986434.675477:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971318400:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 39us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986434.675490:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1565 00000100:00080000:1.0:1788986434.675521:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986435.521649:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986436.544725:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986436.608405:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993532288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986436.608484:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986436.608666:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993532288 00000100:00100000:1.0:1788986436.608674:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993532288 00000100:00100000:1.0:1788986436.608737:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1788986436.608746:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993532288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986436.608778:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986436.608828:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993532288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986436.608835:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 794 00000100:00100000:1.0:1788986436.608873:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967351 gen 2 00000004:00080000:1.0:1788986436.608879:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0941d19180, transno 4294967351 00000100:00100000:1.0:1788986436.608895:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993532288:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986436.609305:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986437.568300:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986437.632516:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993532544:0@lo:400:kworker.0 00000100:00100000:3.0:1788986437.632590:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986437.632642:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993533056:0@lo:400:kworker.0 00000100:00100000:1.0:1788986437.632755:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993532416:0@lo:400:kworker.0 00000100:00100000:2.0:1788986437.633382:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993532672:0@lo:400:kworker.0 00000100:00100000:0.0:1788986437.633602:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993532800:0@lo:400:kworker.0 00000100:00100000:1.0:1788986437.640356:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986437.640444:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993532928:0@lo:400:kworker.0 00000100:00100000:1.0:1788986437.640696:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986437.640749:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993532544 00000100:00100000:1.0:1788986437.640757:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993532544 00000100:00100000:1.0:1788986437.640795:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993532928 00000100:00100000:1.0:1788986437.640798:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993532928 00000100:00100000:1.0:1788986437.640830:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:1.0:1788986437.640838:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993532544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986437.640889:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993532544:12345-0@lo:400:kworker.0 Request processed in 52us (8299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986437.640896:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:1.0:1788986437.640913:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:1.0:1788986437.640918:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993532928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986437.640949:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993532928:12345-0@lo:400:kworker.0 Request processed in 31us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986437.640954:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00080000:1.0:1788986437.640971:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986437.641126:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986437.641242:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993532672 00000100:00100000:2.0:1788986437.641246:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993532672 00000100:00100000:1.0:1788986437.641265:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993532928:0@lo:400:kworker.0 00000100:00100000:2.0:1788986437.641275:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:2.0:1788986437.641281:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993532672:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788986437.641303:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986437.641318:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993532672:12345-0@lo:400:kworker.0 Request processed in 38us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986437.641323:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00000100:00100000:2.0:1788986437.641350:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993532672:0@lo:400:kworker.0 00000100:00100000:2.0:1788986437.641457:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993532416 00000100:00100000:2.0:1788986437.641461:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993532416 00000100:00100000:2.0:1788986437.641495:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:2.0:1788986437.641503:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993532416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986437.641830:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986437.641862:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993533056 00000100:00100000:3.0:1788986437.641865:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993533056 00000100:00100000:2.0:1788986437.642035:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993532416:12345-0@lo:400:kworker.0 Request processed in 532us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986437.642041:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986437.642043:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1788986437.642064:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993532800 00000100:00100000:0.0:1788986437.642067:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993532800 00000100:00100000:0.0:1788986437.642107:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1788986437.642110:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993532544:0@lo:400:kworker.0 00000100:00100000:0.0:1788986437.642115:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993532800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986437.642148:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993532800:12345-0@lo:400:kworker.0 Request processed in 35us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986437.642157:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1788986437.642185:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993532800:0@lo:400:kworker.0 00000100:00100000:0.0:1788986437.642258:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993532416:0@lo:400:kworker.0 00000100:00100000:3.0:1788986437.644057:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1146 00000100:00100000:3.0:1788986437.644072:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993533056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986437.644162:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993533056:12345-0@lo:400:kworker.0 Request processed in 95us (2332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986437.644169:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1146 00000100:00100000:2.0:1788986437.644255:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993533056:0@lo:400:kworker.0 00000100:00080000:2.0:1788986437.644289:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986438.144524:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993533184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986438.144611:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986438.144765:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993533184 00000100:00100000:3.0:1788986438.144773:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993533184 00000100:00100000:3.0:1788986438.144823:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 795 00000100:00100000:3.0:1788986438.144833:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993533184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986438.144863:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986438.144914:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993533184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986438.144921:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 795 00000100:00100000:0.0:1788986438.145051:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993533184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986438.593809:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986439.618997:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986439.795484:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986439.795531:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986439.795565:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986439.795599:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986439.795629:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971319040 00000100:00100000:3.0:1788986439.795637:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971319040 00000100:00100000:3.0:1788986439.795689:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971319168 00000100:00100000:3.0:1788986439.795692:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971319168 00000100:00100000:3.0:1788986439.795714:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1147 00000100:00100000:3.0:1788986439.795725:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971319040:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986439.795791:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971319040:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986439.795799:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1147 00000100:00100000:3.0:1788986439.795817:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1148 00000100:00100000:3.0:1788986439.795824:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971319168:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986439.795849:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971319168:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986439.795855:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1148 00000100:00100000:2.0:1788986439.796030:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971318912 00000100:00100000:2.0:1788986439.796035:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971318912 00000100:00100000:2.0:1788986439.796072:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1569 00000100:00100000:2.0:1788986439.796080:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971318912:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986439.796161:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971318912:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 82us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986439.796168:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1569 00000100:00080000:2.0:1788986439.796185:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986439.796189:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986439.796191:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986439.796559:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971318784 00000100:00100000:1.0:1788986439.796564:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971318784 00000100:00100000:1.0:1788986439.796601:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1249 00000100:00100000:1.0:1788986439.796609:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971318784:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986439.796646:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971318784:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (1171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986439.796652:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1249 00010000:00010000:0.0:1788986440.640443:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986441.664360:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986441.728320:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986441.728344:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993533312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986441.728447:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986441.728584:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993533312 00000100:00100000:3.0:1788986441.728608:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993533312 00000100:00100000:3.0:1788986441.728673:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 796 00000100:00100000:3.0:1788986441.728683:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993533312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986441.728714:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986441.728758:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993533312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986441.728765:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 796 00000100:00080000:2.0:1788986441.728837:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986441.728873:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993533312:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986442.688300:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986442.753555:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993533824:0@lo:400:kworker.0 00000100:00100000:1.0:1788986442.753629:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986442.753685:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986442.753692:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993533696:0@lo:400:kworker.0 00000100:00100000:1.0:1788986442.753718:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986442.753753:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993533696 00000100:00100000:1.0:1788986442.753761:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993533696 00000100:00100000:3.0:1788986442.753781:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993533824 00000100:00100000:3.0:1788986442.753787:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993533824 00000100:00100000:1.0:1788986442.753816:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:3.0:1788986442.753825:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1788986442.753829:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993533696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986442.753838:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993533824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986442.753996:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993533440:0@lo:400:kworker.0 00000100:00100000:2.0:1788986442.754141:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993533568:0@lo:400:kworker.0 00000100:00100000:3.0:1788986442.756641:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993533824:12345-0@lo:400:kworker.0 Request processed in 2799us (3004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986442.756654:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00080000:3.0:1788986442.757016:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986442.757239:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993533696:12345-0@lo:400:kworker.0 Request processed in 3412us (3517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986442.757250:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00100000:3.0:1788986442.757823:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993533696:0@lo:400:kworker.0 00000100:00100000:3.0:1788986442.757836:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993533824:0@lo:400:kworker.0 00000100:00100000:2.0:1788986442.762442:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986442.762443:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986442.762594:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993534080:0@lo:400:kworker.0 00000100:00100000:2.0:1788986442.762705:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986442.762817:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993534080 00000100:00100000:1.0:1788986442.762825:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993534080 00000100:00100000:1.0:1788986442.762881:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1150 00000100:00100000:1.0:1788986442.762890:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993534080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986442.762940:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993534080:12345-0@lo:400:kworker.0 Request processed in 51us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986442.762947:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1150 00000100:00080000:1.0:1788986442.763113:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986442.763482:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993533952:0@lo:400:kworker.0 00000100:00100000:2.0:1788986442.763514:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993534080:0@lo:400:kworker.0 00000100:00100000:0.0:1788986442.763521:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986442.763725:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993533568 00000100:00100000:1.0:1788986442.763731:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993533568 00000100:00100000:3.0:1788986442.763759:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993533440 00000100:00100000:1.0:1788986442.763771:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993533952 00000100:00100000:3.0:1788986442.763778:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993533440 00000100:00100000:1.0:1788986442.763778:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993533952 00000100:00100000:3.0:1788986442.763821:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:3.0:1788986442.763832:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993533440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986442.763838:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:1.0:1788986442.763849:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993533568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986442.763885:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993533440:12345-0@lo:400:kworker.0 Request processed in 55us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986442.763893:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:1.0:1788986442.763905:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993533568:12345-0@lo:400:kworker.0 Request processed in 57us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986442.763914:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:3.0:1788986442.763937:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:3.0:1788986442.763948:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993533952:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788986442.763970:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986442.764008:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993533952:12345-0@lo:400:kworker.0 Request processed in 63us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986442.764016:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:2.0:1788986442.764077:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993533568:0@lo:400:kworker.0 00000100:00100000:0.0:1788986442.764402:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993533440:0@lo:400:kworker.0 00000100:00100000:0.0:1788986442.764414:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993533952:0@lo:400:kworker.0 00000100:00100000:3.0:1788986443.264274:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993534208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986443.264347:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986443.264473:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993534208 00000100:00100000:1.0:1788986443.264481:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993534208 00000100:00100000:1.0:1788986443.264526:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 797 00000100:00100000:1.0:1788986443.264533:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993534208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986443.264564:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986443.266345:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993534208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1804us (1990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986443.266358:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 797 00000100:00100000:3.0:1788986443.266553:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993534208:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986443.713072:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986444.736960:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986444.912875:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986444.912909:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986444.912938:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986444.912975:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986444.913001:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971319552 00000100:00100000:3.0:1788986444.913009:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971319552 00000100:00100000:1.0:1788986444.913032:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971319680 00000100:00100000:1.0:1788986444.913039:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971319680 00000100:00100000:3.0:1788986444.913066:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1151 00000100:00100000:3.0:1788986444.913077:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971319552:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986444.913085:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1152 00000100:00100000:1.0:1788986444.913129:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971319680:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986444.913215:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971319296 00000100:00100000:0.0:1788986444.913220:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971319296 00000100:00100000:2.0:1788986444.913224:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971319424 00000100:00100000:2.0:1788986444.913231:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971319424 00000100:00100000:0.0:1788986444.913265:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1251 00000100:00100000:0.0:1788986444.913275:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971319296:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986444.913279:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1573 00000100:00100000:2.0:1788986444.913292:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971319424:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986444.913347:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971319552:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 101us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986444.913355:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1151 00000100:00100000:1.0:1788986444.914029:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971319680:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 899us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986444.914038:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1152 00000100:00080000:1.0:1788986444.914068:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986444.914073:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986444.914075:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986444.915234:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971319424:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1938us (2288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986444.915245:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1573 00000100:00100000:0.0:1788986444.916331:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971319296:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1958us (2364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986444.916343:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1251 00010000:00010000:2.0:1788986445.761405:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986446.784333:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986446.848458:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993534336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986446.848525:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986446.848798:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993534336 00000100:00100000:1.0:1788986446.848807:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993534336 00000100:00100000:1.0:1788986446.848880:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 798 00000100:00100000:1.0:1788986446.848891:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993534336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986446.848922:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788986446.849042:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986446.849150:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993534336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 260us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986446.849158:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 798 00000100:00100000:0.0:1788986446.851292:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993534336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986447.349167:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986447.357061:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971319808 00000100:00100000:1.0:1788986447.357076:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971319808 00000100:00100000:1.0:1788986447.357375:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 843 00000100:00100000:1.0:1788986447.357384:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49759:x1875885971319808:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986447.357483:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49759:x1875885971319808:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 99us (8324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986447.357491:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 843 00000100:00080000:2.0:1788986447.357538:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986447.366716:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986447.368711:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971319936 00000100:00100000:3.0:1788986447.368730:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971319936 00000100:00100000:3.0:1788986447.368818:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 461 00000100:00100000:3.0:1788986447.368829:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49759:x1875885971319936:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986447.369252:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49759:x1875885971319936:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 425us (2546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986447.369260:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 461 00000100:00080000:2.0:1788986447.370331:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986447.376687:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986447.376789:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971320064 00000100:00100000:1.0:1788986447.376798:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971320064 00000100:00080000:2.0:1788986447.376872:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986447.376874:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 462 00000100:00100000:1.0:1788986447.376887:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49759:x1875885971320064:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986447.377744:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49759:x1875885971320064:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 856us (1061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986447.377753:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 462 00000100:00100000:3.0:1788986447.396444:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986447.401545:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971320192 00000100:00100000:2.0:1788986447.401563:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971320192 00000100:00100000:2.0:1788986447.401648:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 844 00000100:00100000:2.0:1788986447.401659:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49759:x1875885971320192:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986447.402214:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49759:x1875885971320192:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 555us (5778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986447.402223:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 844 00000100:00100000:0.0:1788986447.408740:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986447.408920:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971320320 00000100:00100000:2.0:1788986447.408945:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971320320 00000100:00100000:2.0:1788986447.409006:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 845 00000100:00100000:2.0:1788986447.409017:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49759:x1875885971320320:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986447.409135:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49759:x1875885971320320:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 120us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986447.409143:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 845 00000100:00100000:0.0:1788986447.412887:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986447.412978:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971320448 00000100:00100000:3.0:1788986447.412987:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971320448 00000100:00100000:3.0:1788986447.413183:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 463 00000100:00100000:3.0:1788986447.413193:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49759:x1875885971320448:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986447.413539:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49759:x1875885971320448:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 347us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986447.413546:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 463 00000100:00100000:0.0:1788986447.418425:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986447.419945:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971320576 00000100:00100000:3.0:1788986447.419959:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971320576 00000100:00100000:3.0:1788986447.421206:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 464 00000100:00100000:3.0:1788986447.421223:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49759:x1875885971320576:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986447.423679:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49759:x1875885971320576:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 2451us (5252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986447.423692:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 464 00000100:00100000:0.0:1788986447.435415:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986447.442436:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971320704 00000100:00100000:3.0:1788986447.442450:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971320704 00000100:00100000:2.0:1788986447.442668:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 846 00000100:00100000:2.0:1788986447.442678:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49759:x1875885971320704:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986447.443347:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49759:x1875885971320704:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 668us (7939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986447.443356:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 846 00010000:00010000:2.0:1788986447.815813:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986447.878252:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993534848:0@lo:400:kworker.0 00000100:00100000:1.0:1788986447.878321:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986447.878370:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986447.878376:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993534720:0@lo:400:kworker.0 00000100:00100000:1.0:1788986447.878417:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986447.878446:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993534848 00000100:00100000:1.0:1788986447.878452:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993534848 00000100:00100000:1.0:1788986447.878491:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1788986447.878498:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993534848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986447.878543:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993534848:12345-0@lo:400:kworker.0 Request processed in 46us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986447.878550:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00000100:00100000:1.0:1788986447.878573:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993534720 00000100:00100000:1.0:1788986447.878576:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993534720 00000100:00100000:1.0:1788986447.878610:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:1.0:1788986447.878616:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993534720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986447.878645:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993534720:12345-0@lo:400:kworker.0 Request processed in 29us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986447.878651:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00100000:1.0:1788986447.878684:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993534720:0@lo:400:kworker.0 00000100:00100000:1.0:1788986447.878692:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993534848:0@lo:400:kworker.0 00000100:00080000:1.0:1788986447.878710:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986447.879190:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993534592:0@lo:400:kworker.0 00000100:00100000:2.0:1788986447.879226:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986447.879268:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993535104:0@lo:400:kworker.0 00000100:00100000:2.0:1788986447.879294:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986447.879314:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788986447.879320:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993534464:0@lo:400:kworker.0 00000100:00100000:2.0:1788986447.879345:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986447.879365:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993534976:0@lo:400:kworker.0 00000100:00100000:1.0:1788986447.879471:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993534592 00000100:00100000:1.0:1788986447.879476:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993534592 00000100:00100000:1.0:1788986447.879502:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:1.0:1788986447.879508:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993534592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986447.879540:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993534592:12345-0@lo:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986447.879545:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00100000:1.0:1788986447.879561:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993534464 00000100:00100000:1.0:1788986447.879564:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993534464 00000100:00100000:1.0:1788986447.879581:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1788986447.879586:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993534464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986447.879609:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993534464:12345-0@lo:400:kworker.0 Request processed in 23us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986447.879614:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:2.0:1788986447.879659:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986447.879687:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993534592:0@lo:400:kworker.0 00000100:00100000:2.0:1788986447.879700:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993534464:0@lo:400:kworker.0 00000100:00100000:2.0:1788986447.879716:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993535104 00000100:00100000:2.0:1788986447.879719:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993535104 00000100:00100000:2.0:1788986447.879785:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1788986447.879791:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a76788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993535104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986447.879822:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a76788850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993535104:12345-0@lo:400:kworker.0 Request processed in 32us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986447.879828:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1154 00000100:00100000:2.0:1788986447.879989:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993535104:0@lo:400:kworker.0 00000100:00100000:3.0:1788986447.884318:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993534976 00000100:00100000:3.0:1788986447.884331:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993534976 00000100:00100000:3.0:1788986447.886402:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576 00000100:00100000:3.0:1788986447.886415:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993534976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986447.886502:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993534976:12345-0@lo:400:kworker.0 Request processed in 89us (6841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986447.886509:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576 00000100:00100000:2.0:1788986447.886582:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993534976:0@lo:400:kworker.0 00000100:00080000:1.0:1788986447.887226:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986447.887310:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986448.385205:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993535232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986448.385270:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986448.385342:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993535232 00000100:00100000:3.0:1788986448.385350:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993535232 00000100:00100000:3.0:1788986448.385396:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 799 00000100:00100000:3.0:1788986448.385406:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993535232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986448.385439:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986448.385494:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993535232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986448.385500:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 799 00000100:00100000:3.0:1788986448.385546:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993535232:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986448.837553:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986449.072127:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986449.072229:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971320832 00000100:00100000:3.0:1788986449.072239:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971320832 00000100:00100000:3.0:1788986449.072314:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 847 00000100:00100000:3.0:1788986449.072325:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49773:x1875885971320832:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986449.072344:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986449.072362:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548e28 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1273 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788986449.072504:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986449.072857:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548e2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.072872:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.072885:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986449.072930:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:3.0:1788986449.072934:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986449.072954:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548e2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.072980:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548e28 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1273 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.072996:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548e2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1273 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.073005:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:3.0:1788986449.073008:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986449.073011:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788986449.073074:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49773:x1875885971320832:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 751us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986449.073081:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 847 00000100:00100000:0.0:1788986449.084854:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986449.084941:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971321088 00000100:00100000:1.0:1788986449.084951:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971321088 00000100:00100000:1.0:1788986449.085003:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 848 00000100:00100000:1.0:1788986449.085013:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49773:x1875885971321088:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986449.085065:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986449.085115:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548e2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1273 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.085134:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548dcd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d125e expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.085144:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:1.0:1788986449.085153:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986449.085177:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.085189:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.085199:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986449.155787:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000821837a7 reply state 00000000bc6dd0e0 transno 4294967616 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986449.155805:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986449.155820:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000100:00100000:1.0:1788986449.155940:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49773:x1875885971321088:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 70925us (71091us total) trans 4294967616 rc 0/0 00000100:00100000:1.0:1788986449.155950:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 848 00000001:00080000:2.0:1788986449.156055:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967616 is committed 00010000:00010000:1.0:1788986449.156179:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.156188:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.156195:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.156202:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986449.156206:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.156214:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.156229:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316500) 00010000:00010000:1.0:1788986449.156232:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986449.156237:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.156244:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986449.225248:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986449.226143:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971321216 00000100:00100000:1.0:1788986449.226154:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971321216 00000100:00100000:1.0:1788986449.226215:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 849 00000100:00100000:1.0:1788986449.226225:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49777:x1875885971321216:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:1.0:1788986449.226249:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986449.226270:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d127a expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226328:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548e44 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226342:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548e44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226353:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548e44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226366:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e4b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226372:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226378:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226653:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548e52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226661:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226668:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986449.226687:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:1.0:1788986449.226690:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986449.226705:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548e52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226716:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548e44 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226722:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548e44 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226729:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548e44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226735:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986449.226739:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548e44 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226745:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548e44 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226755:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:1.0:1788986449.226757:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986449.226762:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548e44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226767:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548e44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226779:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e4b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226785:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e4b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226791:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226796:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986449.226799:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e4b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226804:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e4b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226810:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a45316500) 00010000:00010000:1.0:1788986449.226812:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986449.226815:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e4b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226820:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e4b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226844:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d127a expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226855:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548e52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d127a expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.226862:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:1.0:1788986449.226864:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986449.226866:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788986449.226926:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49777:x1875885971321216:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 691us (1675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986449.226934:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 849 00000100:00100000:0.0:1788986449.230298:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986449.230384:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971321472 00000100:00100000:3.0:1788986449.230402:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971321472 00000100:00100000:3.0:1788986449.230631:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 850 00000100:00100000:3.0:1788986449.230641:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49777:x1875885971321472:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:3.0:1788986449.230660:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986449.230679:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548e59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1281 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.230932:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548e60 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.230947:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548e60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.230958:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548e60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.230973:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548e67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.230980:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548e67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.230988:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548e67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986449.232280:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1b:0x0], index 1: 0 00010000:00010000:2.0:1788986449.232723:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548e6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.232738:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.232750:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548e6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.232784:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548e60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.232791:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548e60 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.232798:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548e60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.232805:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986449.232809:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548e60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.232821:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548e60 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.232832:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:2.0:1788986449.232835:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986449.232840:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548e60 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.232846:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548e60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986449.232858:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009dc54573 reply state 0000000089b4b9eb transno 4294967617 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548e67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986449.232867:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986449.232897:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548e59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1281 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.232911:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548e6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1281 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.232931:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9b0a45aca200) 00010000:00010000:2.0:1788986449.232934:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986449.232936:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986449.233053:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49777:x1875885971321472:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 2412us (2763us total) trans 4294967617 rc 0/0 00000100:00100000:2.0:1788986449.233062:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 850 00010000:00010000:1.0:1788986449.242456:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548e67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.242474:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548e67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.242482:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548e67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.242488:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986449.242493:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548e67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.242500:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548e67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.242515:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a55745c00) 00010000:00010000:1.0:1788986449.242518:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986449.242522:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548e67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.242527:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf548e67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986449.252392:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986449.252523:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971321728 00000100:00100000:1.0:1788986449.252532:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971321728 00000100:00100000:1.0:1788986449.252589:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 851 00000100:00100000:1.0:1788986449.252600:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:49777:x1875885971321728:12345-192.168.206.21@tcp:36:touch.60003 00010000:00010000:1.0:1788986449.252657:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986449.252680:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548e6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1281 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.252705:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9b0a45aca200) 00010000:00010000:1.0:1788986449.252715:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986449.252753:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.252765:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.252773:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986449.252889:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008e954e6a reply state 00000000b1f807be transno 4294967618 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986449.252898:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986449.253001:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49777:x1875885971321728:12345-192.168.206.21@tcp:36:touch.60003 Request processed in 402us (622us total) trans 4294967618 rc 0/0 00000100:00100000:1.0:1788986449.253008:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 851 00010000:00010000:2.0:1788986449.263176:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.263194:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.263201:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.263207:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986449.263212:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.263219:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.263234:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9b0a45316500) 00010000:00010000:2.0:1788986449.263237:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986449.263242:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.263248:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548e7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986449.266060:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986449.266242:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971321856 00000100:00100000:0.0:1788986449.266251:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971321856 00000100:00100000:0.0:1788986449.266305:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 852 00000100:00100000:0.0:1788986449.266315:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:49777:x1875885971321856:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788986449.266337:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986449.266358:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548e83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1288 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986449.266431:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548e83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1288 expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986449.266446:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548e83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x46:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1288 expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986449.266464:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986449.266468:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788986449.266471:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee000, rc 0) 00000100:00100000:0.0:1788986449.266562:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49777:x1875885971321856:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 248us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986449.266568:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 852 00000100:00100000:0.0:1788986449.271615:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986449.275914:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971321984 00000100:00100000:1.0:1788986449.275938:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971321984 00000100:00100000:1.0:1788986449.276077:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 465 00000100:00080000:0.0:1788986449.276220:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986449.276262:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971321984:12345-192.168.206.21@tcp:2:touch.60003 00000100:00100000:1.0:1788986449.276737:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971321984:12345-192.168.206.21@tcp:2:touch.60003 Request processed in 649us (5130us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1788986449.276745:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 465 00000100:00100000:2.0:1788986449.287298:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986449.288533:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971322240 00000100:00100000:1.0:1788986449.288545:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971322240 00000100:00100000:0.0:1788986449.291694:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:0.0:1788986449.291708:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49777:x1875885971322240:12345-192.168.206.21@tcp:35:touch.60003 00000100:00100000:0.0:1788986449.292055:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49777:x1875885971322240:12345-192.168.206.21@tcp:35:touch.60003 Request processed in 349us (4764us total) trans 4294967619 rc 0/0 00000100:00100000:0.0:1788986449.292062:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 85 00000100:00100000:2.0:1788986449.387357:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986449.387453:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971322368 00000100:00100000:1.0:1788986449.387463:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971322368 00000100:00100000:1.0:1788986449.387520:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 853 00000100:00100000:1.0:1788986449.387531:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49781:x1875885971322368:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:1.0:1788986449.387553:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986449.387572:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548e8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d128f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387633:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548e91 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387647:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548e91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387657:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548e91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387670:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548e98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387677:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387683:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387765:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387774:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387785:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986449.387817:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x46:0x0]: returning size 0 00000004:00200000:1.0:1788986449.387821:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986449.387838:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387848:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387855:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548e91 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387862:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548e91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387869:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548e91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387875:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986449.387878:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548e91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387886:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548e91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387897:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:1.0:1788986449.387900:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986449.387905:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548e91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387926:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548e91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387941:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548e98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387947:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548e98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387952:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387957:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986449.387960:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548e98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387965:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548e98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387973:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a45316b00) 00010000:00010000:1.0:1788986449.387975:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986449.387978:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548e98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.387984:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548e98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.388011:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf548e8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d128f expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.388024:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d128f expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986449.388033:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:1.0:1788986449.388035:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986449.388038:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788986449.388727:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49781:x1875885971322368:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 1194us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986449.388735:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 853 00000100:00100000:1.0:1788986449.391845:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986449.395602:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971322496 00000100:00100000:3.0:1788986449.395615:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971322496 00000100:00100000:3.0:1788986449.395667:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 466 00000100:00100000:3.0:1788986449.395678:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971322496:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:3.0:1788986449.395702:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986449.395720:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf548ea6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1296 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788986449.395745:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x6aa1c450, atime: 0x6aa1c450, ctime: 0x6aa1c450, blocks: 0x1 00010000:00010000:3.0:1788986449.395766:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=2233s v=(0 0) 00010000:00010000:3.0:1788986449.395770:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986449.395779:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf548ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1296 expref: 7 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.395798:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf548ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1296 expref: 7 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.395809:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2c00, rc 0) 00000100:00100000:3.0:1788986449.395878:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971322496:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 203us (4040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986449.395885:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 466 00000100:00100000:0.0:1788986449.400463:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986449.400630:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971322752 00000100:00100000:3.0:1788986449.400639:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971322752 00000100:00100000:3.0:1788986449.400694:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 854 00000100:00100000:3.0:1788986449.400705:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49781:x1875885971322752:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:3.0:1788986449.400759:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986449.400785:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf548e9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x46:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d128f expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.400807:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf548e83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x46:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1288 expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.400818:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:3.0:1788986449.400828:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986449.400849:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548ead lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.400861:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548ead lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.400870:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548ead lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.400884:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548eb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.400889:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.400895:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.400996:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548ebb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.401003:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548ebb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.401010:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548ebb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986449.402054:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].27, 64 off9920 00000004:00080000:2.0:1788986449.402065:0:7899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2233304975698ns, next at 2234304973034ns, rc = 0 00010000:00010000:2.0:1788986449.402166:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548ec2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402177:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402190:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548ec2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402198:0:7899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548ec2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402204:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548ec2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402211:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548ec2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402232:0:7899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986449.402253:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548ebb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402259:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548ebb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402265:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548ebb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402270:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986449.402274:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548ebb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402280:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548ebb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402289:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:2.0:1788986449.402292:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986449.402297:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548ebb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402303:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf548ebb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x46:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402319:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548ead lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402325:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548ead lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402331:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548ead lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402336:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986449.402339:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548ead lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402345:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548ead lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402352:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:2.0:1788986449.402355:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986449.402358:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548ead lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986449.402363:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf548ead lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986449.402373:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000005ec48312 reply state 00000000baf91b49 transno 4294967620 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986449.402400:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986449.402492:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49781:x1875885971322752:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 1787us (2036us total) trans 4294967620 rc 0/0 00000100:00100000:2.0:1788986449.402500:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 854 00010000:00010000:3.0:1788986449.403635:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986449.403644:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548ec2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.403652:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986449.403655:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548ec2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.403663:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548ec2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.403675:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x46:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:3.0:1788986449.403677:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986449.403681:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548ec2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.403687:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548ec2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x46:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.403710:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986449.403712:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986449.403713:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986449.407907:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548eb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.407940:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548eb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.407950:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548eb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.407957:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986449.407963:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548eb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.407972:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548eb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.407991:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a55745500) 00010000:00010000:3.0:1788986449.407995:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986449.408000:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548eb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986449.408008:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548eb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986449.862253:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986450.042253:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986450.042289:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986450.042315:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986450.042337:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986450.042365:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971323008 00000100:00100000:1.0:1788986450.042374:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971323008 00000100:00100000:1.0:1788986450.042430:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1577 00000100:00100000:1.0:1788986450.042440:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:2347:x1875885971323008:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986450.042517:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:2347:x1875885971323008:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986450.042525:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1577 00000100:00100000:1.0:1788986450.042551:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971323264 00000100:00100000:1.0:1788986450.042554:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971323264 00000100:00100000:1.0:1788986450.042577:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971323136 00000100:00100000:1.0:1788986450.042579:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971323136 00000100:00100000:1.0:1788986450.042605:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1155 00000100:00100000:1.0:1788986450.042612:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971323264:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986450.042639:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971323264:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986450.042646:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1155 00000100:00100000:1.0:1788986450.042674:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1156 00000100:00100000:1.0:1788986450.042680:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971323136:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986450.042703:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971323136:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986450.042709:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1156 00000100:00100000:2.0:1788986450.042882:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971322880 00000100:00100000:2.0:1788986450.042887:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971322880 00000100:00100000:2.0:1788986450.042929:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1253 00000100:00100000:2.0:1788986450.042936:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971322880:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986450.042967:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971322880:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986450.042973:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1253 00000100:00080000:2.0:1788986450.043183:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986450.527419:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986450.527527:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971323392 00000100:00100000:1.0:1788986450.527536:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971323392 00000100:00100000:1.0:1788986450.527591:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 855 00000100:00100000:1.0:1788986450.527601:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49800:x1875885971323392:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986450.527620:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986450.527666:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ec9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d129d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.527743:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ed0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.527757:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.527771:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986450.527816:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:1.0:1788986450.527820:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986450.527849:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ed0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.527880:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ec9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d129d expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.527898:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ed0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d129d expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.527907:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:1.0:1788986450.527921:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986450.527925:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986450.527985:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49800:x1875885971323392:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 385us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986450.527993:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 855 00000100:00100000:0.0:1788986450.544765:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986450.545512:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971323648 00000100:00100000:2.0:1788986450.545523:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971323648 00000100:00100000:2.0:1788986450.545572:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 856 00000100:00100000:2.0:1788986450.545583:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49800:x1875885971323648:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986450.545635:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986450.545661:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf548ed0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d129d expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986450.545682:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548e52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d127a expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986450.545694:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:2.0:1788986450.545705:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986450.545728:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548ed7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986450.545740:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986450.545749:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986450.591165:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e01465a0 reply state 00000000c9781608 transno 4294967621 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986450.591182:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788986450.591197:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000100:00100000:0.0:1788986450.591292:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:49800:x1875885971323648:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 45708us (46532us total) trans 4294967621 rc 0/0 00000100:00100000:0.0:1788986450.591301:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 856 00000001:00080000:2.0:1788986450.591506:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967619 is committed 00000001:00080000:2.0:1788986450.591536:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967621 is committed 00000004:00080000:2.0:1788986450.591542:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 73 committed 00000100:00100000:2.0:1788986450.591657:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993535360:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788986450.591709:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986450.591775:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993535360 00000100:00100000:2.0:1788986450.591796:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993535360 00000100:00100000:2.0:1788986450.591841:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 467 00000100:00100000:2.0:1788986450.591850:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993535360:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788986450.591872:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:27 count 1 00010000:00010000:2.0:1788986450.591892:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986450.591921:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf548ea6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1296 expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986450.591931:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788986450.591935:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986450.591939:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986450.591965:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf548ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1296 expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986450.591978:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf548ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1296 expref: 6 pid: 8478 timeout: 2334 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986450.591989:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875885993535488:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986450.592026:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7feff600 going to sleep for 11 seconds 00000100:00080000:2.0:1788986450.592038:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788986450.592677:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548ed7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986450.592686:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548ed7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986450.592694:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548ed7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986450.592700:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986450.592705:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548ed7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986450.592714:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548ed7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986450.592734:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:3.0:1788986450.592738:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986450.592742:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548ed7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986450.592749:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf548ed7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986450.595790:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875885993535488:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788986450.595820:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986450.597708:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986450.597895:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971323776 00000100:00100000:1.0:1788986450.597904:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971323776 00010000:00010000:1.0:1788986450.597954:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf548ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1296 expref: 7 pid: 8478 timeout: 2334 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986450.598028:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 394 00000100:00100000:1.0:1788986450.598038:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971323776:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986450.598053:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986450.598059:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf548ea6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1296 expref: 7 pid: 8478 timeout: 2334 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.598071:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf548ea6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1296 expref: 7 pid: 8478 timeout: 2334 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.598122:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf548ea6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1296 expref: 7 pid: 8478 timeout: 2334 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.598138:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986450.598142:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986450.598147:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.598156:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.598309:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986450.598366:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971323776:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 329us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986450.598374:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 394 00010000:00010000:2.0:1788986450.599005:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986450.599017:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986450.599027:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986450.599035:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986450.599120:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788986450.599740:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993535360:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7889us (8028us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1788986450.599749:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 467 00010000:00010000:3.0:1788986450.600048:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986450.600057:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986450.600067:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986450.600072:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986450.600082:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986450.600129:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986450.600136:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e991b5a/0xc20d828fcf548ede lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986450.600156:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986450.600158:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986450.600160:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788986450.600959:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7f5f1c00/2, rc 0, transno 4294967351 00000100:00100000:0.0:1788986450.600969:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993535360:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788986450.670887:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986450.671280:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971323904 00000100:00100000:1.0:1788986450.671290:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971323904 00000100:00100000:1.0:1788986450.671352:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 857 00000100:00100000:1.0:1788986450.671362:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49804:x1875885971323904:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:1.0:1788986450.671395:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986450.671414:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548ee5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12a4 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.671475:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548eec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.671492:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548eec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.671502:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548eec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.671516:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ef3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.671522:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.671528:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.671819:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548efa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.671830:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548efa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.671838:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548efa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986450.671882:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:1.0:1788986450.671887:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986450.672306:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548efa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672320:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548eec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672332:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548eec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672338:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548eec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672343:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986450.672347:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548eec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672354:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548eec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672365:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:1.0:1788986450.672368:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986450.672373:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548eec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672388:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf548eec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672402:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ef3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672407:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ef3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672413:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672419:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986450.672422:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ef3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672428:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ef3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672435:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a45316b00) 00010000:00010000:1.0:1788986450.672437:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986450.672440:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ef3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672445:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf548ef3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672477:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf548ee5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12a4 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672490:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548efa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12a4 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986450.672498:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316a00) 00010000:00010000:1.0:1788986450.672500:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986450.672502:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788986450.672603:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49804:x1875885971323904:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 1241us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986450.672611:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 857 00010000:00010000:1.0:1788986450.887132:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986451.618219:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986451.618290:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971324032 00000100:00100000:2.0:1788986451.618299:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971324032 00000100:00100000:2.0:1788986451.618365:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 858 00000100:00100000:2.0:1788986451.618385:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49823:x1875885971324032:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:2.0:1788986451.618404:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986451.618423:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548f01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12ab expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.618480:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548f08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.618493:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548f08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.618507:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548f08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986451.618541:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:2.0:1788986451.618545:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986451.618565:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548f08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.618590:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548f01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12ab expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.618609:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548f08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12ab expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.618617:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316a00) 00010000:00010000:2.0:1788986451.618620:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986451.618624:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1000, rc 0) 00000100:00100000:2.0:1788986451.618680:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49823:x1875885971324032:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 306us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986451.618687:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 858 00000100:00080000:3.0:1788986451.619144:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986451.622833:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986451.623130:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971324288 00000100:00100000:3.0:1788986451.623140:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971324288 00000100:00100000:3.0:1788986451.623194:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 859 00000100:00100000:3.0:1788986451.623205:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49823:x1875885971324288:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986451.623259:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986451.623284:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf548f08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12ab expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.623305:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf548efa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12a4 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.623316:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a45316a00) 00010000:00010000:3.0:1788986451.623327:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986451.623350:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f0f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.623362:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.623371:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986451.623684:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000045aefe42 reply state 000000007462bfa9 transno 4294967622 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986451.623693:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986451.623701:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000100:00100000:3.0:1788986451.623777:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49823:x1875885971324288:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 573us (952us total) trans 4294967622 rc 0/0 00000100:00100000:3.0:1788986451.623784:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 859 00010000:00010000:3.0:1788986451.631710:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f0f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.631726:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f0f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.631733:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.631739:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986451.631743:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f0f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.631750:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f0f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.631763:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a55745b00) 00010000:00010000:3.0:1788986451.631766:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986451.631771:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f0f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.631787:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f0f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986451.763669:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986451.763736:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971324416 00000100:00100000:1.0:1788986451.763745:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971324416 00000100:00100000:1.0:1788986451.763795:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 860 00000100:00100000:1.0:1788986451.763805:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49835:x1875885971324416:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986451.763897:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49835:x1875885971324416:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 92us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986451.763913:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 860 00000100:00100000:0.0:1788986451.766308:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986451.766631:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971324544 00000100:00100000:2.0:1788986451.766640:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971324544 00000100:00100000:2.0:1788986451.766699:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 468 00000100:00100000:2.0:1788986451.766709:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49835:x1875885971324544:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986451.767067:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49835:x1875885971324544:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 359us (766us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986451.767075:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 468 00000100:00100000:3.0:1788986451.770645:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986451.770970:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971324672 00000100:00100000:2.0:1788986451.770978:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971324672 00000100:00100000:2.0:1788986451.771046:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 469 00000100:00100000:2.0:1788986451.771056:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49835:x1875885971324672:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986451.771806:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49835:x1875885971324672:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 748us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986451.771820:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 469 00000100:00080000:3.0:1788986451.773117:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986451.779060:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986451.779200:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971324800 00000100:00100000:1.0:1788986451.779209:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971324800 00000100:00100000:1.0:1788986451.779263:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 861 00000100:00100000:1.0:1788986451.779274:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49835:x1875885971324800:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986451.779720:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49835:x1875885971324800:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 447us (681us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986451.779729:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 861 00000100:00100000:0.0:1788986451.791291:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986451.791551:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971324928 00000100:00100000:2.0:1788986451.791561:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971324928 00000100:00100000:2.0:1788986451.791614:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 862 00000100:00100000:2.0:1788986451.791622:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49835:x1875885971324928:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986451.791858:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49835:x1875885971324928:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 235us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986451.791865:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 862 00000100:00100000:2.0:1788986451.795133:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986451.795721:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971325056 00000100:00100000:0.0:1788986451.795730:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971325056 00000100:00100000:0.0:1788986451.795873:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 470 00000100:00100000:0.0:1788986451.795884:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49835:x1875885971325056:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986451.796254:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49835:x1875885971325056:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 371us (1127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986451.796261:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 470 00000100:00100000:3.0:1788986451.803330:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986451.803424:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971325184 00000100:00100000:2.0:1788986451.803434:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971325184 00000100:00100000:2.0:1788986451.803487:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 471 00000100:00100000:2.0:1788986451.803495:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49835:x1875885971325184:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986451.803808:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49835:x1875885971325184:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 312us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986451.803814:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 471 00000100:00100000:1.0:1788986451.808368:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986451.808470:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971325312 00000100:00100000:2.0:1788986451.808479:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971325312 00000100:00100000:2.0:1788986451.808537:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 863 00000100:00100000:2.0:1788986451.808547:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49835:x1875885971325312:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986451.808952:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49835:x1875885971325312:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 406us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986451.808959:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 863 00000100:00100000:3.0:1788986451.874171:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986451.874308:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971325440 00000100:00100000:0.0:1788986451.874318:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971325440 00000100:00100000:0.0:1788986451.874385:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 864 00000100:00100000:0.0:1788986451.874396:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:49839:x1875885971325440:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:0.0:1788986451.874415:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986451.874435:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548f16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12b2 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874495:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548f1d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874509:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548f1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874520:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548f1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874533:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548f24 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874540:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548f24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874547:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548f24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874851:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548f2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874861:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874868:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986451.874890:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:0.0:1788986451.874894:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986451.874924:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548f2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874935:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548f1d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874953:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548f1d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874961:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548f1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874967:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986451.874972:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548f1d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874986:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548f1d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.874998:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:0.0:1788986451.875001:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986451.875006:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548f1d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.875012:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf548f1d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.875023:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548f24 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.875030:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548f24 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.875035:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548f24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.875040:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986451.875043:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548f24 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.875049:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548f24 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.875055:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986451.875058:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986451.875060:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548f24 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.875066:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548f24 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.875151:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf548f16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12b2 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.875166:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548f2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12b2 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986451.875173:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986451.875175:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986451.875177:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef200, rc 0) 00000100:00100000:0.0:1788986451.875233:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49839:x1875885971325440:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 839us (1071us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986451.875240:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 864 00000100:00100000:3.0:1788986451.880198:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986451.880383:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971325696 00000100:00100000:2.0:1788986451.880392:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971325696 00000100:00100000:2.0:1788986451.880456:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 865 00000100:00100000:2.0:1788986451.880466:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49839:x1875885971325696:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:2.0:1788986451.880485:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986451.880504:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548f32 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12b9 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.880779:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548f39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.880806:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548f39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.880817:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548f39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.880873:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548f40 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.880881:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548f40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.880888:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548f40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986451.883942:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1c:0x0], index 0: 0 00010000:00010000:2.0:1788986451.884523:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548f47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.884539:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548f47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.884550:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548f47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.884587:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548f39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.884594:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548f39 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.884601:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548f39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.884608:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986451.884613:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548f39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.884621:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548f39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.884631:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:2.0:1788986451.884634:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986451.884639:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548f39 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.884644:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf548f39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986451.884657:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009010a3a1 reply state 000000009a22fa32 transno 4294967623 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548f40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986451.884665:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986451.884699:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf548f32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12b9 expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.884720:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548f47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12b9 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.884727:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986451.884729:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986451.884731:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0c00, rc 0) 00000100:00100000:2.0:1788986451.886179:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:49839:x1875885971325696:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 5617us (5891us total) trans 4294967623 rc 0/0 00000100:00100000:2.0:1788986451.886192:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 865 00010000:00010000:3.0:1788986451.889742:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548f40 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.889760:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548f40 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.889767:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548f40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.889774:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986451.889779:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548f40 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.889787:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548f40 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.889877:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a45aca900) 00010000:00010000:3.0:1788986451.889880:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986451.889886:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548f40 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986451.889893:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf548f40 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986451.901992:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986451.902135:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971325824 00000100:00100000:2.0:1788986451.902146:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971325824 00000100:00100000:2.0:1788986451.902194:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 472 00000100:00100000:2.0:1788986451.902204:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:49839:x1875885971325824:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:2.0:1788986451.902221:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986451.902241:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080be8d2f/0xc20d828fcf548f55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12c0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788986451.902266:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788986451.902287:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=2235s v=(0 0) 00010000:00010000:2.0:1788986451.902291:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986451.902301:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080be8d2f/0xc20d828fcf548f55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12c0 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.902318:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080be8d2f/0xc20d828fcf548f55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12c0 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986451.902336:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0800, rc 0) 00000100:00100000:2.0:1788986451.902398:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:49839:x1875885971325824:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 194us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986451.902405:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 472 00010000:00010000:3.0:1788986451.904199:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986451.925963:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986451.926074:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971325952 00000100:00100000:0.0:1788986451.926083:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971325952 00002000:00100000:0.0:1788986451.926161:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff9b0a80d38380 x1875885971325952/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:372/0 lens 488/0 e 0 to 0 dl 1788986462 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1788986451.926173:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a80d38380 with x1875885971325952 ext(0->1048575) 00002000:00010000:0.0:1788986451.926179:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0a80d38380 00000100:00100000:0.0:1788986451.926208:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:0.0:1788986451.926217:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971325952:12345-192.168.206.21@tcp:4:dd.60003 00000100:00100000:0.0:1788986451.945930:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971325952:12345-192.168.206.21@tcp:4:dd.60003 Request processed in 19704us (19966us total) trans 4294967352 rc 0/0 00000100:00100000:0.0:1788986451.945944:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00002000:00100000:0.0:1788986451.945956:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c:0x0] (0->1048575) req@ffff9b0a80d38380 x1875885971325952/t4294967352(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:372/0 lens 488/448 e 0 to 0 dl 1788986462 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1788986451.945975:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a80d38380 with x1875885971325952 ext(0->1048575) 00002000:00010000:0.0:1788986451.945981:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0a80d38380 00000100:00100000:2.0:1788986451.950475:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986451.950741:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971326080 00000100:00100000:1.0:1788986451.950753:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971326080 00000100:00100000:1.0:1788986451.953645:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 866 00000100:00100000:1.0:1788986451.953666:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49839:x1875885971326080:12345-192.168.206.21@tcp:44:dd.60003 00000100:00100000:0.0:1788986451.968411:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986451.968643:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993535616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986451.968705:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986451.968816:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993535616 00000100:00100000:3.0:1788986451.968824:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993535616 00000100:00080000:0.0:1788986451.968950:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986451.969125:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 800 00000100:00100000:3.0:1788986451.969135:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993535616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986451.969158:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986451.969212:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993535616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986451.969218:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 800 00000100:00100000:0.0:1788986451.969294:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993535616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986451.990179:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:49839:x1875885971326080:12345-192.168.206.21@tcp:44:dd.60003 Request processed in 36514us (39702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986451.990203:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 866 00000001:00080000:3.0:1788986451.990316:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967623 is committed 00000100:00100000:1.0:1788986451.994731:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986451.994806:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971326208 00000100:00100000:2.0:1788986451.994815:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971326208 00000100:00100000:2.0:1788986451.994870:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 473 00000100:00100000:2.0:1788986451.994880:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971326208:12345-192.168.206.21@tcp:16:dd.60003 00000100:00100000:3.0:1788986452.027898:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971326208:12345-192.168.206.21@tcp:16:dd.60003 Request processed in 33010us (33167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986452.027920:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 473 00000001:00080000:3.0:1788986452.027953:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967352 is committed 00000100:00100000:1.0:1788986452.034373:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986452.034465:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971326464 00000100:00100000:3.0:1788986452.034475:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971326464 00000100:00100000:3.0:1788986452.034540:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 86 00000100:00100000:3.0:1788986452.034550:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:49839:x1875885971326464:12345-192.168.206.21@tcp:35:dd.60003 00000100:00100000:3.0:1788986452.034992:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:49839:x1875885971326464:12345-192.168.206.21@tcp:35:dd.60003 Request processed in 442us (631us total) trans 4294967624 rc 0/0 00000100:00100000:3.0:1788986452.035000:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 86 00010000:00010000:0.0:1788986452.929872:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986452.992387:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993535744:0@lo:400:kworker.0 00000100:00100000:1.0:1788986452.992472:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993536128:0@lo:400:kworker.0 00000100:00100000:3.0:1788986452.992488:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986452.992589:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993535872:0@lo:400:kworker.0 00000100:00100000:0.0:1788986452.992695:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993536000:0@lo:400:kworker.0 00000100:00100000:2.0:1788986452.993705:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986452.993782:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993536384:0@lo:400:kworker.0 00000100:00100000:2.0:1788986452.993817:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986452.993892:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993535872 00000100:00100000:2.0:1788986452.993924:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993535872 00000100:00100000:2.0:1788986452.993983:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1578 00000100:00100000:2.0:1788986452.993992:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993535872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986452.994059:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993535872:12345-0@lo:400:kworker.0 Request processed in 68us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986452.994066:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1578 00000100:00100000:2.0:1788986452.994128:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993536384 00000100:00100000:2.0:1788986452.994133:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993536384 00000100:00100000:2.0:1788986452.994173:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:2.0:1788986452.994179:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993536384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986452.994218:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993536384:12345-0@lo:400:kworker.0 Request processed in 38us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986452.994230:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:2.0:1788986452.994280:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993535872:0@lo:400:kworker.0 00000100:00100000:2.0:1788986452.994291:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993536384:0@lo:400:kworker.0 00000100:00100000:0.0:1788986452.994620:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788986452.994698:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986452.995006:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993536000 00000100:00100000:2.0:1788986452.995011:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993536000 00000100:00100000:2.0:1788986452.995051:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:2.0:1788986452.995059:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993536000:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788986452.995475:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986452.995531:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993535744 00000100:00100000:0.0:1788986452.995537:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993535744 00000100:00100000:0.0:1788986452.995570:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1254 00000100:00100000:0.0:1788986452.995578:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993535744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986452.995628:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993535744:12345-0@lo:400:kworker.0 Request processed in 50us (3141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986452.995635:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1254 00000100:00100000:2.0:1788986452.996279:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993536000:12345-0@lo:400:kworker.0 Request processed in 1218us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986452.996289:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00100000:2.0:1788986452.996753:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993536000:0@lo:400:kworker.0 00000100:00100000:1.0:1788986453.001724:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986453.001805:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993536128 00000100:00100000:1.0:1788986453.001821:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993536128 00000100:00100000:1.0:1788986453.001892:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1158 00000100:00100000:1.0:1788986453.001921:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993536128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986453.002008:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993536128:12345-0@lo:400:kworker.0 Request processed in 90us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986453.002015:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1158 00000100:00080000:1.0:1788986453.002050:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986453.002183:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993536128:0@lo:400:kworker.0 00000100:00100000:1.0:1788986453.002209:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986453.002222:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993536256:0@lo:400:kworker.0 00000100:00100000:1.0:1788986453.002269:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986453.003030:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993536256 00000100:00100000:0.0:1788986453.003043:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993536256 00000100:00100000:0.0:1788986453.003122:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580 00000100:00100000:0.0:1788986453.003133:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993536256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986453.003215:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993536256:12345-0@lo:400:kworker.0 Request processed in 85us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986453.003231:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580 00000100:00080000:0.0:1788986453.003317:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986453.003964:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993535744:0@lo:400:kworker.0 00000100:00100000:0.0:1788986453.005441:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993536256:0@lo:400:kworker.0 00000001:00080000:2.0:1788986453.048322:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967350 is committed 00000001:00080000:2.0:1788986453.048341:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967351 is committed 00000001:00080000:3.0:1788986453.229977:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967624 is committed 00000100:00100000:2.0:1788986453.504401:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993536512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986453.504466:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986453.504559:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993536512 00000100:00100000:1.0:1788986453.504568:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993536512 00000100:00100000:1.0:1788986453.504620:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 801 00000100:00100000:1.0:1788986453.504642:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993536512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986453.504677:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986453.504739:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993536512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986453.504746:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 801 00000100:00100000:2.0:1788986453.504781:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967351 gen 2 00000004:00080000:2.0:1788986453.504786:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7f5f1c00, transno 4294967351 00000100:00100000:2.0:1788986453.504810:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993536512:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986453.952817:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788986454.510193:0:84913:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2238413101174ns, next at 2212274103621ns, rc = 0 00000004:00080000:1.0:1788986454.510761:0:84913:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2238413669946ns, next at 2234304973034ns, rc = 0 00000004:00080000:0.0:1788986454.541711:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 74 committed 00000004:00080000:0.0:1788986454.541742:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 72 committed 00010000:00010000:0.0:1788986454.976394:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986455.154570:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986455.154648:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971326592 00000100:00100000:1.0:1788986455.154668:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971326592 00000100:00100000:1.0:1788986455.154718:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1255 00000100:00100000:1.0:1788986455.154727:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971326592:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986455.154791:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971326592:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986455.154797:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1255 00000100:00100000:3.0:1788986455.159692:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986455.159734:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986455.159760:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986455.159791:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971326720 00000100:00100000:3.0:1788986455.159800:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971326720 00000100:00100000:3.0:1788986455.159855:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1581 00000100:00100000:3.0:1788986455.159865:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971326720:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986455.159947:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971326720:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 83us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986455.159954:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1581 00000100:00100000:0.0:1788986455.160128:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971326848 00000100:00100000:0.0:1788986455.160133:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971326848 00000100:00100000:0.0:1788986455.160177:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971326976 00000100:00100000:0.0:1788986455.160180:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971326976 00000100:00100000:0.0:1788986455.160204:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1159 00000100:00100000:0.0:1788986455.160211:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971326848:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986455.160245:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971326848:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986455.160251:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1159 00000100:00100000:0.0:1788986455.160266:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1160 00000100:00100000:0.0:1788986455.160272:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971326976:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986455.160298:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971326976:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986455.160304:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1160 00000100:00080000:0.0:1788986455.160323:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986455.160326:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986455.160328:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986455.956353:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986455.956968:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971327104 00000100:00100000:3.0:1788986455.956978:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971327104 00000100:00100000:3.0:1788986455.957035:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 867 00000100:00100000:3.0:1788986455.957045:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50031:x1875885971327104:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986455.957299:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50031:x1875885971327104:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 255us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986455.957306:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 867 00000100:00100000:3.0:1788986455.960146:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986455.960296:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971327232 00000100:00100000:3.0:1788986455.960305:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971327232 00000100:00100000:3.0:1788986455.960349:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 474 00000100:00100000:3.0:1788986455.960360:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50031:x1875885971327232:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986455.960702:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50031:x1875885971327232:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 342us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986455.960710:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 474 00000100:00100000:3.0:1788986455.970374:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986455.970423:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971327360 00000100:00100000:0.0:1788986455.970434:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971327360 00000100:00100000:0.0:1788986455.970497:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 475 00000100:00100000:0.0:1788986455.970507:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50031:x1875885971327360:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986455.970935:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50031:x1875885971327360:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 428us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986455.970943:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 475 00000100:00100000:3.0:1788986455.983343:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986455.983502:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971327488 00000100:00100000:2.0:1788986455.983512:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971327488 00000100:00100000:2.0:1788986455.983599:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 868 00000100:00100000:2.0:1788986455.983610:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50031:x1875885971327488:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986455.984150:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50031:x1875885971327488:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 540us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986455.984233:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 868 00000100:00100000:1.0:1788986455.987420:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986455.987508:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971327616 00000100:00100000:0.0:1788986455.987517:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971327616 00000100:00100000:3.0:1788986455.990964:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 869 00000100:00100000:2.0:1788986455.991052:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50031:x1875885971327616:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986455.991182:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50031:x1875885971327616:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 206us (3771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986455.991191:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 869 00000100:00100000:0.0:1788986455.994745:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986455.994838:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971327744 00000100:00100000:3.0:1788986455.994848:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971327744 00000100:00100000:3.0:1788986455.994915:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 476 00000100:00100000:3.0:1788986455.994926:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50031:x1875885971327744:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986455.995681:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50031:x1875885971327744:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 753us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986455.995691:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 476 00000100:00100000:3.0:1788986455.997694:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986455.997787:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971327872 00000100:00100000:0.0:1788986455.997796:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971327872 00000100:00100000:0.0:1788986455.997847:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 477 00000100:00100000:0.0:1788986455.997856:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50031:x1875885971327872:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986455.998277:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50031:x1875885971327872:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 420us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986455.998285:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 477 00010000:00010000:2.0:1788986456.000549:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986456.007597:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986456.007695:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971328000 00000100:00100000:0.0:1788986456.007705:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971328000 00000100:00100000:0.0:1788986456.007804:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 870 00000100:00100000:0.0:1788986456.007814:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50031:x1875885971328000:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986456.008477:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50031:x1875885971328000:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 660us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986456.008487:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 870 00000100:00100000:1.0:1788986456.073358:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986456.073462:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971328256 00000100:00100000:2.0:1788986456.073472:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971328256 00000100:00100000:2.0:1788986456.073555:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 871 00000100:00100000:2.0:1788986456.073567:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50035:x1875885971328256:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:2.0:1788986456.073625:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986456.073723:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf548f47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x47:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12b9 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.073746:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986456.073765:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986456.073792:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548f5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.073811:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548f5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.073823:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548f5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.073838:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548f63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.073845:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.073852:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.075134:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548f6a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.075151:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548f6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.075161:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548f6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986456.076145:0:15241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].28, 64 off9984 00000004:00080000:2.0:1788986456.076158:0:15241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2239979068800ns, next at 2240979066038ns, rc = 0 00010000:00010000:2.0:1788986456.076256:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548f71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076268:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548f71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076282:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548f71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076288:0:15241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548f71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076294:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548f71 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076300:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548f71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076325:0:15241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986456.076348:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548f6a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076355:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548f6a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076361:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548f6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076367:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986456.076371:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548f6a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076378:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548f6a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076389:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986456.076392:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986456.076398:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548f6a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076404:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf548f6a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x47:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076422:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548f5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076428:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548f5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076434:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548f5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076439:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986456.076442:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548f5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076448:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548f5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076455:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:2.0:1788986456.076458:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986456.076461:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548f5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986456.076466:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf548f5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x42:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986456.076475:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000a2518c4e reply state 00000000fe834373 transno 4294967625 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986456.076489:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986456.076575:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:50035:x1875885971328256:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 3006us (3231us total) trans 4294967625 rc 0/0 00000100:00100000:2.0:1788986456.076583:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 871 00010000:00010000:0.0:1788986456.077641:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986456.077661:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548f71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986456.077668:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986456.077673:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548f71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986456.077681:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548f71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986456.077693:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x47:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:0.0:1788986456.077696:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788986456.077700:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548f71 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986456.077705:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf548f71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x47:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986456.077725:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986456.077727:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986456.077729:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986456.085512:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548f63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986456.085530:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548f63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986456.085538:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548f63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986456.085545:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986456.085549:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548f63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986456.085557:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548f63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986456.085572:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x1c2d2f2 (ffff9b0a45aca500) 00010000:00010000:3.0:1788986456.085576:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986456.085581:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548f63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986456.085588:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf548f63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x42:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986457.024384:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788986457.091390:0:6925:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2240994298529ns, next at 2241994296533ns, rc = 0 00000100:00100000:3.0:1788986457.092108:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993536640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986457.092172:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986457.092201:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993536640 00000100:00100000:0.0:1788986457.092208:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993536640 00000100:00100000:3.0:1788986457.093203:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1788986457.093214:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993536640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986457.093244:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788986457.093317:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993536640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986457.093323:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 802 00000100:00100000:3.0:1788986457.093372:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993536640:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986457.093511:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1788986457.864515:0:85058:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2241767423302ns, next at 2241994296533ns, rc = 0 00000004:00080000:2.0:1788986457.920679:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 74 committed 00000001:00080000:2.0:1788986457.920707:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967625 is committed 00000004:00080000:2.0:1788986457.920712:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 73 committed 00000004:00080000:2.0:1788986457.920717:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 75 committed 00000100:00100000:1.0:1788986457.920917:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986457.920937:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993536768:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788986457.921010:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986457.921170:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993536768 00000100:00100000:0.0:1788986457.921178:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993536768 00000100:00100000:0.0:1788986457.921247:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:0.0:1788986457.921257:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993536768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788986457.921284:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:28 count 1 00010000:00010000:0.0:1788986457.921307:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986457.921328:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000080be8d2f/0xc20d828fcf548f55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12c0 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986457.921347:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1c:0x0].0x0 since=6s v=(0 0) 00010000:00010000:0.0:1788986457.921353:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986457.921357:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986457.921388:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000080be8d2f/0xc20d828fcf548f55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12c0 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986457.921401:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000080be8d2f/0xc20d828fcf548f55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12c0 expref: 5 pid: 6695 timeout: 2341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986457.921413:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993536896:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986457.921469:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eaca80 going to sleep for 11 seconds 00000100:00100000:0.0:1788986457.926915:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993536896:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788986457.926946:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986457.933933:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986457.934613:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971328384 00000100:00100000:3.0:1788986457.934623:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971328384 00010000:00010000:3.0:1788986457.934679:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000080be8d2f/0xc20d828fcf548f55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12c0 expref: 6 pid: 6695 timeout: 2341 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986457.934719:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 395 00000100:00100000:3.0:1788986457.934729:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971328384:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986457.934753:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986457.934759:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000080be8d2f/0xc20d828fcf548f55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12c0 expref: 6 pid: 6695 timeout: 2341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986457.934773:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000080be8d2f/0xc20d828fcf548f55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12c0 expref: 6 pid: 6695 timeout: 2341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986457.934796:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080be8d2f/0xc20d828fcf548f55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12c0 expref: 6 pid: 6695 timeout: 2341 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986457.934812:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986457.934816:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986457.934822:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986457.934831:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986457.934865:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986457.934923:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971328384:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 195us (999us total) trans 0 rc 0/0 00010000:00010000:2.0:1788986457.934925:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986457.934935:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 395 00010000:00010000:2.0:1788986457.934953:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986457.934966:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986457.934974:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986457.935003:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:1.0:1788986457.935006:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986457.935782:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993536768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 14524us (14769us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788986457.935791:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000004:00080000:2.0:1788986457.936631:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0941d18a80/2, rc 0, transno 4294967353 00000100:00100000:2.0:1788986457.936654:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941d18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993536768:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788986457.936867:0:85058:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2241839776210ns, next at 2234304973034ns, rc = 0 00010000:00010000:3.0:1788986457.937892:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986457.937901:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986457.937914:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986457.937919:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986457.937933:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986457.937951:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986457.937959:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ccf01f0/0xc20d828fcf548f78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986457.937979:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986457.937981:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986457.937983:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986457.940689:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 75 committed 00010000:00010000:2.0:1788986458.052491:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986458.123014:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993537024:0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.123082:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986458.123161:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993537536:0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.123189:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986458.123216:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788986458.123223:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993537152:0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.123250:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986458.123268:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993537664:0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.123290:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986458.123320:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a457ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993537280:0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.123342:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986458.123361:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986458.123367:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a45109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993537408:0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.123387:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986458.123416:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993537024 00000100:00100000:2.0:1788986458.123424:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993537024 00000100:00100000:2.0:1788986458.123467:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1788986458.123475:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993537024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.123523:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993537024:12345-0@lo:400:kworker.0 Request processed in 48us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986458.123530:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:2.0:1788986458.123559:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993537536 00000100:00100000:2.0:1788986458.123564:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993537536 00000100:00100000:2.0:1788986458.123597:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993537152 00000100:00100000:2.0:1788986458.123600:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993537152 00000100:00100000:2.0:1788986458.123617:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993537280 00000100:00100000:2.0:1788986458.123619:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993537280 00000100:00100000:2.0:1788986458.123635:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1582 00000100:00100000:2.0:1788986458.123642:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993537536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.123675:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993537536:12345-0@lo:400:kworker.0 Request processed in 33us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986458.123681:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1582 00000100:00100000:2.0:1788986458.123694:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:2.0:1788986458.123700:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993537152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.123729:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993537152:12345-0@lo:400:kworker.0 Request processed in 30us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986458.123735:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00000100:00100000:2.0:1788986458.123746:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:2.0:1788986458.123752:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993537280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.123785:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993537280:12345-0@lo:400:kworker.0 Request processed in 32us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986458.123791:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000100:00100000:2.0:1788986458.123810:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993537664 00000100:00100000:2.0:1788986458.123813:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993537664 00000100:00100000:2.0:1788986458.123835:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993537408 00000100:00100000:2.0:1788986458.123838:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993537408 00000100:00100000:2.0:1788986458.123856:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1788986458.123863:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993537664:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788986458.126176:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986458.126183:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986458.126210:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1162 00000100:00100000:1.0:1788986458.126224:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993537408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986458.126294:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993537408:12345-0@lo:400:kworker.0 Request processed in 75us (2905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986458.126302:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1162 00000100:00100000:2.0:1788986458.127045:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094268f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993537664:12345-0@lo:400:kworker.0 Request processed in 45us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986458.127057:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1788986458.127129:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993537152:0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.127144:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993537664:0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.127157:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993537024:0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.127168:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993537536:0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.127208:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a45109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993537408:0@lo:400:kworker.0 00000100:00100000:2.0:1788986458.127218:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a457ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993537280:0@lo:400:kworker.0 00000100:00100000:1.0:1788986458.625327:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993537792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986458.625403:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986458.625490:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993537792 00000100:00100000:1.0:1788986458.625497:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993537792 00000100:00100000:1.0:1788986458.625724:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1788986458.625733:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993537792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986458.625765:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986458.625811:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993537792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986458.625818:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 803 00000100:00100000:1.0:1788986458.625859:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993537792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986459.072907:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986460.096712:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986460.272910:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986460.273184:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971328512 00000100:00100000:0.0:1788986460.273194:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971328512 00000100:00100000:0.0:1788986460.273249:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1257 00000100:00100000:0.0:1788986460.273258:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971328512:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986460.274436:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971328512:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1172us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986460.274449:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1257 00000100:00100000:3.0:1788986460.277120:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986460.277502:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971328640 00000100:00100000:1.0:1788986460.277511:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971328640 00000100:00100000:1.0:1788986460.277575:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1585 00000100:00100000:1.0:1788986460.277585:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971328640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986460.277649:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971328640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 66us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986460.277656:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1585 00000100:00100000:3.0:1788986460.278789:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986460.278868:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986460.278897:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971328768 00000100:00100000:3.0:1788986460.278903:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971328768 00000100:00100000:3.0:1788986460.278936:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971328896 00000100:00100000:3.0:1788986460.278939:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971328896 00000100:00100000:3.0:1788986460.278962:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1163 00000100:00100000:3.0:1788986460.278970:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971328768:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:0.0:1788986460.279145:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986460.279149:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986460.279152:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986460.279183:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1164 00000100:00100000:0.0:1788986460.279192:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971328896:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986460.279238:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971328896:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 47us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986460.279245:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1164 00000100:00100000:3.0:1788986460.280181:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80910000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971328768:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1207us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986460.280191:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1163 00010000:00010000:3.0:1788986461.120230:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986461.249887:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967353 is committed 00010000:00010000:2.0:1788986462.145476:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986462.210205:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993537920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986462.210267:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986462.210350:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993537920 00000100:00100000:2.0:1788986462.210359:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993537920 00000100:00100000:2.0:1788986462.212414:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1788986462.212428:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993537920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986462.212465:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986462.212549:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993537920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986462.212557:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 804 00000100:00100000:2.0:1788986462.212618:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000004:00080000:2.0:1788986462.212624:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0941d18a80, transno 4294967353 00000100:00100000:2.0:1788986462.212673:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993537920:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986462.214535:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986463.170455:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986463.232526:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993538048:0@lo:400:kworker.0 00000100:00100000:2.0:1788986463.232595:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986463.232649:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993538560:0@lo:400:kworker.0 00000100:00100000:2.0:1788986463.232675:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986463.232699:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788986463.232705:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993538176:0@lo:400:kworker.0 00000100:00100000:2.0:1788986463.232728:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986463.232743:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993538688:0@lo:400:kworker.0 00000100:00100000:2.0:1788986463.232764:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986463.232793:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993538432:0@lo:400:kworker.0 00000100:00100000:2.0:1788986463.232813:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986463.232832:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986463.232837:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993538304:0@lo:400:kworker.0 00000100:00100000:2.0:1788986463.232871:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986463.232898:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993538688 00000100:00100000:2.0:1788986463.232905:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993538688 00000100:00100000:2.0:1788986463.232949:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993538432 00000100:00100000:2.0:1788986463.232952:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993538432 00000100:00100000:2.0:1788986463.232972:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1788986463.232981:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993538688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986463.233043:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993538688:12345-0@lo:400:kworker.0 Request processed in 62us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986463.233049:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1165 00000100:00100000:2.0:1788986463.233066:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1166 00000100:00100000:2.0:1788986463.233072:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993538432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986463.233126:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993538432:12345-0@lo:400:kworker.0 Request processed in 54us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986463.233132:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1166 00000100:00100000:2.0:1788986463.233170:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993538432:0@lo:400:kworker.0 00000100:00100000:2.0:1788986463.233213:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993538688:0@lo:400:kworker.0 00000100:00100000:1.0:1788986463.233922:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993538048 00000100:00100000:1.0:1788986463.233928:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993538048 00000100:00100000:1.0:1788986463.233967:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1788986463.233975:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993538048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986463.234109:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993538048:12345-0@lo:400:kworker.0 Request processed in 134us (1513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986463.234116:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:1.0:1788986463.234146:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993538560 00000100:00100000:1.0:1788986463.234150:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993538560 00000100:00100000:1.0:1788986463.234177:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993538176 00000100:00100000:1.0:1788986463.234180:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993538176 00000100:00100000:1.0:1788986463.234194:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993538304 00000100:00100000:1.0:1788986463.234197:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993538304 00000100:00080000:0.0:1788986463.234314:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986463.234319:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986463.234332:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1586 00000100:00100000:0.0:1788986463.234340:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993538560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986463.234377:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993538560:12345-0@lo:400:kworker.0 Request processed in 39us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986463.234383:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1586 00000100:00100000:0.0:1788986463.234396:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:0.0:1788986463.234401:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993538176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986463.234427:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993538176:12345-0@lo:400:kworker.0 Request processed in 26us (1698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986463.234432:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00100000:1.0:1788986463.234581:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:1.0:1788986463.234588:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993538304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986463.234626:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993538304:12345-0@lo:400:kworker.0 Request processed in 39us (1754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986463.234632:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00100000:1.0:1788986463.234669:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993538304:0@lo:400:kworker.0 00000100:00100000:2.0:1788986463.235767:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993538176:0@lo:400:kworker.0 00000100:00100000:2.0:1788986463.235782:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993538048:0@lo:400:kworker.0 00000100:00100000:2.0:1788986463.235793:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993538560:0@lo:400:kworker.0 00000100:00100000:3.0:1788986463.745060:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993538816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986463.745168:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986463.745353:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993538816 00000100:00100000:2.0:1788986463.745362:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993538816 00000100:00100000:2.0:1788986463.745413:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 805 00000100:00100000:2.0:1788986463.745422:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993538816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986463.745452:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986463.745509:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941d18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993538816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986463.745516:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 805 00000100:00100000:0.0:1788986463.745645:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993538816:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986464.192560:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986465.216270:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986465.392824:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986465.392880:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986465.392914:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986465.392946:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986465.393031:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971329408 00000100:00100000:2.0:1788986465.393041:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971329408 00000100:00100000:2.0:1788986465.393139:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971329280 00000100:00100000:2.0:1788986465.393143:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971329280 00000100:00100000:2.0:1788986465.393165:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1167 00000100:00100000:2.0:1788986465.393175:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971329408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986465.393246:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971329408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986465.393253:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1167 00000100:00100000:2.0:1788986465.393271:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1168 00000100:00100000:2.0:1788986465.393278:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971329280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986465.393303:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971329280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986465.393309:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1168 00000100:00100000:0.0:1788986465.393654:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971329152 00000100:00100000:0.0:1788986465.393660:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971329152 00000100:00100000:0.0:1788986465.393702:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1589 00000100:00100000:0.0:1788986465.393711:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971329152:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986465.393743:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971329152:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986465.393750:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1589 00000100:00080000:0.0:1788986465.393790:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986465.393795:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986465.393797:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986465.393875:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971329024 00000100:00100000:1.0:1788986465.393881:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971329024 00000100:00100000:1.0:1788986465.393916:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1259 00000100:00100000:1.0:1788986465.393923:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971329024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986465.393963:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971329024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986465.393970:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1259 00010000:00010000:2.0:1788986466.240537:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986467.264224:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986467.331674:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986467.331697:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993538944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986467.331761:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986467.331814:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993538944 00000100:00100000:2.0:1788986467.331831:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993538944 00000100:00100000:2.0:1788986467.331902:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 806 00000100:00100000:2.0:1788986467.331912:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993538944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986467.331944:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986467.331999:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993538944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986467.332006:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 806 00000100:00080000:0.0:1788986467.332061:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986467.332183:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993538944:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986468.288457:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986468.352969:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993539328:0@lo:400:kworker.0 00000100:00100000:0.0:1788986468.353046:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986468.353139:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986468.353147:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993539456:0@lo:400:kworker.0 00000100:00100000:0.0:1788986468.353175:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986468.353217:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993539328 00000100:00100000:0.0:1788986468.353226:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993539328 00000100:00100000:3.0:1788986468.353239:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993539200:0@lo:400:kworker.0 00000100:00100000:0.0:1788986468.353286:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:0.0:1788986468.353298:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993539328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986468.353337:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986468.353371:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993539328:12345-0@lo:400:kworker.0 Request processed in 74us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986468.353381:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00100000:3.0:1788986468.353398:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993539712:0@lo:400:kworker.0 00000100:00100000:3.0:1788986468.353431:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986468.353455:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788986468.353462:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993539072:0@lo:400:kworker.0 00000100:00100000:3.0:1788986468.353491:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986468.353524:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993539584:0@lo:400:kworker.0 00000100:00100000:3.0:1788986468.353558:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986468.353591:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993539072 00000100:00100000:3.0:1788986468.353598:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993539072 00000100:00100000:0.0:1788986468.353640:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993539200 00000100:00100000:0.0:1788986468.353648:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993539200 00000100:00100000:3.0:1788986468.353651:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1260 00000100:00100000:3.0:1788986468.353664:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993539072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986468.353686:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993539584 00000100:00100000:0.0:1788986468.353691:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993539584 00000100:00100000:3.0:1788986468.353726:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993539072:12345-0@lo:400:kworker.0 Request processed in 64us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986468.353727:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:3.0:1788986468.353752:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1260 00000100:00100000:0.0:1788986468.353752:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993539200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986468.353805:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:0.0:1788986468.353824:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993539200:12345-0@lo:400:kworker.0 Request processed in 71us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986468.353832:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993539584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986468.353841:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00080000:0.0:1788986468.353873:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986468.353886:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993539584:12345-0@lo:400:kworker.0 Request processed in 71us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986468.353896:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00100000:3.0:1788986468.353942:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993539072:0@lo:400:kworker.0 00000100:00100000:3.0:1788986468.353956:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993539584:0@lo:400:kworker.0 00000100:00100000:3.0:1788986468.353966:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993539200:0@lo:400:kworker.0 00000100:00100000:3.0:1788986468.354019:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993539328:0@lo:400:kworker.0 00000100:00100000:2.0:1788986468.354626:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993539456 00000100:00100000:2.0:1788986468.354633:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993539456 00000100:00100000:2.0:1788986468.354675:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993539712 00000100:00100000:2.0:1788986468.354679:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993539712 00000100:00100000:2.0:1788986468.354720:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1788986468.354728:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993539456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986468.354788:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7988ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993539456:12345-0@lo:400:kworker.0 Request processed in 60us (1611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986468.354794:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1169 00000100:00100000:2.0:1788986468.354809:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1788986468.354829:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993539712:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788986468.354877:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986468.354885:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993539712:12345-0@lo:400:kworker.0 Request processed in 56us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986468.354893:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1170 00000100:00100000:2.0:1788986468.354959:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993539712:0@lo:400:kworker.0 00000100:00100000:3.0:1788986468.354986:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f430e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993539456:0@lo:400:kworker.0 00000100:00100000:2.0:1788986468.864441:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986468.864469:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993539840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986468.864547:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986468.864761:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993539840 00000100:00100000:1.0:1788986468.864773:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993539840 00000100:00100000:1.0:1788986468.864859:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 807 00000100:00100000:1.0:1788986468.864871:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993539840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986468.864915:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986468.865344:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993539840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 474us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986468.865353:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 807 00000100:00100000:2.0:1788986468.865643:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993539840:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986469.312450:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986470.338038:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986470.512952:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986470.512995:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986470.513035:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986470.513067:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986470.513151:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971329664 00000100:00100000:2.0:1788986470.513161:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971329664 00000100:00100000:2.0:1788986470.513223:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1593 00000100:00100000:2.0:1788986470.513233:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971329664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986470.513322:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971329664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 90us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986470.513329:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1593 00000100:00100000:2.0:1788986470.513355:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971329792 00000100:00100000:2.0:1788986470.513358:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971329792 00000100:00100000:2.0:1788986470.513383:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971329920 00000100:00100000:2.0:1788986470.513385:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971329920 00000100:00100000:2.0:1788986470.513402:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1171 00000100:00100000:2.0:1788986470.513408:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971329792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986470.513433:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971329792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986470.513451:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1171 00000100:00100000:2.0:1788986470.513471:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1172 00000100:00100000:2.0:1788986470.513478:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971329920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986470.513503:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971329920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986470.513509:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1172 00000100:00100000:0.0:1788986470.514052:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971329536 00000100:00100000:0.0:1788986470.514058:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971329536 00000100:00100000:0.0:1788986470.514125:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1261 00000100:00100000:0.0:1788986470.514133:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971329536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986470.514165:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971329536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 34us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986470.514172:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1261 00000100:00080000:3.0:1788986470.514773:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986470.514778:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986470.514780:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986471.362136:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986472.388052:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986472.448324:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986472.448348:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993539968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986472.448490:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986472.448664:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993539968 00000100:00100000:0.0:1788986472.448672:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993539968 00000100:00100000:0.0:1788986472.448730:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 808 00000100:00100000:0.0:1788986472.448738:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993539968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986472.448768:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788986472.448816:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986472.448822:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993539968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986472.448830:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 808 00000100:00100000:3.0:1788986472.449056:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993539968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986473.106670:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986473.106758:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971330048 00000100:00100000:0.0:1788986473.106768:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971330048 00000100:00100000:0.0:1788986473.106849:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 872 00000100:00100000:0.0:1788986473.106860:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50252:x1875885971330048:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986473.106957:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50252:x1875885971330048:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 99us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986473.106965:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 872 00000100:00080000:1.0:1788986473.107573:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986473.111763:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986473.111843:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971330176 00000100:00100000:2.0:1788986473.111853:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971330176 00000100:00100000:2.0:1788986473.111923:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 479 00000100:00100000:2.0:1788986473.111933:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50252:x1875885971330176:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986473.112354:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50252:x1875885971330176:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 422us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986473.112362:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 479 00000100:00080000:1.0:1788986473.112679:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986473.115306:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986473.121447:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971330304 00000100:00100000:1.0:1788986473.121461:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971330304 00000100:00100000:1.0:1788986473.121657:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 480 00000100:00100000:1.0:1788986473.121668:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50252:x1875885971330304:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986473.122060:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50252:x1875885971330304:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 393us (6760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986473.122068:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 480 00000100:00080000:3.0:1788986473.123139:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986473.125899:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986473.126355:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971330432 00000100:00100000:3.0:1788986473.126364:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971330432 00000100:00100000:3.0:1788986473.126420:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 873 00000100:00100000:3.0:1788986473.126430:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50252:x1875885971330432:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986473.127779:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50252:x1875885971330432:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 1344us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986473.127798:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 873 00000100:00100000:2.0:1788986473.134324:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986473.134453:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971330560 00000100:00100000:0.0:1788986473.134462:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971330560 00000100:00100000:0.0:1788986473.134518:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 874 00000100:00100000:0.0:1788986473.134528:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50252:x1875885971330560:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986473.134623:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50252:x1875885971330560:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 96us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986473.134630:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 874 00000100:00100000:2.0:1788986473.137368:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986473.137480:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971330688 00000100:00100000:0.0:1788986473.137488:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971330688 00000100:00100000:0.0:1788986473.137576:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 481 00000100:00100000:0.0:1788986473.137587:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a457ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50252:x1875885971330688:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986473.138577:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a457ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50252:x1875885971330688:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 989us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986473.138587:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 481 00000100:00100000:3.0:1788986473.141848:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986473.144215:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971330816 00000100:00100000:1.0:1788986473.144229:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971330816 00000100:00100000:1.0:1788986473.144295:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 482 00000100:00100000:1.0:1788986473.144304:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50252:x1875885971330816:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986473.144896:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50252:x1875885971330816:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 590us (3052us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986473.144905:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 482 00000100:00100000:2.0:1788986473.151552:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986473.151736:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971330944 00000100:00100000:3.0:1788986473.151745:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971330944 00000100:00100000:3.0:1788986473.151837:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 875 00000100:00100000:3.0:1788986473.151847:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50252:x1875885971330944:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986473.152311:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50252:x1875885971330944:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 464us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986473.152320:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 875 00000100:00100000:2.0:1788986473.181779:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986473.181871:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971331072 00000100:00100000:3.0:1788986473.181880:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971331072 00000100:00100000:3.0:1788986473.181990:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 876 00000100:00100000:3.0:1788986473.182001:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50254:x1875885971331072:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986473.182021:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986473.182041:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12c7 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.182133:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548f86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.182153:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.182166:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986473.182198:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00000004:00200000:3.0:1788986473.182202:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986473.182220:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548f86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.182244:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12c7 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.182262:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548f86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12c7 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.182271:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:3.0:1788986473.182274:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986473.182278:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2a00, rc 0) 00000100:00100000:3.0:1788986473.182348:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50254:x1875885971331072:12345-192.168.206.21@tcp:101:rm.0 Request processed in 349us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986473.182356:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 876 00000100:00100000:1.0:1788986473.187044:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986473.187168:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971331328 00000100:00100000:2.0:1788986473.187178:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971331328 00000100:00100000:2.0:1788986473.187235:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 877 00000100:00100000:2.0:1788986473.187245:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50254:x1875885971331328:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986473.187263:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986473.187283:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548f8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12ce expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986473.187434:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00010000:00010000:2.0:1788986473.187651:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548f8d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12ce expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.187665:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:2.0:1788986473.187668:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788986473.187673:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf548f8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12ce expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.187685:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986473.188569:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:50254:x1875885971331328:12345-192.168.206.21@tcp:101:rm.0 Request processed in 1321us (1529us total) trans 4294967626 rc 301/301 00000100:00100000:2.0:1788986473.188578:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 877 00000100:00100000:2.0:1788986473.196849:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986473.199215:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971331456 00000100:00100000:0.0:1788986473.199228:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971331456 00000100:00100000:0.0:1788986473.199341:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 87 00000100:00100000:0.0:1788986473.199352:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:50254:x1875885971331456:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:0.0:1788986473.206017:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:50254:x1875885971331456:12345-192.168.206.21@tcp:37:rm.0 Request processed in 6660us (9169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986473.206029:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 87 00000100:00100000:1.0:1788986473.210202:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986473.210289:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971331712 00000100:00100000:3.0:1788986473.210297:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971331712 00000100:00100000:3.0:1788986473.210350:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 88 00000100:00100000:3.0:1788986473.210361:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:50254:x1875885971331712:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:3.0:1788986473.210568:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50254:x1875885971331712:12345-192.168.206.21@tcp:35:rm.0 Request processed in 209us (374us total) trans 4294967627 rc 0/0 00000100:00100000:3.0:1788986473.210577:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 88 00000100:00100000:2.0:1788986473.223704:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986473.224201:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971331968 00000100:00100000:3.0:1788986473.224211:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971331968 00000100:00100000:3.0:1788986473.224271:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 878 00000100:00100000:3.0:1788986473.224281:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50254:x1875885971331968:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788986473.224328:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788986473.224353:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548f86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12c7 expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.224375:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf548f2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x42:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12b2 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.224386:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:3.0:1788986473.224401:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548c37 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d11fc expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.224411:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:3.0:1788986473.224417:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986473.224440:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f9b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.224452:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.224578:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.224595:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fa2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.224603:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fa2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.224610:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fa2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.225045:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548fa9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.225054:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548fa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.225063:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548fa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986473.228337:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x42:0x0]: returning size 16384 00010000:00010000:2.0:1788986473.228362:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548fa9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228371:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548fa9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228379:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548fa9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228386:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986473.228390:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548fa9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228397:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548fa9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228411:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x42:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:2.0:1788986473.228414:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986473.228419:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548fa9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228425:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf548fa9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x42:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228451:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228457:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f9b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228462:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f9b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228467:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986473.228469:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f9b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228475:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f9b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228481:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:2.0:1788986473.228483:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986473.228485:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f9b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986473.228491:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf548f9b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986473.228502:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d60e3a18 reply state 000000005b1ddaca transno 4294967628 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fa2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986473.228511:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986473.228600:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:50254:x1875885971331968:12345-192.168.206.21@tcp:36:rm.0 Request processed in 4317us (4901us total) trans 4294967628 rc 0/0 00000100:00100000:2.0:1788986473.228609:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 878 00010000:00010000:3.0:1788986473.232764:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fa2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.232780:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fa2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.232799:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fa2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.232805:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986473.232809:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fa2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.232818:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fa2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.232832:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a55745000) 00010000:00010000:3.0:1788986473.232836:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986473.232840:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fa2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.232847:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fa2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986473.408493:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986473.476365:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993540096:0@lo:400:kworker.0 00000100:00100000:2.0:1788986473.476429:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986473.476486:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993540608:0@lo:400:kworker.0 00000100:00100000:2.0:1788986473.476515:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986473.476546:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788986473.476553:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993540224:0@lo:400:kworker.0 00000100:00100000:2.0:1788986473.478694:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986473.478729:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993540736:0@lo:400:kworker.0 00000100:00100000:2.0:1788986473.478754:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986473.478809:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993540480:0@lo:400:kworker.0 00000100:00100000:0.0:1788986473.478825:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993540608 00000100:00100000:0.0:1788986473.478834:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993540608 00000100:00100000:2.0:1788986473.478839:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986473.478886:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993540224 00000100:00100000:0.0:1788986473.478890:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993540224 00000100:00100000:0.0:1788986473.478910:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:0.0:1788986473.478920:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993540608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986473.478925:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986473.478935:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993540352:0@lo:400:kworker.0 00000100:00100000:2.0:1788986473.478972:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986473.478985:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993540608:12345-0@lo:400:kworker.0 Request processed in 66us (2468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986473.478993:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:0.0:1788986473.479012:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993540352 00000100:00100000:0.0:1788986473.479015:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993540352 00000100:00100000:0.0:1788986473.479031:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00100000:0.0:1788986473.479036:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993540224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986473.479070:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993540224:12345-0@lo:400:kworker.0 Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986473.479076:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595 00000100:00100000:0.0:1788986473.479109:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596 00000100:00100000:0.0:1788986473.479115:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993540352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986473.479150:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993540352:12345-0@lo:400:kworker.0 Request processed in 36us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986473.479156:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1596 00000100:00100000:0.0:1788986473.479312:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993540736 00000100:00100000:0.0:1788986473.479323:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993540736 00000100:00100000:0.0:1788986473.479351:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993540480 00000100:00100000:0.0:1788986473.479353:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993540480 00000100:00100000:0.0:1788986473.479371:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1788986473.479376:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993540736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986473.479408:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993540736:12345-0@lo:400:kworker.0 Request processed in 32us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986473.479413:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1173 00000100:00100000:0.0:1788986473.479425:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1788986473.479431:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993540480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986473.479463:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993540480:12345-0@lo:400:kworker.0 Request processed in 32us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986473.479468:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1174 00000100:00100000:0.0:1788986473.479516:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941837480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993540352:0@lo:400:kworker.0 00000100:00100000:0.0:1788986473.479529:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993540480:0@lo:400:kworker.0 00000100:00100000:0.0:1788986473.479565:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993540224:0@lo:400:kworker.0 00000100:00100000:0.0:1788986473.479575:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941835500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993540736:0@lo:400:kworker.0 00000100:00100000:0.0:1788986473.479587:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993540608:0@lo:400:kworker.0 00000100:00100000:3.0:1788986473.481676:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993540096 00000100:00100000:3.0:1788986473.481689:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993540096 00000100:00100000:3.0:1788986473.481739:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1788986473.481748:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993540096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986473.481850:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993540096:12345-0@lo:400:kworker.0 Request processed in 103us (5420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986473.481857:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00080000:3.0:1788986473.482511:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986473.482518:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986473.487200:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993540096:0@lo:400:kworker.0 00000001:00080000:1.0:1788986473.554154:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967628 is committed 00000100:00100000:3.0:1788986473.998830:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993540864:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986473.998895:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986474.000795:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993540864 00000100:00100000:2.0:1788986474.000805:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993540864 00000100:00100000:2.0:1788986474.000917:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 809 00000100:00100000:2.0:1788986474.000929:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993540864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986474.000965:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986474.006774:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993540864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5838us (7868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986474.006801:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 809 00000100:00100000:3.0:1788986474.006848:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c7a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993540864:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986474.432303:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986475.458884:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986475.635013:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986475.635051:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986475.636131:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986475.636158:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986475.636193:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971332096 00000100:00100000:0.0:1788986475.636205:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971332096 00000100:00100000:0.0:1788986475.636263:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1263 00000100:00100000:0.0:1788986475.636274:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971332096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986475.636351:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971332096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 79us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986475.636359:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1263 00000100:00100000:0.0:1788986475.636399:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971332352 00000100:00100000:0.0:1788986475.636403:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971332352 00000100:00100000:0.0:1788986475.636439:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971332480 00000100:00100000:0.0:1788986475.636442:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971332480 00000100:00100000:0.0:1788986475.636463:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1175 00000100:00100000:0.0:1788986475.636470:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971332352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986475.636500:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971332352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986475.636507:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1175 00000100:00100000:0.0:1788986475.637924:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1176 00000100:00100000:0.0:1788986475.637944:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971332480:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986475.638004:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971332480:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (1843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986475.638011:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1176 00000100:00100000:0.0:1788986475.638046:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971332224 00000100:00100000:0.0:1788986475.638052:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971332224 00000100:00100000:0.0:1788986475.638308:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1597 00000100:00100000:0.0:1788986475.638317:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971332224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986475.638352:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971332224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (2228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986475.638359:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1597 00000100:00080000:0.0:1788986475.638490:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986475.638495:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986475.638498:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788986476.336712:0:85372:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe7b589890 20000000:00000080:3.0:1788986476.336735:0:85372:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f8bac00 uarg=0000000000000000 10000000:01000000:3.0:1788986476.336806:0:85372:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986476.336831:0:85372:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.337388:0:85372:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf548c29 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548c22 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.337406:0:85372:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.337605:0:85372:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf548c29 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548c22 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.337623:0:85372:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf548c29 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548c22 expref: 18 pid: 5849 timeout: 2360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986476.337842:0:85372:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85372:1875885993540992:0@lo:104: 00000100:00100000:3.0:1788986476.337924:0:85372:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986476.337984:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993540992 00000100:00100000:0.0:1788986476.337994:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993540992 00000100:00100000:0.0:1788986476.338056:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:0.0:1788986476.338067:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:85372:x1875885993540992:12345-0@lo:104: 00010000:00010000:0.0:1788986476.338082:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548c29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986476.338165:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986476.338173:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:85372:x1875885993540992:12345-0@lo:104: Request processed in 108us (249us total) trans 0 rc 0/0 00010000:00010000:1.0:1788986476.338175:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788986476.338180:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00010000:00010000:1.0:1788986476.338183:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548c29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986476.338190:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986476.338195:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548c29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986476.338204:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548c29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986476.338752:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548c29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986476.338760:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1788986476.338841:0:85372:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eac9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788986476.338875:0:85372:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85372:1875885993540992:0@lo:104: 00010000:00010000:3.0:1788986476.338900:0:85372:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986476.339059:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548c29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986476.339067:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788986476.339139:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993541120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986476.339189:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788986476.339233:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548c29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986476.339318:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993541120 00000100:00100000:3.0:1788986476.339325:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993541120 00010000:00010000:3.0:1788986476.339355:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf548c29 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548c22 expref: 19 pid: 5849 timeout: 2360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986476.339394:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788986476.339403:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993541120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986476.339417:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986476.339499:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548c22 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548c29 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986476.339600:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986476.339602:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986476.339604:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986476.339744:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf548c29 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548c22 expref: 19 pid: 5849 timeout: 2360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.339761:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf548c29 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548c22 expref: 19 pid: 5849 timeout: 2360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.339856:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf548c29 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548c22 expref: 19 pid: 5849 timeout: 2360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.339873:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.339883:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.339903:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.339912:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.339920:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.339928:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.339935:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986476.339939:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.339947:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986476.343056:0:85372:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986476.343079:0:85372:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.346044:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.346071:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85372 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986476.346157:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986476.346357:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993541120:12345-0@lo:103:ldlm_bl.0 Request processed in 6950us (7162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986476.346369:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:1.0:1788986476.348305:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993541120:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986476.480395:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986477.127896:0:85421:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb19cb3c0 20000000:00000080:3.0:1788986477.127914:0:85421:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a82078000 uarg=0000000000000000 00010000:00010000:3.0:1788986477.128608:0:85421:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986477.128622:0:85421:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986477.128635:0:85421:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986477.128653:0:85421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb7 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986477.128819:0:85421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb7 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986477.128830:0:85421:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986477.128837:0:85421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb7 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986477.128845:0:85421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb7 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986477.128853:0:85421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986477.128864:0:85421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986477.128868:0:85421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb7 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986477.128875:0:85421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb7 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986477.128888:0:85421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb7 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986477.128896:0:85421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb7 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986477.128903:0:85421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf548fb7 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986477.506852:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986477.568439:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986477.568460:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993541248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986477.568523:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986477.568684:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993541248 00000100:00100000:1.0:1788986477.568693:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993541248 00000100:00100000:1.0:1788986477.568759:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 810 00000100:00100000:1.0:1788986477.568779:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993541248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986477.568810:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788986477.568937:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986477.569035:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993541248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986477.569190:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993541248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 403us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986477.569198:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 810 10000000:01000000:1.0:1788986477.701393:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986477.701400:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986477.701406:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986477.701449:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986477.701460:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986477.701470:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986477.701494:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993541376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986477.701623:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986477.701680:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a808dbc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788986477.701746:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993541376 00000100:00100000:2.0:1788986477.701754:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993541376 00000100:00100000:2.0:1788986477.701810:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:2.0:1788986477.701819:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993541376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986477.701832:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986477.701845:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548fc5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf548fbe expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986477.701878:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548fc5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf548fbe expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986477.701888:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548fc5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548fbe expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986477.701897:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0c00, rc 0) 00000100:00100000:2.0:1788986477.702059:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993541376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986477.702066:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:1.0:1788986477.702167:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b40a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993541376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986477.702249:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548fc5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986477.702259:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf548fc5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986477.702283:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986477.702287:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548fc5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986477.702295:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf548fc5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986478.528218:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986478.592559:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993541888:0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.592622:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986478.592676:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788986478.592683:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993541504:0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.592709:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986478.592733:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993542016:0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.592754:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986478.592794:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993541632:0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.592817:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986478.592835:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993542144:0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.592853:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986478.592870:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986478.592875:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993541760:0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.592893:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986478.592928:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993541888 00000100:00100000:2.0:1788986478.592935:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993541888 00000100:00100000:2.0:1788986478.592974:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993542144 00000100:00100000:2.0:1788986478.592977:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993542144 00000100:00100000:2.0:1788986478.593006:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1177 00000100:00100000:2.0:1788986478.593014:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993541888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.593063:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993541888:12345-0@lo:400:kworker.0 Request processed in 50us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986478.593069:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1177 00000100:00100000:2.0:1788986478.593085:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1788986478.593113:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993542144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.593145:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993542144:12345-0@lo:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986478.593151:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1178 00000100:00100000:2.0:1788986478.593169:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993541504 00000100:00100000:2.0:1788986478.593172:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993541504 00000100:00100000:3.0:1788986478.594069:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993542016 00000100:00100000:3.0:1788986478.594077:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993542016 00000100:00100000:3.0:1788986478.594128:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993541632 00000100:00100000:3.0:1788986478.594131:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993541632 00000100:00100000:3.0:1788986478.594146:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993541760 00000100:00100000:3.0:1788986478.594149:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993541760 00000100:00100000:3.0:1788986478.594167:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:3.0:1788986478.594174:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993542016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986478.594216:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993542016:12345-0@lo:400:kworker.0 Request processed in 43us (1461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986478.594222:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000100:00100000:3.0:1788986478.594236:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1788986478.594241:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993541632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986478.594269:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993541632:12345-0@lo:400:kworker.0 Request processed in 28us (1451us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986478.594274:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1788986478.594286:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1788986478.594292:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993541760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986478.594319:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993541760:12345-0@lo:400:kworker.0 Request processed in 27us (1424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986478.594325:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00100000:2.0:1788986478.594722:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1265 00000100:00100000:2.0:1788986478.594731:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993541504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.594781:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993541504:12345-0@lo:400:kworker.0 Request processed in 51us (2071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986478.594787:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1265 00000100:00080000:2.0:1788986478.594812:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986478.594817:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986478.594848:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993541760:0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.594860:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993541632:0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.594871:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941837800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993542144:0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.594906:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993541504:0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.594916:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993542016:0@lo:400:kworker.0 00000100:00100000:2.0:1788986478.594925:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993541888:0@lo:400:kworker.0 00000100:00100000:2.0:1788986479.105313:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993542272:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986479.105377:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986479.105585:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993542272 00000100:00100000:0.0:1788986479.105593:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993542272 00000100:00100000:0.0:1788986479.105643:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 811 00000100:00100000:0.0:1788986479.105653:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993542272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986479.105684:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986479.105738:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993542272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986479.105745:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 811 00000100:00100000:3.0:1788986479.105846:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993542272:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986479.552571:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986479.848609:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986479.851468:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971332608 00000100:00100000:3.0:1788986479.851482:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971332608 00000100:00100000:3.0:1788986479.851629:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 879 00000100:00100000:3.0:1788986479.851641:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50366:x1875885971332608:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986479.851662:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986479.851684:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548fcc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12d5 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.851738:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fd3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.851760:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.851773:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986479.851807:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788986479.851811:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986479.851830:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fd3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.851852:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf548fcc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12d5 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.851870:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fd3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12d5 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.851878:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986479.851881:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986479.851884:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3c00, rc 0) 00000100:00100000:3.0:1788986479.851957:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50366:x1875885971332608:12345-192.168.206.21@tcp:101:rm.0 Request processed in 317us (3356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986479.851964:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 879 00000100:00080000:2.0:1788986479.855488:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986479.857348:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986479.857419:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971332736 00000100:00100000:3.0:1788986479.857428:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971332736 00000100:00100000:3.0:1788986479.857479:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 880 00000100:00100000:3.0:1788986479.857489:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42ccc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50366:x1875885971332736:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986479.857506:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986479.857524:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12dc expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857585:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548fe1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857598:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548fe1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857608:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548fe1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857620:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548fe8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857627:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857632:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857819:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548fe1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857827:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548fe1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857834:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857840:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986479.857844:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548fe1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857856:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548fe1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857867:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986479.857870:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986479.857875:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548fe1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857882:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf548fe1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857893:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548fe8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857899:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548fe8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857905:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857910:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986479.857913:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548fe8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857919:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548fe8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857925:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a55745300) 00010000:00010000:3.0:1788986479.857927:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986479.857930:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548fe8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857940:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548fe8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857971:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fda lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12dc expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857981:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986479.857983:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986479.857987:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12dc expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.857996:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2a00, rc 0) 00000100:00100000:3.0:1788986479.858054:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42ccc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50366:x1875885971332736:12345-192.168.206.21@tcp:101:rm.0 Request processed in 566us (713us total) trans 0 rc 301/301 00000100:00100000:3.0:1788986479.858061:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 880 00000100:00100000:1.0:1788986479.934149:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986479.934183:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986479.934265:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971332864 00000100:00100000:3.0:1788986479.934274:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971332864 00000100:00100000:3.0:1788986479.934331:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971333120 00000100:00100000:3.0:1788986479.934334:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971333120 00000100:00100000:3.0:1788986479.934365:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 881 00000100:00100000:3.0:1788986479.934375:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971332864:12345-192.168.206.21@tcp:41:mkdir.0 00000004:00000024:3.0:1788986479.934417:0:15241:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788986479.934478:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971332864:12345-192.168.206.21@tcp:41:mkdir.0 Request processed in 104us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986479.934485:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 881 00000100:00100000:3.0:1788986479.934502:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 882 00000100:00100000:3.0:1788986479.934509:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50370:x1875885971333120:12345-192.168.206.21@tcp:36:mkdir.0 00010000:00010000:3.0:1788986479.934540:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986479.934565:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf548fd3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12d5 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.934584:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986479.934594:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986479.934818:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.934832:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.934841:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.934852:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548ff6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.934859:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.934866:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986479.935771:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00010000:00010000:3.0:1788986479.935782:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.935790:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.935800:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.935806:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986479.935810:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.935818:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.935828:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986479.935831:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986479.935836:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.935841:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf548fef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986479.935855:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000089a5c952 reply state 00000000a352ad2e transno 4294967629 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986479.935864:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986479.935920:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50370:x1875885971333120:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 1410us (1735us total) trans 4294967629 rc 0/0 00000100:00100000:3.0:1788986479.935928:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 882 00010000:00010000:3.0:1788986479.949123:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548ff6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.949139:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548ff6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.949150:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.949156:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986479.949160:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548ff6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.949167:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548ff6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.949181:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a55745e00) 00010000:00010000:3.0:1788986479.949184:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986479.949189:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548ff6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986479.949196:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf548ff6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986480.051870:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986480.051967:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971333248 00000100:00100000:0.0:1788986480.051976:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971333248 00000100:00100000:0.0:1788986480.052035:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 883 00000100:00100000:0.0:1788986480.052045:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50374:x1875885971333248:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:0.0:1788986480.052066:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986480.052120:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548ffd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12e3 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.052178:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549004 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.052191:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.052206:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986480.052245:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788986480.052248:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986480.052267:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549004 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.052289:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf548ffd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12e3 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.052306:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549004 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12e3 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.052319:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986480.052322:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986480.052325:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986480.052422:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50374:x1875885971333248:12345-192.168.206.21@tcp:101:chown.0 Request processed in 378us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986480.052430:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 883 00000100:00100000:2.0:1788986480.056980:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986480.057058:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971333376 00000100:00100000:1.0:1788986480.057068:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971333376 00000100:00100000:1.0:1788986480.057144:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 884 00000100:00100000:1.0:1788986480.057155:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50374:x1875885971333376:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:1.0:1788986480.057173:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986480.057191:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54900b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12ea expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057258:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549012 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057271:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549012 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057282:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549012 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057295:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549019 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057302:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549019 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057308:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549019 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057392:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549020 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057400:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549020 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057407:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549020 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986480.057437:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:1.0:1788986480.057441:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986480.057459:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549020 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057470:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549012 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057476:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549012 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057483:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549012 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057489:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986480.057493:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549012 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057501:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549012 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057513:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:1.0:1788986480.057516:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986480.057520:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549012 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057526:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549012 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057539:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549019 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057546:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549019 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057551:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549019 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057556:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986480.057559:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549019 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057564:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549019 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057571:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a45316400) 00010000:00010000:1.0:1788986480.057573:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986480.057575:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549019 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057580:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549019 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057611:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54900b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12ea expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057622:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549020 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12ea expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.057643:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:1.0:1788986480.057645:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986480.057647:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031a00, rc 0) 00000100:00100000:1.0:1788986480.057700:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50374:x1875885971333376:12345-192.168.206.21@tcp:101:chown.0 Request processed in 547us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986480.057707:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 884 00000100:00100000:1.0:1788986480.062079:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986480.062184:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971333632 00000100:00100000:0.0:1788986480.062193:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971333632 00000100:00100000:0.0:1788986480.062255:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 885 00000100:00100000:0.0:1788986480.062264:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50374:x1875885971333632:12345-192.168.206.21@tcp:36:chown.0 00010000:00010000:0.0:1788986480.062308:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986480.062332:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549020 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12ea expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.062357:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:0.0:1788986480.062367:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986480.062389:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549027 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.062401:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.062411:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788986480.098832:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967630 is committed 00000004:00010000:1.0:1788986480.099051:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000046809311 reply state 00000000b8c9ecdc transno 4294967630 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986480.099064:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986480.099077:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00010000:00080000:1.0:1788986480.099329:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788986480.099353:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50374:x1875885971333632:12345-192.168.206.21@tcp:36:chown.0 Request processed in 37086us (37278us total) trans 4294967630 rc 0/0 00000100:00100000:1.0:1788986480.099362:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 885 00010000:00010000:3.0:1788986480.099497:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549027 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.099507:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549027 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.099513:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.099518:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986480.099522:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549027 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.099529:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549027 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.099544:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:3.0:1788986480.099547:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986480.099551:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549027 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.099557:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549027 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.578278:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986480.755475:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986480.755519:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986480.755610:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971333760 00000100:00100000:1.0:1788986480.755620:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971333760 00000100:00100000:1.0:1788986480.755715:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1266 00000100:00100000:1.0:1788986480.755727:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971333760:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986480.755808:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971333760:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 83us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986480.755826:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1266 00000100:00100000:2.0:1788986480.756299:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986480.756326:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986480.757673:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971334016 00000100:00100000:0.0:1788986480.757685:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971334016 00000100:00100000:0.0:1788986480.757804:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971334144 00000100:00100000:0.0:1788986480.757809:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971334144 00000100:00080000:2.0:1788986480.760017:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986480.760027:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986480.760266:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1179 00000100:00100000:0.0:1788986480.760281:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971334016:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986480.760373:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971334016:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 88us (4843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986480.760381:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1179 00000100:00100000:0.0:1788986480.760400:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1180 00000100:00100000:0.0:1788986480.760406:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971334144:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986480.760436:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971334144:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (4109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986480.760442:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1180 00000100:00100000:0.0:1788986480.760601:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971333888 00000100:00100000:0.0:1788986480.760609:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971333888 00000100:00100000:0.0:1788986480.760645:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1601 00000100:00100000:0.0:1788986480.760652:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971333888:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986480.760687:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971333888:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (4388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986480.760693:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1601 00000020:00000080:0.0:1788986480.980922:0:85617:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc61015eb0 20000000:00000080:0.0:1788986480.980939:0:85617:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094242f000 uarg=0000000000000000 10000000:01000000:0.0:1788986480.980980:0:85617:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986480.980998:0:85617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.981016:0:85617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548fc5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf548fbe expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.981024:0:85617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.981063:0:85617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548fc5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf548fbe expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.981077:0:85617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548fc5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf548fbe expref: 18 pid: 5849 timeout: 2364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986480.985219:0:85617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c79f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85617:1875885993542400:0@lo:104: 00000100:00100000:0.0:1788986480.985293:0:85617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986480.985411:0:85617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986480.986483:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993542400 00000100:00100000:1.0:1788986480.986494:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993542400 00000100:00100000:1.0:1788986480.986947:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:1.0:1788986480.986958:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:85617:x1875885993542400:12345-0@lo:104: 00010000:00010000:1.0:1788986480.986974:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548fc5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986480.987066:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986480.987072:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:85617:x1875885993542400:12345-0@lo:104: Request processed in 118us (1779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986480.987078:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00010000:00010000:3.0:1788986480.987156:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986480.987163:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf548fc5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987171:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986480.987176:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf548fc5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987184:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf548fc5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986480.987191:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf548fc5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986480.987197:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986480.987233:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548fc5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987240:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986480.987262:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548fc5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987269:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf548fbe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf548fc5 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987286:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986480.987288:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986480.987290:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986480.987303:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993542528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986480.987341:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986480.987388:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993542528 00000100:00100000:3.0:1788986480.987392:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993542528 00010000:00010000:3.0:1788986480.987413:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548fc5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548fbe expref: 19 pid: 5849 timeout: 2364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986480.987435:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788986480.987441:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993542528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986480.987451:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986480.987456:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548fc5 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf548fbe expref: 19 pid: 5849 timeout: 2364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987467:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548fc5 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf548fbe expref: 19 pid: 5849 timeout: 2364 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987482:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987490:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987510:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987518:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987525:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987531:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987536:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986480.987541:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987548:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987557:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986480.987566:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986480.987596:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993542528:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986480.987602:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:3.0:1788986480.987639:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993542528:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986480.987730:0:85617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf548fc5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf548fbe expref: 18 pid: 5849 timeout: 2364 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986480.987756:0:85617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c79f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:85617:1875885993542400:0@lo:104: 00010000:00010000:0.0:1788986480.987771:0:85617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.987780:0:85617:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.987786:0:85617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986480.987793:0:85617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54902e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986481.600345:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986481.874670:0:85665:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed7ad7090 20000000:00000080:2.0:1788986481.874694:0:85665:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a4871e000 uarg=0000000000000000 00010000:00010000:2.0:1788986481.875758:0:85665:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788986481.875810:0:85665:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:2.0:1788986481.875815:0:85665:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986481.875830:0:85665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549004 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12e3 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986481.875862:0:85665:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1788986481.875882:0:85665:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986481.875903:0:85665:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549035 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 85665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986481.875918:0:85665:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549035 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 85665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986481.875930:0:85665:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549035 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 85665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986481.875940:0:85665:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549035 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986481.875947:0:85665:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549035 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 85665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986481.875955:0:85665:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549035 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986481.875961:0:85665:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986481.875966:0:85665:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549035 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 85665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986481.875974:0:85665:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549035 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 85665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986481.875985:0:85665:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549035 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986481.875998:0:85665:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549035 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986481.876006:0:85665:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549035 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 85665 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986482.630950:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986482.688576:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993542656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986482.688642:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986482.688957:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993542656 00000100:00100000:1.0:1788986482.688966:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993542656 00000100:00100000:1.0:1788986482.689024:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 812 00000100:00100000:1.0:1788986482.689034:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993542656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986482.689068:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986482.691892:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993542656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2852us (3242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986482.691906:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 812 00000100:00080000:1.0:1788986482.691941:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986482.693356:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993542656:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1788986482.752523:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986482.752530:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986482.752536:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986482.752576:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986482.752588:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986482.752598:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986482.752624:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993542784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986482.752696:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986482.752747:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eac300 going to sleep for 11 seconds 00000100:00100000:0.0:1788986482.753009:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993542784 00000100:00100000:0.0:1788986482.753017:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993542784 00000100:00100000:0.0:1788986482.753060:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:0.0:1788986482.753069:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993542784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986482.753081:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986482.753110:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549043 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54903c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986482.753132:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549043 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54903c expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986482.753148:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549043 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54903c expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986482.753156:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef800, rc 0) 00000100:00100000:0.0:1788986482.753197:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993542784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986482.753217:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:3.0:1788986482.766365:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993542784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986482.766392:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986482.766404:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986482.766423:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986482.766429:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986482.766436:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986483.648714:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986483.712580:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993542912:0@lo:400:kworker.0 00000100:00100000:3.0:1788986483.712641:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993543168:0@lo:400:kworker.0 00000100:00100000:2.0:1788986483.712656:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986483.712717:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993543424:0@lo:400:kworker.0 00000100:00100000:1.0:1788986483.712770:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993543040:0@lo:400:kworker.0 00000100:00100000:0.0:1788986483.714434:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993542912 00000100:00100000:0.0:1788986483.714447:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993542912 00000100:00100000:0.0:1788986483.714500:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1788986483.714509:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993542912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986483.715037:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986483.715119:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986483.715130:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993543296:0@lo:400:kworker.0 00000100:00100000:3.0:1788986483.715182:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986483.715224:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993543168 00000100:00100000:3.0:1788986483.715229:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993543168 00000100:00100000:2.0:1788986483.715234:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986483.715271:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993543424 00000100:00100000:3.0:1788986483.715275:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993543424 00000100:00100000:3.0:1788986483.715295:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1602 00000100:00100000:3.0:1788986483.715301:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993543168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986483.715499:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993543168:12345-0@lo:400:kworker.0 Request processed in 198us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986483.715507:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1602 00000100:00100000:3.0:1788986483.716385:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603 00000100:00100000:3.0:1788986483.716397:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993543424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986483.716507:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993543424:12345-0@lo:400:kworker.0 Request processed in 113us (1277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986483.716513:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603 00000100:00100000:3.0:1788986483.716540:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993543296 00000100:00100000:3.0:1788986483.716546:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993543296 00000100:00100000:3.0:1788986483.716575:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1788986483.716582:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993543296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986483.716613:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993543296:12345-0@lo:400:kworker.0 Request processed in 31us (1430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986483.716618:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1181 00000100:00100000:3.0:1788986483.716773:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993543424:0@lo:400:kworker.0 00000100:00100000:3.0:1788986483.716814:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993543296:0@lo:400:kworker.0 00000100:00100000:3.0:1788986483.716827:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993543168:0@lo:400:kworker.0 00000100:00100000:1.0:1788986483.719075:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986483.719134:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993543552:0@lo:400:kworker.0 00000100:00100000:1.0:1788986483.719164:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986483.719230:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993543040 00000100:00100000:1.0:1788986483.719236:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993543040 00000100:00100000:1.0:1788986483.719280:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00100000:1.0:1788986483.719288:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993543040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986483.719343:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993543040:12345-0@lo:400:kworker.0 Request processed in 55us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986483.719351:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00080000:1.0:1788986483.719376:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986483.719394:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993543552 00000100:00100000:1.0:1788986483.719397:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993543552 00000100:00100000:1.0:1788986483.719428:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1182 00000100:00100000:1.0:1788986483.719435:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993543552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986483.719468:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993543552:12345-0@lo:400:kworker.0 Request processed in 34us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986483.719473:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1182 00000100:00080000:1.0:1788986483.719493:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986483.719520:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993543040:0@lo:400:kworker.0 00000100:00100000:1.0:1788986483.719529:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993543552:0@lo:400:kworker.0 00000100:00100000:0.0:1788986483.720953:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993542912:12345-0@lo:400:kworker.0 Request processed in 6439us (8292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986483.720966:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:3.0:1788986483.721786:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993542912:0@lo:400:kworker.0 00000100:00100000:3.0:1788986484.226717:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993543680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986484.226789:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986484.226872:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993543680 00000100:00100000:1.0:1788986484.226880:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993543680 00000100:00100000:1.0:1788986484.226941:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 813 00000100:00100000:1.0:1788986484.226950:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993543680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986484.226984:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986484.227808:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993543680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 857us (1017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986484.227818:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 813 00000100:00100000:3.0:1788986484.228013:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993543680:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986484.672341:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986484.756833:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986484.756946:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971334272 00000100:00100000:3.0:1788986484.756955:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971334272 00000100:00100000:3.0:1788986484.757041:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00100000:3.0:1788986484.757051:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5588:x1875885971334272:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986484.757066:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986484.757068:0:8524:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf549004) 00010000:00010000:3.0:1788986484.757070:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986484.757156:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5588:x1875885971334272:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 107us (332us total) trans 0 rc 116/116 00000100:00100000:3.0:1788986484.757163:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 14 00000100:00080000:1.0:1788986484.757848:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986485.539560:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986485.539628:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971334400 00000100:00100000:3.0:1788986485.539637:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971334400 00000100:00100000:3.0:1788986485.539694:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 886 00000100:00100000:3.0:1788986485.539703:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50479:x1875885971334400:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986485.539732:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986485.539753:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54904a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12f1 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.539810:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549051 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.539823:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.539836:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986485.539871:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788986485.539874:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986485.539892:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549051 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.539911:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54904a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12f1 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.539925:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549051 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12f1 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.539933:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:3.0:1788986485.539936:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986485.539939:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3c00, rc 0) 00000100:00100000:3.0:1788986485.540057:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50479:x1875885971334400:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 354us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986485.540063:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 886 00000100:00100000:2.0:1788986485.549064:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986485.549113:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971334528 00000100:00100000:2.0:1788986485.549123:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971334528 00000100:00100000:2.0:1788986485.549173:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 887 00000100:00100000:2.0:1788986485.549182:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50479:x1875885971334528:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:2.0:1788986485.549199:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986485.549219:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549058 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12f8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549279:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54905f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549293:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54905f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549304:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54905f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549333:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549066 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549340:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549347:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549598:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54906d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549607:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54906d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549613:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54906d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986485.549640:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:2.0:1788986485.549642:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986485.549659:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54906d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549669:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54905f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549676:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54905f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549683:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54905f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549692:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986485.549696:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54905f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549702:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54905f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549713:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:2.0:1788986485.549715:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986485.549734:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54905f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549741:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54905f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549751:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549066 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549757:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549066 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549763:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549066 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549768:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986485.549771:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549066 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549777:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549066 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549789:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a45aca400) 00010000:00010000:2.0:1788986485.549791:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986485.549794:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549066 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549799:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549066 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549831:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549058 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12f8 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549842:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54906d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12f8 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.549849:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986485.549851:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986485.549853:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1000, rc 0) 00000100:00100000:2.0:1788986485.549907:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50479:x1875885971334528:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 726us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986485.549914:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 887 00000100:00100000:0.0:1788986485.559436:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986485.562138:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971334784 00000100:00100000:0.0:1788986485.562152:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971334784 00000100:00100000:0.0:1788986485.562212:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 888 00000100:00100000:0.0:1788986485.562222:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50479:x1875885971334784:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788986485.562269:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986485.562293:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54906d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12f8 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986485.562308:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:0.0:1788986485.562319:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986485.562339:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549074 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986485.562350:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986485.562359:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986485.613703:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f17ac9f0 reply state 00000000f11f5c70 transno 4294967631 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986485.613733:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986485.613749:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000100:00100000:1.0:1788986485.613846:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50479:x1875885971334784:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 51621us (54414us total) trans 4294967631 rc 0/0 00000100:00100000:1.0:1788986485.613853:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 888 00000001:00080000:3.0:1788986485.615031:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967631 is committed 00010000:00010000:1.0:1788986485.615126:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549074 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.615136:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549074 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.615143:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549074 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.615149:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986485.615155:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549074 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.615162:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549074 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.615176:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:1.0:1788986485.615179:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986485.615184:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549074 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.615199:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549074 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986485.686059:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986485.686171:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971334912 00000100:00100000:3.0:1788986485.686181:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971334912 00000100:00100000:3.0:1788986485.686247:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 889 00000100:00100000:3.0:1788986485.686258:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50483:x1875885971334912:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:3.0:1788986485.686281:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986485.686301:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54907b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d12ff expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686359:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549082 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686372:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549082 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686384:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549082 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686398:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549089 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686405:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686411:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686699:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549090 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686714:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686732:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986485.686760:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:3.0:1788986485.686764:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986485.686783:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549090 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686794:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549082 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686800:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549082 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686806:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549082 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686811:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986485.686815:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549082 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686822:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549082 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686833:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:3.0:1788986485.686835:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986485.686840:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549082 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686846:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549082 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686857:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549089 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686863:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549089 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686873:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549089 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686878:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986485.686881:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549089 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686887:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549089 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686895:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a55745300) 00010000:00010000:3.0:1788986485.686897:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986485.686900:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549089 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686906:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549089 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686934:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54907b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12ff expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686947:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549090 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12ff expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.686954:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:3.0:1788986485.686955:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986485.686958:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2600, rc 0) 00000100:00100000:3.0:1788986485.688057:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50483:x1875885971334912:12345-192.168.206.21@tcp:101:touch.0 Request processed in 1796us (2004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986485.688070:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 889 00000100:00100000:2.0:1788986485.692749:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986485.693041:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971335168 00000100:00100000:1.0:1788986485.693050:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971335168 00000100:00100000:1.0:1788986485.693376:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 890 00000100:00100000:1.0:1788986485.693386:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50483:x1875885971335168:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986485.693407:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986485.693426:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549097 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1306 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.693757:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54909e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.693771:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54909e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.693782:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54909e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.693816:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5490a5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.693824:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5490a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.693831:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5490a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788986485.695067:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1c:0x0], index 1: 0 00010000:00010000:1.0:1788986485.695537:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5490ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.695551:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5490ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.695561:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5490ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.695670:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54909e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.695678:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54909e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.695685:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54909e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.695691:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986485.695695:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54909e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.695703:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54909e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.695715:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:1.0:1788986485.695728:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986485.695733:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54909e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.695739:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54909e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986485.695758:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000566a8a9a reply state 000000008d611263 transno 4294967632 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5490a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986485.695766:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986485.695799:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549097 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1306 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.695815:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5490ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1306 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.695822:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9b0a45316400) 00010000:00010000:1.0:1788986485.695825:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986485.695827:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986485.696148:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50483:x1875885971335168:12345-192.168.206.21@tcp:101:touch.0 Request processed in 2762us (3406us total) trans 4294967632 rc 0/0 00000100:00100000:1.0:1788986485.696157:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 890 00010000:00010000:1.0:1788986485.696671:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986485.698742:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5490a5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.698758:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5490a5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.698765:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5490a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.698770:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986485.698775:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5490a5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.698781:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5490a5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.698795:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a45316200) 00010000:00010000:3.0:1788986485.698798:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986485.698802:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5490a5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.698808:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5490a5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986485.702022:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986485.702250:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971335424 00000100:00100000:1.0:1788986485.702260:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971335424 00000100:00100000:1.0:1788986485.702361:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 891 00000100:00100000:1.0:1788986485.702372:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:50483:x1875885971335424:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:1.0:1788986485.702424:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986485.702448:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5490ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1306 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.702472:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9b0a45316400) 00010000:00010000:1.0:1788986485.702483:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986485.702519:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5490ba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.702531:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5490ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.702540:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5490ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986485.702660:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000018415804 reply state 00000000efb9851d transno 4294967633 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5490ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986485.702669:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986485.702764:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50483:x1875885971335424:12345-192.168.206.21@tcp:36:touch.0 Request processed in 393us (749us total) trans 4294967633 rc 0/0 00000100:00100000:1.0:1788986485.702771:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 891 00010000:00010000:3.0:1788986485.705407:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5490ba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.705420:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5490ba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.705431:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5490ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.705437:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986485.705441:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5490ba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.705460:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5490ba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.705475:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9b0a45316700) 00010000:00010000:3.0:1788986485.705478:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986485.705482:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5490ba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.705488:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5490ba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986485.707775:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986485.707922:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971335552 00000100:00100000:3.0:1788986485.707932:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971335552 00000100:00100000:3.0:1788986485.708034:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 892 00000100:00100000:3.0:1788986485.708045:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:50483:x1875885971335552:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:3.0:1788986485.708067:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986485.708172:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5490c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d130d expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.708231:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5490c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d130d expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.708251:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5490c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x49:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d130d expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.708269:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986485.708273:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788986485.708277:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2a00, rc 0) 00000100:00100000:3.0:1788986485.708335:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50483:x1875885971335552:12345-192.168.206.21@tcp:101:touch.0 Request processed in 292us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986485.708342:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 892 00000100:00100000:1.0:1788986485.712024:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986485.712382:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971335680 00000100:00100000:3.0:1788986485.712392:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971335680 00000100:00100000:2.0:1788986485.712607:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 483 00000100:00100000:2.0:1788986485.712618:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971335680:12345-192.168.206.21@tcp:2:touch.0 00000100:00100000:2.0:1788986485.712952:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971335680:12345-192.168.206.21@tcp:2:touch.0 Request processed in 335us (936us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788986485.712960:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 483 00000100:00080000:1.0:1788986485.714771:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986485.715855:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986485.716014:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971335936 00000100:00100000:3.0:1788986485.716023:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971335936 00000100:00100000:3.0:1788986485.716076:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 89 00000100:00100000:3.0:1788986485.716085:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50483:x1875885971335936:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:3.0:1788986485.716622:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50483:x1875885971335936:12345-192.168.206.21@tcp:35:touch.0 Request processed in 535us (770us total) trans 4294967634 rc 0/0 00000100:00100000:3.0:1788986485.716630:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 89 00000100:00100000:0.0:1788986485.772047:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986485.772201:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971336064 00000100:00100000:1.0:1788986485.772212:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971336064 00000100:00100000:1.0:1788986485.772318:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 893 00000100:00100000:1.0:1788986485.772329:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50487:x1875885971336064:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986485.772351:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986485.772371:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5490c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1314 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772430:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490cf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772444:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772456:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772470:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772477:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772484:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772568:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5490dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772577:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5490dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772584:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5490dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986485.772615:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x49:0x0]: returning size 0 00000004:00200000:1.0:1788986485.772620:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986485.772637:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5490dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772647:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5490dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772655:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490cf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772665:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490cf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772672:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772677:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986485.772681:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490cf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772688:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490cf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772698:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:1.0:1788986485.772702:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986485.772706:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772712:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772740:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772746:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772752:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772757:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986485.772760:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772766:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772773:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a45316400) 00010000:00010000:1.0:1788986485.772776:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986485.772779:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490d6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772785:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772825:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5490c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1314 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772840:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5490dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1314 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.772847:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:1.0:1788986485.772850:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986485.772852:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986485.772940:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50487:x1875885971336064:12345-192.168.206.21@tcp:101:rm.0 Request processed in 613us (903us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986485.772947:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 893 00000100:00100000:1.0:1788986485.778999:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986485.779120:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971336192 00000100:00100000:2.0:1788986485.779130:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971336192 00000100:00100000:2.0:1788986485.779196:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 484 00000100:00100000:2.0:1788986485.779206:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971336192:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986485.779223:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986485.779242:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf5490e4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d131b expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788986485.779267:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x6aa1c475, atime: 0x6aa1c475, ctime: 0x6aa1c475, blocks: 0x1 00010000:00010000:2.0:1788986485.779284:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=2269s v=(0 0) 00010000:00010000:2.0:1788986485.779288:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986485.779297:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf5490e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d131b expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.779315:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf5490e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d131b expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986485.779328:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0800, rc 0) 00000100:00100000:2.0:1788986485.779386:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971336192:12345-192.168.206.21@tcp:101:rm.0 Request processed in 181us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986485.779393:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 484 00000100:00100000:3.0:1788986485.783344:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986485.783444:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971336448 00000100:00100000:1.0:1788986485.783453:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971336448 00000100:00100000:1.0:1788986485.783550:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 894 00000100:00100000:1.0:1788986485.783561:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50487:x1875885971336448:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788986485.783610:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986485.783636:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5490dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x49:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1314 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.783659:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5490c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x49:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d130d expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.783670:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:1.0:1788986485.783680:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986485.783701:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5490eb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.783714:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5490eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.784222:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5490eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.784240:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.784249:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.784255:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.784352:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.784363:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.784370:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986485.785443:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].28, 64 off9984 00000004:00080000:1.0:1788986485.785454:0:7899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2269688364717ns, next at 2270688362364ns, rc = 0 00010000:00010000:1.0:1788986485.785509:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549100 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.785521:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549100 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.785529:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549100 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.785536:0:7899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549100 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.785542:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549100 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.785548:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549100 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.785570:0:7899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986485.785658:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.785665:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490f9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.785673:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.785678:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986485.785683:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986485.785686:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986485.785690:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490f9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986485.785692:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549100 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986485.785700:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986485.785701:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:1.0:1788986485.785704:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788986485.785707:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549100 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.785709:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490f9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986485.785715:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549100 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x49:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.785716:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5490f9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x49:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986485.785737:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x49:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:0.0:1788986485.785739:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788986485.785742:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549100 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986485.785747:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549100 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x49:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986485.785764:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986485.785766:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986485.785768:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986485.786053:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5490eb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.786060:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5490eb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.786065:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5490eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.786070:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986485.786073:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5490eb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.786082:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5490eb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.786122:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:1.0:1788986485.786124:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986485.786127:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5490eb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986485.786132:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5490eb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986485.786142:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000028d9f1f9 reply state 0000000084023365 transno 4294967635 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986485.786150:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986485.786373:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50487:x1875885971336448:12345-192.168.206.21@tcp:36:rm.0 Request processed in 2811us (3035us total) trans 4294967635 rc 0/0 00000100:00100000:1.0:1788986485.786382:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 894 00010000:00010000:3.0:1788986485.793967:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.793983:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490f2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.793991:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.793998:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986485.794003:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.794011:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490f2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.794025:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a45316400) 00010000:00010000:3.0:1788986485.794028:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986485.794033:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490f2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986485.794038:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5490f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986485.873961:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986485.874055:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986485.874182:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971336576 00000100:00100000:2.0:1788986485.874198:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971336576 00000100:00100000:2.0:1788986485.874256:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1269 00000100:00100000:2.0:1788986485.874266:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971336576:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986485.874343:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971336576:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 78us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986485.874350:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1269 00000100:00100000:0.0:1788986485.874866:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971336704 00000100:00100000:0.0:1788986485.874873:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971336704 00000100:00100000:0.0:1788986485.874939:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1183 00000100:00100000:0.0:1788986485.874949:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971336704:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986485.874986:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971336704:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986485.874992:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1183 00000100:00080000:1.0:1788986485.875054:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986486.599946:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986486.600069:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971336832 00000100:00100000:1.0:1788986486.600079:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971336832 00000100:00100000:1.0:1788986486.600157:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 895 00000100:00100000:1.0:1788986486.600167:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50502:x1875885971336832:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986486.600189:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986486.600209:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549107 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1322 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.600266:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54910e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.600281:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54910e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.600294:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54910e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986486.600325:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:1.0:1788986486.600329:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986486.600345:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54910e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.600367:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549107 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1322 expref: 13 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.600384:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54910e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1322 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.600392:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:1.0:1788986486.600395:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986486.600398:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788986486.600445:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50502:x1875885971336832:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 280us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986486.600453:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 895 00000100:00080000:2.0:1788986486.600577:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986486.609571:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986486.609662:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971337088 00000100:00100000:2.0:1788986486.609672:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971337088 00000100:00100000:2.0:1788986486.609772:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 896 00000100:00100000:2.0:1788986486.609783:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50502:x1875885971337088:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986486.609834:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986486.609860:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54910e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1322 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.609880:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549090 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12ff expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.609890:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:2.0:1788986486.609910:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986486.609933:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549115 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.609946:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.609955:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788986486.668555:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967635 is committed 00000004:00080000:1.0:1788986486.668568:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 76 committed 00000001:00080000:1.0:1788986486.668586:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967636 is committed 00000100:00100000:0.0:1788986486.668730:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993543808:0@lo:6:osp-syn-1-0.0 00000004:00010000:2.0:1788986486.669484:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000622af62e reply state 0000000031945fbe transno 4294967636 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986486.669497:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986486.669513:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00010000:00080000:2.0:1788986486.669639:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788986486.669662:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50502:x1875885971337088:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 59879us (60095us total) trans 4294967636 rc 0/0 00000100:00100000:2.0:1788986486.669671:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 896 00010000:00010000:1.0:1788986486.669691:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549115 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.669705:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549115 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.669724:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549115 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.669730:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986486.669734:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549115 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.669742:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549115 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.669756:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:1.0:1788986486.669758:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986486.669763:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549115 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.669770:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549115 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986486.670618:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986486.670694:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993543808 00000100:00100000:1.0:1788986486.670702:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993543808 00000100:00100000:1.0:1788986486.670772:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1788986486.670780:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993543808:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788986486.670807:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:28 count 1 00010000:00010000:1.0:1788986486.670831:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.670850:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf5490e4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d131b expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.670859:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788986486.670863:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986486.670868:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788986486.670877:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788986486.670900:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf5490e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d131b expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.671281:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf5490e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d131b expref: 6 pid: 6698 timeout: 2370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986486.671297:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875885993543936:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986486.671355:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a75d74cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788986486.687607:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986486.687659:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b41180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875885993543936:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788986486.687683:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986486.687723:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971337216 00000100:00100000:0.0:1788986486.687729:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971337216 00010000:00010000:0.0:1788986486.687762:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf5490e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d131b expref: 7 pid: 6698 timeout: 2370 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986486.687806:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 398 00000100:00100000:0.0:1788986486.687816:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971337216:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986486.687829:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986486.687835:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf5490e4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d131b expref: 7 pid: 6698 timeout: 2370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.687847:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf5490e4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d131b expref: 7 pid: 6698 timeout: 2370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.687871:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf5490e4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x1c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d131b expref: 7 pid: 6698 timeout: 2370 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.687885:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986486.687890:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986486.687895:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.687904:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.687925:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986486.687971:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971337216:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 156us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986486.687978:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 398 00010000:00010000:0.0:1788986486.688003:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.688012:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.688022:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.688030:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.688057:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788986486.688738:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993543808:12345-0@lo:6:osp-syn-1-0.0 Request processed in 17958us (18122us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788986486.688747:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00010000:00010000:0.0:1788986486.688770:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986486.688777:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.688855:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986486.688860:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.688870:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.688884:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.688891:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54911c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986486.688910:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986486.688912:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986486.688914:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788986486.688944:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a80b41500/2, rc 0, transno 4294967353 00000100:00100000:0.0:1788986486.688950:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993543808:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1788986486.720313:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986486.749373:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986486.750421:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971337344 00000100:00100000:1.0:1788986486.750431:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971337344 00000100:00100000:1.0:1788986486.750484:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 897 00000100:00100000:1.0:1788986486.750494:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50506:x1875885971337344:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986486.750516:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986486.750536:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549123 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1329 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.750589:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54912a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.750601:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54912a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.750611:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54912a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.750624:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549131 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.750631:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.750637:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.750910:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549138 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.750919:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.750926:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986486.750951:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:1.0:1788986486.750954:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986486.750972:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549138 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.750984:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54912a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.750990:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54912a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751000:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54912a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751006:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986486.751010:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54912a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751017:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54912a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751028:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:1.0:1788986486.751031:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986486.751035:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54912a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751041:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54912a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751053:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549131 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751060:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549131 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751066:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751070:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986486.751073:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549131 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751083:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549131 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751129:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a45316c00) 00010000:00010000:1.0:1788986486.751132:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986486.751135:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549131 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751141:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549131 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751168:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549123 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1329 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751181:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549138 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1329 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.751188:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:1.0:1788986486.751190:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986486.751192:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788986486.751245:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50506:x1875885971337344:12345-192.168.206.21@tcp:101:touch.0 Request processed in 752us (1881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986486.751252:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 897 00000100:00100000:0.0:1788986486.763561:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986486.763647:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971337600 00000100:00100000:2.0:1788986486.763656:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971337600 00000100:00100000:2.0:1788986486.763705:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 898 00000100:00100000:2.0:1788986486.763723:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50506:x1875885971337600:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986486.763743:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986486.763763:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54913f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1330 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.764010:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549146 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.764026:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549146 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.764037:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549146 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.764059:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54914d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.764066:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54914d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.764073:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54914d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986486.764677:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1d:0x0], index 0: 0 00010000:00010000:2.0:1788986486.765000:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549154 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.765011:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.765019:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549154 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.765181:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549146 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.765188:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549146 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.765198:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549146 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.765204:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986486.765208:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549146 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.765214:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549146 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.765223:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:2.0:1788986486.765226:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986486.765230:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549146 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.765237:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549146 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986486.765247:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009f558cb3 reply state 00000000c0c552b5 transno 4294967637 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54914d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986486.765254:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986486.765278:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54913f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1330 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.765289:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549154 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1330 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.765296:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:2.0:1788986486.765298:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986486.765300:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1e00, rc 0) 00000100:00100000:2.0:1788986486.765669:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50506:x1875885971337600:12345-192.168.206.21@tcp:101:touch.0 Request processed in 1954us (2113us total) trans 4294967637 rc 0/0 00000100:00100000:2.0:1788986486.766357:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 898 00010000:00010000:1.0:1788986486.768549:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54914d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.768564:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54914d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.768576:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54914d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.768583:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986486.768587:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54914d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.768595:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54914d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.768611:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a45acaf00) 00010000:00010000:1.0:1788986486.768614:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986486.768618:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54914d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.768625:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54914d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986486.770501:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986486.770565:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971337856 00000100:00100000:2.0:1788986486.770574:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971337856 00000100:00100000:2.0:1788986486.770624:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 899 00000100:00100000:2.0:1788986486.770633:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:50506:x1875885971337856:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:2.0:1788986486.770680:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986486.770702:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549154 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1330 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.770737:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:2.0:1788986486.770746:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986486.770780:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549162 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.770793:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549162 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.770801:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549162 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986486.770907:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000edbe178b reply state 00000000e36c81b5 transno 4294967638 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549162 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986486.770916:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986486.770997:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50506:x1875885971337856:12345-192.168.206.21@tcp:36:touch.0 Request processed in 364us (502us total) trans 4294967638 rc 0/0 00000100:00100000:2.0:1788986486.771003:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 899 00000100:00100000:0.0:1788986486.773384:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986486.773496:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971337984 00000100:00100000:3.0:1788986486.773506:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971337984 00000100:00100000:3.0:1788986486.773613:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 900 00000100:00100000:3.0:1788986486.773624:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50506:x1875885971337984:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:3.0:1788986486.773664:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986486.773683:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549169 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1337 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.773748:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549169 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1337 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.773766:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549169 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1337 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.773797:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:3.0:1788986486.773801:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788986486.773804:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986486.773870:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50506:x1875885971337984:12345-192.168.206.21@tcp:101:touch.0 Request processed in 240us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986486.773878:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 900 00010000:00010000:2.0:1788986486.777561:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549162 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.777578:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549162 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.777655:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549162 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.777662:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986486.777666:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549162 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.777675:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549162 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.777693:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:2.0:1788986486.777696:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986486.777700:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549162 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.777706:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549162 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986486.788559:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986486.788701:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971338112 00000100:00100000:1.0:1788986486.788720:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971338112 00000100:00100000:1.0:1788986486.788777:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 486 00000100:00100000:1.0:1788986486.788787:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971338112:12345-192.168.206.21@tcp:2:touch.0 00000100:00100000:1.0:1788986486.789221:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971338112:12345-192.168.206.21@tcp:2:touch.0 Request processed in 435us (667us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788986486.789229:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 486 00000100:00100000:0.0:1788986486.799742:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986486.799780:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971338368 00000100:00100000:0.0:1788986486.799789:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971338368 00000100:00100000:0.0:1788986486.799837:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 90 00000100:00100000:0.0:1788986486.799847:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50506:x1875885971338368:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:0.0:1788986486.800208:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50506:x1875885971338368:12345-192.168.206.21@tcp:35:touch.0 Request processed in 361us (476us total) trans 4294967639 rc 0/0 00000100:00100000:0.0:1788986486.800216:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 90 00000001:00080000:2.0:1788986486.835211:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967353 is committed 00000001:00080000:2.0:1788986486.842684:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967352 is committed 00000100:00100000:2.0:1788986486.862790:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986486.862925:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971338496 00000100:00100000:3.0:1788986486.862934:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971338496 00000100:00100000:3.0:1788986486.862983:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 901 00000100:00100000:3.0:1788986486.862993:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50510:x1875885971338496:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986486.863016:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986486.863040:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549170 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d133e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863132:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549177 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863146:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549177 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863157:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549177 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863171:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54917e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863179:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54917e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863185:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54917e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863270:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549185 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863278:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863286:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986486.863316:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4a:0x0]: returning size 0 00000004:00200000:3.0:1788986486.863320:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986486.863338:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863349:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549185 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863356:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549177 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863363:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549177 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863370:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549177 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863381:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986486.863385:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549177 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863393:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549177 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863405:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:3.0:1788986486.863408:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986486.863412:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549177 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863419:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549177 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863431:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54917e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863437:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54917e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863442:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54917e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863447:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986486.863450:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54917e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863456:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54917e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863467:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a55745b00) 00010000:00010000:3.0:1788986486.863470:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986486.863473:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54917e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863479:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54917e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863508:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549170 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d133e expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863521:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549185 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d133e expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.863528:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:3.0:1788986486.863531:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788986486.863533:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3800, rc 0) 00000100:00100000:3.0:1788986486.863582:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50510:x1875885971338496:12345-192.168.206.21@tcp:101:rm.0 Request processed in 591us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986486.863590:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 901 00000100:00100000:0.0:1788986486.868812:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986486.868899:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971338624 00000100:00100000:2.0:1788986486.868908:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971338624 00000100:00100000:2.0:1788986486.868997:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 487 00000100:00100000:2.0:1788986486.869007:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971338624:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986486.869028:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986486.869047:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54918c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1345 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788986486.869072:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x6aa1c476, atime: 0x6aa1c476, ctime: 0x6aa1c476, blocks: 0x1 00010000:00010000:2.0:1788986486.869125:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=2270s v=(0 0) 00010000:00010000:2.0:1788986486.869130:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986486.869139:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54918c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1345 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.869165:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54918c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1345 expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.869177:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:1.0:1788986486.869295:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971338624:12345-192.168.206.21@tcp:101:rm.0 Request processed in 287us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986486.869303:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 487 00000100:00100000:0.0:1788986486.874554:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986486.875923:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971338880 00000100:00100000:2.0:1788986486.875937:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971338880 00000100:00100000:2.0:1788986486.876001:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 902 00000100:00100000:2.0:1788986486.876011:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50510:x1875885971338880:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:2.0:1788986486.876056:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986486.876079:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549185 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4a:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d133e expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876141:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549169 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1337 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876152:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:2.0:1788986486.876161:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986486.876182:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549193 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876195:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549193 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876204:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549193 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876217:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54919a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876224:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54919a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876230:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54919a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876314:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491a1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876323:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876329:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986486.876827:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].29, 64 off10048 00000004:00080000:2.0:1788986486.876837:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2270779747393ns, next at 2271779745153ns, rc = 0 00010000:00010000:2.0:1788986486.876891:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5491a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876901:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5491a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876909:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5491a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876916:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5491a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876922:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5491a8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876933:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5491a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876953:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986486.876974:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491a1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876980:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491a1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876986:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.876991:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986486.876994:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986486.876996:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491a1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.877000:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5491a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.877002:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491a1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.877006:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986486.877009:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5491a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.877012:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986486.877015:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986486.877019:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491a1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.877141:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491a1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4a:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.877158:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549193 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.877163:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549193 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.877170:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549193 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.877176:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986486.877179:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549193 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.877186:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549193 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.877194:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:2.0:1788986486.877197:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986486.877200:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549193 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986486.877205:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549193 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986486.877216:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ada99fa1 reply state 0000000036c2456f transno 4294967640 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54919a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986486.877224:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986486.877383:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50510:x1875885971338880:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1369us (2835us total) trans 4294967640 rc 0/0 00000100:00100000:3.0:1788986486.877391:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 902 00010000:00010000:3.0:1788986486.879010:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54919a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.879024:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54919a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.879036:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54919a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.879042:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986486.879047:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54919a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.879054:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54919a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.879068:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a45acab00) 00010000:00010000:3.0:1788986486.879071:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986486.879076:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54919a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986486.879082:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54919a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.880112:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5491a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.880135:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4a:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:1.0:1788986486.880137:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788986486.880142:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5491a8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.880149:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5491a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4a:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986486.880168:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986486.880170:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986486.880172:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986487.744531:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986487.808556:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993544064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986487.808641:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986487.808731:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993544064 00000100:00100000:1.0:1788986487.808739:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993544064 00000100:00100000:1.0:1788986487.808806:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 814 00000100:00100000:1.0:1788986487.808815:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993544064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986487.808846:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986487.809270:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993544064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 454us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986487.809279:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 814 00000100:00080000:1.0:1788986487.809304:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986487.809376:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993544064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986487.819882:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986487.827629:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971339008 00000100:00100000:1.0:1788986487.827643:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971339008 00000100:00100000:1.0:1788986487.827702:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 903 00000100:00100000:1.0:1788986487.827723:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50525:x1875885971339008:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986487.827747:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986487.827768:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d134c expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986487.827837:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5491b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986487.827850:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5491b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986487.827861:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5491b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986487.827894:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:1.0:1788986487.827897:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986487.827913:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5491b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986487.827935:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d134c expref: 13 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986487.827954:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5491b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d134c expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986487.827962:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:1.0:1788986487.827965:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986487.827969:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00100000:1.0:1788986487.828026:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50525:x1875885971339008:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 305us (8155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986487.828033:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 903 00000100:00100000:0.0:1788986487.842064:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986487.855016:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971339264 00000100:00100000:1.0:1788986487.855029:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971339264 00000100:00100000:1.0:1788986487.855114:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 904 00000100:00100000:1.0:1788986487.855125:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50525:x1875885971339264:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986487.855187:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986487.855212:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5491b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d134c expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986487.855230:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549138 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1329 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986487.855240:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:1.0:1788986487.855250:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986487.855273:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986487.855285:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986487.855293:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986487.855510:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009d00761b reply state 0000000065e9d5f7 transno 4294967641 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986487.855519:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986487.855534:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000100:00100000:1.0:1788986487.855615:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50525:x1875885971339264:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 492us (13559us total) trans 4294967641 rc 0/0 00000100:00100000:1.0:1788986487.855621:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 904 00010000:00010000:3.0:1788986487.857255:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986487.857269:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986487.857276:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986487.857282:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986487.857286:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986487.857293:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986487.857305:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:3.0:1788986487.857308:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986487.857311:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986487.857316:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5491bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986488.018060:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986488.018207:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971339392 00000100:00100000:3.0:1788986488.018217:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971339392 00000100:00100000:3.0:1788986488.018318:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 905 00000100:00100000:3.0:1788986488.018328:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50537:x1875885971339392:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986488.018414:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50537:x1875885971339392:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 87us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986488.018420:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 905 00000100:00100000:0.0:1788986488.020192:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986488.020264:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971339520 00000100:00100000:3.0:1788986488.020271:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971339520 00000100:00080000:1.0:1788986488.020324:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986488.020329:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986488.020547:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 488 00000100:00100000:3.0:1788986488.020557:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a76788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50537:x1875885971339520:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986488.020891:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a76788050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50537:x1875885971339520:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 335us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986488.020898:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 488 00000100:00100000:0.0:1788986488.023900:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986488.023993:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971339648 00000100:00100000:2.0:1788986488.024002:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971339648 00000100:00100000:2.0:1788986488.024069:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 489 00000100:00100000:2.0:1788986488.024079:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50537:x1875885971339648:12345-192.168.206.21@tcp:19:lfs.0 00000100:00080000:1.0:1788986488.024260:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986488.024967:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50537:x1875885971339648:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 886us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986488.024988:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 489 00000100:00100000:2.0:1788986488.033785:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986488.036497:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971339776 00000100:00100000:1.0:1788986488.036509:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971339776 00000100:00100000:1.0:1788986488.036632:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 906 00000100:00100000:1.0:1788986488.036642:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50537:x1875885971339776:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986488.037075:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50537:x1875885971339776:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 432us (3296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986488.037083:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 906 00000100:00100000:0.0:1788986488.046082:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986488.046226:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971339904 00000100:00100000:2.0:1788986488.046235:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971339904 00000100:00100000:2.0:1788986488.046326:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 907 00000100:00100000:2.0:1788986488.046335:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50537:x1875885971339904:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986488.046432:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50537:x1875885971339904:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 98us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986488.046438:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 907 00000100:00100000:0.0:1788986488.049153:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986488.049522:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971340032 00000100:00100000:1.0:1788986488.049530:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971340032 00000100:00100000:1.0:1788986488.049596:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 490 00000100:00100000:1.0:1788986488.049606:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50537:x1875885971340032:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986488.050517:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50537:x1875885971340032:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 909us (1367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986488.050527:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 490 00000100:00100000:0.0:1788986488.052912:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986488.053060:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971340160 00000100:00100000:3.0:1788986488.053068:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971340160 00000100:00100000:2.0:1788986488.053299:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 491 00000100:00100000:2.0:1788986488.053310:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50537:x1875885971340160:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986488.053834:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50537:x1875885971340160:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 525us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986488.053842:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 491 00000100:00100000:0.0:1788986488.056277:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986488.056359:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971340288 00000100:00100000:2.0:1788986488.056367:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971340288 00000100:00100000:2.0:1788986488.056500:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 908 00000100:00100000:2.0:1788986488.056509:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50537:x1875885971340288:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986488.056871:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50537:x1875885971340288:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 362us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986488.056878:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 908 00000100:00100000:0.0:1788986488.143076:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986488.143189:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971340416 00000100:00100000:1.0:1788986488.143199:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971340416 00000100:00100000:1.0:1788986488.143253:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 909 00000100:00100000:1.0:1788986488.143263:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50541:x1875885971340416:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:1.0:1788986488.143282:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986488.143301:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5491c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1353 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143355:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5491cb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143369:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5491cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143393:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5491cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143409:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5491d2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143417:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5491d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143423:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5491d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143661:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5491d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143670:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5491d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143678:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5491d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986488.143718:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:1.0:1788986488.143721:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986488.143741:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5491d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143757:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5491cb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143763:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5491cb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143769:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5491cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143775:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986488.143780:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5491cb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143787:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5491cb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143799:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:1.0:1788986488.143802:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986488.143806:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5491cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143813:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5491cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143826:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5491d2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143833:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5491d2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143838:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5491d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143843:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986488.143846:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5491d2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143852:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5491d2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143859:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a45316000) 00010000:00010000:1.0:1788986488.143861:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986488.143864:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5491d2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143870:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5491d2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143898:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5491c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1353 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143912:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5491d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1353 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.143920:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788986488.143922:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986488.143924:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986488.143981:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50541:x1875885971340416:12345-192.168.206.21@tcp:101:dd.0 Request processed in 719us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986488.143989:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 909 00000100:00100000:0.0:1788986488.149240:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986488.149411:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971340672 00000100:00100000:2.0:1788986488.149420:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971340672 00000100:00100000:2.0:1788986488.149510:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 910 00000100:00100000:2.0:1788986488.149520:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:50541:x1875885971340672:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788986488.149540:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986488.149558:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5491e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d135a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.149685:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5491e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.149699:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5491e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.149721:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5491e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.149735:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.149742:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.149748:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986488.150698:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1d:0x0], index 1: 0 00010000:00010000:2.0:1788986488.150888:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5491f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.150900:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5491f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.150909:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5491f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.150947:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5491e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.150954:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5491e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.150961:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5491e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.150968:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986488.150984:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5491e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.150992:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5491e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.151003:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:2.0:1788986488.151006:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986488.151011:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5491e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.151017:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5491e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986488.151031:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003f41f2c8 reply state 00000000255dfe06 transno 4294967642 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986488.151040:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986488.151071:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf5491e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d135a expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.151135:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5491f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d135a expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986488.151142:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:2.0:1788986488.151145:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986488.151147:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0400, rc 0) 00000100:00100000:2.0:1788986488.151756:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+15:50541:x1875885971340672:12345-192.168.206.21@tcp:101:dd.0 Request processed in 2236us (2522us total) trans 4294967642 rc 0/0 00000100:00100000:2.0:1788986488.151763:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 910 00010000:00010000:3.0:1788986488.160280:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986488.160295:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986488.160302:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986488.160308:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986488.160312:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986488.160319:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986488.160334:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a45aca600) 00010000:00010000:3.0:1788986488.160337:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986488.160341:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986488.160347:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5491ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986488.161480:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986488.161544:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971340800 00000100:00100000:3.0:1788986488.161552:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971340800 00000100:00100000:3.0:1788986488.161613:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 492 00000100:00100000:3.0:1788986488.161624:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50541:x1875885971340800:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:3.0:1788986488.161640:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986488.161658:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf549203 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1361 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788986488.161687:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788986488.161717:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=2272s v=(0 0) 00010000:00010000:3.0:1788986488.161722:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986488.161733:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf549203 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1361 expref: 6 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986488.161749:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf549203 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1361 expref: 6 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986488.161761:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986488.161818:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50541:x1875885971340800:12345-192.168.206.21@tcp:101:dd.0 Request processed in 196us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986488.161825:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 492 00000100:00100000:0.0:1788986488.181340:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986488.181424:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971340928 00000100:00100000:2.0:1788986488.181432:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971340928 00002000:00100000:2.0:1788986488.181477:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff9b0a7f5f0700 x1875885971340928/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:409/0 lens 488/0 e 0 to 0 dl 1788986499 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788986488.181487:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a7f5f0700 with x1875885971340928 ext(0->1048575) 00002000:00010000:2.0:1788986488.181492:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a7f5f0700 00000100:00100000:2.0:1788986488.181520:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:2.0:1788986488.181528:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971340928:12345-192.168.206.21@tcp:4:dd.0 00000100:00100000:2.0:1788986488.210844:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971340928:12345-192.168.206.21@tcp:4:dd.0 Request processed in 27102us (27297us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1788986488.210869:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00002000:00100000:2.0:1788986488.210883:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1d:0x0] (0->1048575) req@ffff9b0a7f5f0700 x1875885971340928/t4294967354(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:409/0 lens 488/448 e 0 to 0 dl 1788986499 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788986488.210893:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a7f5f0700 with x1875885971340928 ext(0->1048575) 00002000:00010000:2.0:1788986488.210900:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a7f5f0700 00000100:00100000:1.0:1788986488.216302:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986488.216432:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971341056 00000100:00100000:2.0:1788986488.216441:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971341056 00000100:00100000:2.0:1788986488.216495:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 911 00000100:00100000:2.0:1788986488.216504:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+14:50541:x1875885971341056:12345-192.168.206.21@tcp:44:dd.0 00000001:00080000:1.0:1788986488.292939:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967639 is committed 00000100:00100000:2.0:1788986488.292953:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+13:50541:x1875885971341056:12345-192.168.206.21@tcp:44:dd.0 Request processed in 76444us (76653us total) trans 0 rc 0/0 00000001:00080000:1.0:1788986488.292957:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967641 is committed 00000100:00100000:2.0:1788986488.292963:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 911 00000001:00080000:1.0:1788986488.292964:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967642 is committed 00000004:00080000:1.0:1788986488.292971:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 76 committed 00000100:00100000:0.0:1788986488.293339:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993544192:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788986488.293387:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986488.293520:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993544192 00000100:00100000:1.0:1788986488.293527:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993544192 00000100:00100000:1.0:1788986488.293853:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1788986488.293863:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993544192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788986488.293891:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:29 count 1 00010000:00010000:1.0:1788986488.293913:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.293932:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54918c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1345 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.293940:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788986488.293944:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986488.293948:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.293973:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54918c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1345 expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.293986:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54918c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1345 expref: 6 pid: 6698 timeout: 2372 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986488.293997:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875885993544320:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986488.294063:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a432fcf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788986488.301075:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875885993544320:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788986488.301141:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986488.305330:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986488.305626:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971341184 00000100:00100000:3.0:1788986488.305636:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971341184 00000100:00100000:3.0:1788986488.305799:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 494 00000100:00100000:3.0:1788986488.305809:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971341184:12345-192.168.206.21@tcp:16:dd.0 00000100:00100000:3.0:1788986488.308571:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986488.308775:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971341312 00000100:00100000:0.0:1788986488.308784:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971341312 00010000:00010000:0.0:1788986488.308821:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54918c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1345 expref: 7 pid: 6698 timeout: 2372 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986488.308861:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 399 00000100:00100000:0.0:1788986488.308870:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971341312:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986488.308885:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986488.308891:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54918c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1345 expref: 7 pid: 6698 timeout: 2372 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986488.308905:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54918c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1345 expref: 7 pid: 6698 timeout: 2372 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986488.308935:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54918c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1345 expref: 7 pid: 6698 timeout: 2372 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986488.308951:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986488.308955:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986488.308960:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986488.308969:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986488.309004:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986488.309053:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971341312:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 184us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986488.309060:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 399 00010000:00010000:1.0:1788986488.309198:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.309210:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.309220:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.309228:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986488.309246:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788986488.309775:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993544192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 15912us (16386us total) trans 4294967355 rc 0/0 00000100:00100000:1.0:1788986488.309784:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000004:00080000:1.0:1788986488.309830:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a80b42300/2, rc 0, transno 4294967355 00000100:00100000:1.0:1788986488.309836:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993544192:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788986488.310345:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986488.310353:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986488.310363:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986488.310368:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986488.310378:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986488.310400:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986488.310408:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54920a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986488.310429:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986488.310431:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986488.310482:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986488.386989:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971341184:12345-192.168.206.21@tcp:16:dd.0 Request processed in 81170us (81657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986488.387002:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 494 00000001:00080000:2.0:1788986488.387040:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967354 is committed 00000100:00100000:3.0:1788986488.396016:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986488.396115:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971341568 00000100:00100000:0.0:1788986488.396125:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971341568 00000100:00100000:0.0:1788986488.396190:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 91 00000100:00100000:0.0:1788986488.396200:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50541:x1875885971341568:12345-192.168.206.21@tcp:35:dd.0 00000001:00080000:0.0:1788986488.396563:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967643 00000100:00100000:0.0:1788986488.396670:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50541:x1875885971341568:12345-192.168.206.21@tcp:35:dd.0 Request processed in 470us (661us total) trans 4294967644 rc 0/0 00000100:00100000:0.0:1788986488.396678:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 91 00000020:00080000:0.0:1788986488.396682:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788986488.769024:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986488.833057:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993544576:0@lo:400:kworker.0 00000100:00100000:0.0:1788986488.833184:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986488.833240:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788986488.833247:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993544448:0@lo:400:kworker.0 00000100:00100000:0.0:1788986488.833276:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986488.833300:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993544960:0@lo:400:kworker.0 00000100:00100000:0.0:1788986488.833323:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986488.833357:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993544448 00000100:00100000:0.0:1788986488.833363:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993544448 00000100:00100000:0.0:1788986488.833418:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1788986488.833426:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993544448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986488.833471:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993544448:12345-0@lo:400:kworker.0 Request processed in 46us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986488.833478:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1270 00000100:00100000:0.0:1788986488.833530:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993544960 00000100:00100000:0.0:1788986488.833534:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993544960 00000100:00100000:0.0:1788986488.833565:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1184 00000100:00100000:0.0:1788986488.833571:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993544960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986488.833599:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993544960:12345-0@lo:400:kworker.0 Request processed in 29us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986488.833604:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1184 00000100:00100000:0.0:1788986488.833633:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993544448:0@lo:400:kworker.0 00000100:00100000:0.0:1788986488.833643:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967353 gen 2 00000100:00100000:2.0:1788986488.833876:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993544704:0@lo:400:kworker.0 00000100:00100000:2.0:1788986488.833914:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986488.833950:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986488.833960:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993544832:0@lo:400:kworker.0 00000100:00100000:2.0:1788986488.833988:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986488.834062:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993544576 00000100:00100000:2.0:1788986488.834068:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993544576 00000100:00100000:2.0:1788986488.834110:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993544704 00000100:00100000:2.0:1788986488.834112:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993544704 00000100:00100000:2.0:1788986488.834133:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993544832 00000100:00100000:2.0:1788986488.834136:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993544832 00000100:00100000:2.0:1788986488.834150:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:2.0:1788986488.834156:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993544576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986488.834191:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993544576:12345-0@lo:400:kworker.0 Request processed in 35us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986488.834197:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000100:00100000:2.0:1788986488.834211:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1606 00000100:00100000:2.0:1788986488.834217:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993544704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986488.834247:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993544704:12345-0@lo:400:kworker.0 Request processed in 31us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986488.834252:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1606 00000100:00100000:2.0:1788986488.834263:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607 00000100:00100000:2.0:1788986488.834269:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993544832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986488.834292:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993544832:12345-0@lo:400:kworker.0 Request processed in 23us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986488.834297:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607 00000100:00100000:2.0:1788986488.834333:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993544832:0@lo:400:kworker.0 00000100:00100000:2.0:1788986488.834342:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993544704:0@lo:400:kworker.0 00000100:00080000:1.0:1788986488.835407:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986488.835415:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788986488.835486:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a80b41500, transno 4294967353 00000100:00100000:0.0:1788986488.835512:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993544960:0@lo:400:kworker.0 00000100:00100000:0.0:1788986488.835540:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993544576:0@lo:400:kworker.0 00000100:00100000:0.0:1788986489.344251:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993545088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986489.344313:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986489.344429:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993545088 00000100:00100000:3.0:1788986489.344437:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993545088 00000100:00100000:3.0:1788986489.344487:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 815 00000100:00100000:3.0:1788986489.344497:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993545088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986489.344517:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788986489.344670:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993545088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986489.344678:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 815 00000100:00100000:0.0:1788986489.344754:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993545088:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788986489.643142:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967644 is committed 00010000:00010000:2.0:1788986489.797738:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788986490.714954:0:86058:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2274617861704ns, next at 2271779745153ns, rc = 0 00000004:00080000:2.0:1788986490.715053:0:86058:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2274617963382ns, next at 2270688362364ns, rc = 0 00000004:00080000:3.0:1788986490.717014:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 77 committed 00000004:00080000:3.0:1788986490.717067:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 77 committed 00010000:00010000:2.0:1788986490.816367:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986490.996863:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986490.996914:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986490.996957:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986490.997006:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971342080 00000100:00100000:2.0:1788986490.997007:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971341696 00000100:00100000:2.0:1788986490.997018:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971341696 00000100:00100000:0.0:1788986490.997019:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971342080 00000100:00100000:0.0:1788986490.997082:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1185 00000100:00100000:2.0:1788986490.997112:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1271 00000100:00100000:0.0:1788986490.997124:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971342080:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986490.997125:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971341696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986490.997212:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971342080:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 121us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986490.997220:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1185 00000100:00080000:0.0:1788986490.997258:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986490.997366:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971341696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 245us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986490.997373:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1271 00000100:00100000:3.0:1788986490.998064:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971341824 00000100:00100000:3.0:1788986490.998071:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971341824 00000100:00080000:0.0:1788986490.999334:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986491.000969:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1608 00000100:00100000:3.0:1788986491.000990:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971341824:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986491.001108:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971341824:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 108us (4175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986491.001117:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1608 00000100:00100000:3.0:1788986491.002554:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986491.002850:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971341952 00000100:00100000:0.0:1788986491.002861:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971341952 00000100:00100000:0.0:1788986491.002979:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1186 00000100:00100000:0.0:1788986491.002990:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971341952:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986491.003062:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971341952:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 75us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986491.003069:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1186 00000100:00080000:1.0:1788986491.003136:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986491.843261:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986491.972827:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967355 is committed 00000001:00080000:3.0:1788986491.972853:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967354 is committed 00000100:00100000:2.0:1788986492.106471:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986492.106627:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971342208 00000100:00100000:0.0:1788986492.106640:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971342208 00000100:00100000:0.0:1788986492.106746:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 912 00000100:00100000:0.0:1788986492.106759:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50733:x1875885971342208:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986492.106883:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50733:x1875885971342208:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 126us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986492.106891:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 912 00000100:00080000:1.0:1788986492.106965:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986492.114083:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986492.114252:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971342336 00000100:00100000:1.0:1788986492.114270:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971342336 00000100:00100000:1.0:1788986492.114352:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 495 00000100:00100000:1.0:1788986492.114365:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50733:x1875885971342336:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986492.114873:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50733:x1875885971342336:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 509us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986492.114882:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 495 00000100:00100000:3.0:1788986492.117114:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986492.117177:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971342464 00000100:00100000:2.0:1788986492.117190:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971342464 00000100:00100000:2.0:1788986492.117269:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 496 00000100:00100000:2.0:1788986492.117282:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50733:x1875885971342464:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986492.117702:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50733:x1875885971342464:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 421us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986492.117711:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 496 00000100:00080000:1.0:1788986492.117806:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986492.119031:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986492.125268:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971342592 00000100:00100000:1.0:1788986492.125290:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971342592 00000100:00100000:1.0:1788986492.125408:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 913 00000100:00100000:1.0:1788986492.125422:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50733:x1875885971342592:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986492.125957:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50733:x1875885971342592:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 537us (6929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986492.125966:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 913 00000100:00100000:3.0:1788986492.131244:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986492.131469:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971342720 00000100:00100000:0.0:1788986492.131486:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971342720 00000100:00100000:0.0:1788986492.131572:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 914 00000100:00100000:0.0:1788986492.131585:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50733:x1875885971342720:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986492.131763:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50733:x1875885971342720:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 179us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986492.131772:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 914 00000100:00100000:3.0:1788986492.139320:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986492.139508:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971342848 00000100:00100000:1.0:1788986492.139521:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971342848 00000100:00100000:1.0:1788986492.139613:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 497 00000100:00100000:1.0:1788986492.139626:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50733:x1875885971342848:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986492.140172:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50733:x1875885971342848:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 546us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986492.140181:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 497 00000100:00100000:3.0:1788986492.144803:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986492.144887:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971342976 00000100:00100000:0.0:1788986492.144902:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971342976 00000100:00100000:0.0:1788986492.145024:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 498 00000100:00100000:0.0:1788986492.145037:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50733:x1875885971342976:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986492.145476:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50733:x1875885971342976:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 441us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986492.145486:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 498 00000100:00100000:3.0:1788986492.162292:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986492.162338:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971343104 00000100:00100000:3.0:1788986492.162348:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971343104 00000100:00100000:3.0:1788986492.162412:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 915 00000100:00100000:3.0:1788986492.162428:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50733:x1875885971343104:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986492.163594:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50733:x1875885971343104:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 1169us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986492.163606:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 915 00000100:00100000:2.0:1788986492.234309:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986492.234414:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971343360 00000100:00100000:1.0:1788986492.234423:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971343360 00000100:00100000:1.0:1788986492.234480:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 916 00000100:00100000:1.0:1788986492.234490:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50737:x1875885971343360:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788986492.234536:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986492.234565:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5491f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d135a expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.234590:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:1.0:1788986492.234600:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986492.234621:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549211 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.234633:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549211 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.234643:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549211 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.234657:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549218 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.234665:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.234671:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.235017:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54921f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.235027:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54921f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.235034:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54921f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986492.235847:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].29, 64 off10048 00000004:00080000:1.0:1788986492.235857:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2276138767398ns, next at 2277138765068ns, rc = 0 00010000:00010000:1.0:1788986492.235955:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549226 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.235966:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549226 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.235974:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549226 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.235982:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549226 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.235988:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549226 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.235994:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549226 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236019:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986492.236037:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54921f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236044:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54921f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236050:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54921f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236056:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986492.236060:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54921f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236067:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54921f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236077:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:1.0:1788986492.236079:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986492.236083:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54921f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236111:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54921f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236127:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549211 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236134:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549211 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236140:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549211 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236144:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986492.236147:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549211 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236154:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549211 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236161:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788986492.236164:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986492.236166:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549211 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.236172:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549211 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986492.236187:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000df5f83bb reply state 00000000ef208e13 transno 4294967645 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986492.236196:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986492.236268:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:50737:x1875885971343360:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1778us (1965us total) trans 4294967645 rc 0/0 00000100:00100000:1.0:1788986492.236277:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 916 00010000:00010000:2.0:1788986492.238136:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986492.238147:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549226 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986492.238164:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986492.238167:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549226 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986492.238179:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549226 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986492.238193:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4b:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:2.0:1788986492.238195:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788986492.238200:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549226 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986492.238206:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549226 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986492.238230:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986492.238232:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986492.238233:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986492.240078:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549218 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.240293:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549218 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.240302:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549218 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.240308:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986492.240313:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549218 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.240321:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549218 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.240335:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a45316000) 00010000:00010000:1.0:1788986492.240338:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986492.240342:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549218 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986492.240348:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549218 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986492.864319:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986492.928260:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993545216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986492.928319:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986492.928403:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993545216 00000100:00100000:3.0:1788986492.928412:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993545216 00000100:00100000:3.0:1788986492.928497:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 816 00000100:00100000:3.0:1788986492.928510:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993545216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986492.928553:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986492.928614:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993545216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986492.928625:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 816 00000100:00100000:2.0:1788986492.928725:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967355 gen 2 00000004:00080000:2.0:1788986492.928731:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a80b42300, transno 4294967355 00000100:00100000:2.0:1788986492.928759:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993545216:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986492.928824:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986493.902947:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986493.952793:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993545344:0@lo:400:kworker.0 00000100:00100000:3.0:1788986493.952861:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986493.954449:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993545856:0@lo:400:kworker.0 00000100:00100000:1.0:1788986493.954452:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993545728:0@lo:400:kworker.0 00000100:00100000:3.0:1788986493.954497:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986493.954497:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986493.956733:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993545472:0@lo:400:kworker.0 00000100:00100000:3.0:1788986493.956847:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993545344 00000100:00100000:1.0:1788986493.956849:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986493.956855:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993545344 00000100:00100000:1.0:1788986493.956882:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993545984:0@lo:400:kworker.0 00000100:00100000:3.0:1788986493.956907:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:3.0:1788986493.956917:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993545344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986493.956968:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993545344:12345-0@lo:400:kworker.0 Request processed in 52us (4107us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986493.956977:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986493.956982:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:1.0:1788986493.957006:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986493.957017:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993545600:0@lo:400:kworker.0 00000100:00100000:3.0:1788986493.957022:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993545856 00000100:00100000:3.0:1788986493.957027:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993545856 00000100:00100000:1.0:1788986493.957049:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986493.957050:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993545472 00000100:00100000:2.0:1788986493.957056:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993545472 00000100:00100000:1.0:1788986493.957292:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993545728 00000100:00100000:1.0:1788986493.957297:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993545728 00000100:00100000:1.0:1788986493.957515:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993545984 00000100:00100000:1.0:1788986493.957519:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993545984 00000100:00100000:1.0:1788986493.957548:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1788986493.957555:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993545728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986493.957599:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993545728:12345-0@lo:400:kworker.0 Request processed in 43us (3102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986493.957606:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1187 00000100:00100000:1.0:1788986493.957623:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1188 00000100:00100000:1.0:1788986493.957630:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993545984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986493.957664:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993545984:12345-0@lo:400:kworker.0 Request processed in 35us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986493.957781:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1188 00000100:00100000:3.0:1788986493.957859:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993545600 00000100:00100000:3.0:1788986493.957864:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993545600 00000100:00100000:3.0:1788986493.957887:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:3.0:1788986493.957894:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993545856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986493.957928:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993545856:12345-0@lo:400:kworker.0 Request processed in 35us (3432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986493.957935:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00100000:3.0:1788986493.957947:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:3.0:1788986493.957952:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993545472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986493.957976:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993545472:12345-0@lo:400:kworker.0 Request processed in 24us (1128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986493.957982:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:3.0:1788986493.957993:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:3.0:1788986493.957998:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993545600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986493.958020:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993545600:12345-0@lo:400:kworker.0 Request processed in 22us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986493.958025:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00080000:3.0:1788986493.958047:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986493.958052:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986493.961703:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993545856:0@lo:400:kworker.0 00000100:00100000:3.0:1788986493.961739:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993545344:0@lo:400:kworker.0 00000100:00100000:1.0:1788986493.962286:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993545600:0@lo:400:kworker.0 00000100:00100000:1.0:1788986493.962301:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993545472:0@lo:400:kworker.0 00000100:00100000:1.0:1788986493.962384:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993545984:0@lo:400:kworker.0 00000100:00100000:1.0:1788986493.962532:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993545728:0@lo:400:kworker.0 00000004:00080000:2.0:1788986494.017352:0:86204:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2277920259755ns, next at 2271779745153ns, rc = 0 00000004:00080000:2.0:1788986494.017462:0:86204:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2277920371842ns, next at 2277138765068ns, rc = 0 00000001:00080000:2.0:1788986494.047578:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967645 is committed 00000004:00080000:2.0:1788986494.047591:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 78 committed 00000004:00080000:2.0:1788986494.047607:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 78 committed 00000100:00100000:0.0:1788986494.048115:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993546112:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788986494.048190:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986494.048400:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993546112 00000100:00100000:1.0:1788986494.048407:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993546112 00000100:00100000:1.0:1788986494.048458:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1788986494.048467:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993546112:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788986494.048503:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:29 count 1 00010000:00010000:1.0:1788986494.048526:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986494.048554:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf549203 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1361 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986494.048564:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d:0x0].0x0 since=5s v=(0 0) 00010000:00010000:1.0:1788986494.048569:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986494.048573:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986494.048599:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf549203 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1361 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986494.048624:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf549203 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1361 expref: 5 pid: 8478 timeout: 2377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986494.048642:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875885993546240:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986494.049140:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c4f00 going to sleep for 11 seconds 00000004:00080000:2.0:1788986494.050769:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 79 committed 00000100:00100000:1.0:1788986494.051856:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b41880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6697:1875885993546240:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788986494.051894:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986494.052264:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986494.052359:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971343488 00000100:00100000:0.0:1788986494.052366:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971343488 00010000:00010000:0.0:1788986494.052461:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf549203 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1361 expref: 6 pid: 8478 timeout: 2377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986494.052503:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 400 00000100:00100000:0.0:1788986494.052515:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971343488:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986494.052529:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986494.052535:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf549203 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1361 expref: 6 pid: 8478 timeout: 2377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986494.052548:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf549203 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1361 expref: 6 pid: 8478 timeout: 2377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986494.052571:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e36856b6/0xc20d828fcf549203 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1361 expref: 6 pid: 8478 timeout: 2377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986494.052586:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986494.052591:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986494.052596:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986494.052606:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986494.052650:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986494.052692:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986494.052701:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986494.052707:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971343488:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 195us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986494.052714:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 400 00010000:00010000:2.0:1788986494.052717:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986494.052724:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986494.052741:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788986494.052750:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986494.052755:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986494.052762:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986494.052766:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986494.052774:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986494.052790:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986494.052796:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54922d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986494.052813:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986494.052815:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986494.052817:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788986494.053418:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986494.053454:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993546112:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4988us (5263us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788986494.053464:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000004:00080000:0.0:1788986494.053721:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a80b42d80/2, rc 0, transno 4294967355 00000100:00100000:0.0:1788986494.054239:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b42d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993546112:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788986494.464707:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986494.464729:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993546368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986494.464797:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986494.464864:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993546368 00000100:00100000:0.0:1788986494.464871:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993546368 00000100:00100000:0.0:1788986494.464916:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 817 00000100:00100000:0.0:1788986494.464925:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993546368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986494.464958:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788986494.465020:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993546368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986494.465028:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 817 00000100:00100000:0.0:1788986494.465373:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c7b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993546368:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986494.912571:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986495.936377:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986496.116552:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986496.116604:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986496.116643:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986496.116690:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986496.116726:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971343872 00000100:00100000:3.0:1788986496.116737:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971343872 00000100:00100000:3.0:1788986496.116802:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971344000 00000100:00100000:3.0:1788986496.116806:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971344000 00000100:00100000:3.0:1788986496.116829:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1189 00000100:00100000:3.0:1788986496.116840:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971343872:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986496.116930:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971343872:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 91us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986496.116938:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1189 00000100:00100000:3.0:1788986496.116958:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1190 00000100:00100000:3.0:1788986496.116966:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971344000:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986496.116991:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971344000:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986496.116997:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1190 00000100:00100000:0.0:1788986496.117434:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971343744 00000100:00100000:0.0:1788986496.117441:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971343744 00000100:00100000:0.0:1788986496.117490:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1612 00000100:00100000:0.0:1788986496.117499:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971343744:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986496.117551:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971343744:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 54us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986496.117558:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1612 00000100:00080000:0.0:1788986496.117580:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986496.117586:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986496.117589:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986496.117710:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971343616 00000100:00100000:1.0:1788986496.117724:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971343616 00000100:00100000:1.0:1788986496.117799:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1273 00000100:00100000:1.0:1788986496.117809:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971343616:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986496.124313:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971343616:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 6495us (7766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986496.124328:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1273 00010000:00010000:3.0:1788986496.960850:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788986497.067854:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967355 is committed 00010000:00010000:0.0:1788986497.984662:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986498.049252:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993546496:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986498.049356:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986498.049439:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993546496 00000100:00100000:2.0:1788986498.049450:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993546496 00000100:00100000:2.0:1788986498.049539:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 818 00000100:00100000:2.0:1788986498.049551:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993546496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986498.049594:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986498.049674:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993546496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986498.049681:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 818 00000100:00100000:0.0:1788986498.050136:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993546496:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986498.058130:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986499.009243:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986499.072900:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993546624:0@lo:400:kworker.0 00000100:00100000:1.0:1788986499.072972:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986499.073025:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8099b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993547136:0@lo:400:kworker.0 00000100:00100000:1.0:1788986499.073052:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986499.073076:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788986499.073082:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993546752:0@lo:400:kworker.0 00000100:00100000:1.0:1788986499.073137:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986499.073154:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993547264:0@lo:400:kworker.0 00000100:00100000:1.0:1788986499.073175:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986499.073204:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993547136 00000100:00100000:1.0:1788986499.073211:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993547136 00000100:00100000:1.0:1788986499.073258:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993546752 00000100:00100000:1.0:1788986499.073261:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993546752 00000100:00100000:1.0:1788986499.073283:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:1.0:1788986499.073292:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993547136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986499.073343:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993547136:12345-0@lo:400:kworker.0 Request processed in 52us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986499.073350:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00100000:1.0:1788986499.073366:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614 00000100:00100000:1.0:1788986499.073373:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993546752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986499.073399:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993546752:12345-0@lo:400:kworker.0 Request processed in 27us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986499.073404:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614 00000100:00080000:1.0:1788986499.073420:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986499.073446:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993546752:0@lo:400:kworker.0 00000100:00100000:1.0:1788986499.073458:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8099b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993547136:0@lo:400:kworker.0 00000100:00100000:0.0:1788986499.073625:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993547008:0@lo:400:kworker.0 00000100:00100000:0.0:1788986499.073670:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986499.073703:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986499.073710:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993546880:0@lo:400:kworker.0 00000100:00100000:0.0:1788986499.073732:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986499.073760:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993546880 00000100:00100000:0.0:1788986499.073765:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993546880 00000100:00100000:0.0:1788986499.073797:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615 00000100:00100000:0.0:1788986499.073803:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993546880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986499.073834:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993546880:12345-0@lo:400:kworker.0 Request processed in 31us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986499.073840:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615 00000100:00080000:0.0:1788986499.073863:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986499.073878:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993546880:0@lo:400:kworker.0 00000100:00100000:2.0:1788986499.074009:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993546624 00000100:00100000:2.0:1788986499.074015:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993546624 00000100:00100000:2.0:1788986499.074050:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1788986499.074057:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993546624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986499.074136:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993546624:12345-0@lo:400:kworker.0 Request processed in 80us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986499.074145:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1274 00000100:00100000:2.0:1788986499.074186:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993546624:0@lo:400:kworker.0 00000100:00100000:1.0:1788986499.075304:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993547264 00000100:00100000:1.0:1788986499.075313:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993547264 00000100:00100000:1.0:1788986499.075366:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993547008 00000100:00100000:1.0:1788986499.075369:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993547008 00000100:00100000:1.0:1788986499.075388:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1788986499.075396:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993547264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986499.075455:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993547264:12345-0@lo:400:kworker.0 Request processed in 60us (2278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986499.075464:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1191 00000100:00100000:1.0:1788986499.075479:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1192 00000100:00100000:1.0:1788986499.075485:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993547008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986499.075514:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993547008:12345-0@lo:400:kworker.0 Request processed in 30us (1843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986499.075519:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1192 00000100:00080000:2.0:1788986499.075682:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986499.075709:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967355 gen 2 00000004:00080000:2.0:1788986499.075714:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a80b42d80, transno 4294967355 00000100:00100000:2.0:1788986499.075736:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993547264:0@lo:400:kworker.0 00000100:00100000:0.0:1788986499.077176:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80998e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993547008:0@lo:400:kworker.0 00000100:00100000:2.0:1788986499.584412:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993547392:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986499.584481:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986499.584624:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993547392 00000100:00100000:3.0:1788986499.584632:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993547392 00000100:00100000:3.0:1788986499.584693:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 819 00000100:00100000:3.0:1788986499.584703:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993547392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986499.584737:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986499.584786:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993547392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986499.584792:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 819 00000100:00100000:1.0:1788986499.584886:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993547392:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986500.032415:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986501.056938:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986501.233732:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986501.233822:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986501.233875:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986501.233916:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986501.234008:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971344384 00000100:00100000:2.0:1788986501.234022:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971344384 00000100:00100000:2.0:1788986501.234155:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971344512 00000100:00100000:2.0:1788986501.234159:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971344512 00000100:00100000:2.0:1788986501.234185:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1193 00000100:00100000:2.0:1788986501.234196:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971344384:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986501.234295:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971344384:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 100us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986501.234303:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1193 00000100:00100000:2.0:1788986501.234323:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1194 00000100:00100000:2.0:1788986501.234330:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971344512:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986501.234356:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971344512:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986501.234362:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1194 00000100:00100000:0.0:1788986501.234599:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971344256 00000100:00100000:0.0:1788986501.234605:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971344256 00000100:00100000:0.0:1788986501.234672:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1616 00000100:00100000:1.0:1788986501.234675:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971344128 00000100:00100000:1.0:1788986501.234680:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971344128 00000100:00100000:0.0:1788986501.234680:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971344256:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986501.234708:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1275 00000100:00100000:1.0:1788986501.234715:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971344128:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986501.234721:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971344256:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986501.234727:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1616 00000100:00100000:1.0:1788986501.234741:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971344128:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986501.234747:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1275 00000100:00080000:3.0:1788986501.234983:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986501.234990:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986501.234992:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986502.082023:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986503.104309:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986503.168534:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993547520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986503.168632:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986503.168945:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993547520 00000100:00100000:2.0:1788986503.168956:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993547520 00000100:00100000:2.0:1788986503.169080:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 820 00000100:00100000:2.0:1788986503.169132:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993547520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986503.169178:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986503.169395:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993547520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 304us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986503.169403:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 820 00000100:00080000:3.0:1788986503.169501:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986503.169567:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993547520:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986504.128533:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986504.192538:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993547648:0@lo:400:kworker.0 00000100:00100000:2.0:1788986504.192649:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986504.192723:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993548160:0@lo:400:kworker.0 00000100:00100000:3.0:1788986504.192724:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993547904:0@lo:400:kworker.0 00000100:00100000:2.0:1788986504.192752:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986504.192781:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993548160 00000100:00100000:2.0:1788986504.192787:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788986504.192791:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993548160 00000100:00100000:2.0:1788986504.192793:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993547776:0@lo:400:kworker.0 00000100:00100000:2.0:1788986504.192813:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986504.192830:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993548288:0@lo:400:kworker.0 00000100:00100000:2.0:1788986504.192853:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986504.192856:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993547776 00000100:00100000:3.0:1788986504.192859:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993547776 00000100:00100000:3.0:1788986504.192883:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617 00000100:00100000:3.0:1788986504.192892:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993548160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986504.192925:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993547648 00000100:00100000:0.0:1788986504.192930:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993547648 00000100:00100000:3.0:1788986504.192956:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993548160:12345-0@lo:400:kworker.0 Request processed in 65us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986504.192957:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:0.0:1788986504.192964:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993547648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986504.193049:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993548032:0@lo:400:kworker.0 00000100:00100000:1.0:1788986504.193085:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986504.193199:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993548288 00000100:00100000:1.0:1788986504.193203:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993548288 00000100:00100000:1.0:1788986504.193250:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993548032 00000100:00100000:1.0:1788986504.193253:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993548032 00000100:00100000:1.0:1788986504.193275:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1195 00000100:00100000:1.0:1788986504.193281:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993548288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986504.193313:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993548288:12345-0@lo:400:kworker.0 Request processed in 32us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986504.193320:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1195 00000100:00100000:1.0:1788986504.193339:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1196 00000100:00100000:1.0:1788986504.193345:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993548032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986504.193377:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993548032:12345-0@lo:400:kworker.0 Request processed in 32us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986504.193383:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1196 00000100:00100000:1.0:1788986504.193775:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993548032:0@lo:400:kworker.0 00000100:00100000:0.0:1788986504.193975:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993547648:12345-0@lo:400:kworker.0 Request processed in 1010us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986504.193985:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:2.0:1788986504.195824:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618 00000100:00100000:2.0:1788986504.195858:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993547776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986504.195971:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993547776:12345-0@lo:400:kworker.0 Request processed in 133us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986504.195979:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618 00000100:00100000:3.0:1788986504.196990:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617 00000100:00080000:2.0:1788986504.198687:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986504.198699:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986504.199227:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993547776:0@lo:400:kworker.0 00000100:00100000:3.0:1788986504.199255:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993548288:0@lo:400:kworker.0 00000100:00100000:3.0:1788986504.199268:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993547648:0@lo:400:kworker.0 00000100:00100000:3.0:1788986504.199281:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993548160:0@lo:400:kworker.0 00000100:00100000:3.0:1788986504.199335:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986504.199399:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993547904 00000100:00100000:2.0:1788986504.199408:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993547904 00000100:00100000:2.0:1788986504.199470:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:2.0:1788986504.199479:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993547904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986504.200741:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993547904:12345-0@lo:400:kworker.0 Request processed in 1243us (1385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986504.200754:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00000100:00080000:2.0:1788986504.200800:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986504.200991:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993547904:0@lo:400:kworker.0 00000100:00100000:0.0:1788986504.704420:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986504.704452:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993548416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986504.704546:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986504.704816:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993548416 00000100:00100000:1.0:1788986504.704827:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993548416 00000100:00100000:1.0:1788986504.704898:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 821 00000100:00100000:1.0:1788986504.704911:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993548416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986504.704957:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986504.705038:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993548416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986504.705050:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 821 00000100:00100000:2.0:1788986504.705372:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b41180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993548416:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986505.152241:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986506.176635:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986506.353440:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986506.353532:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986506.353619:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986506.353671:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986506.353713:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971344768 00000100:00100000:0.0:1788986506.353722:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971344768 00000100:00100000:0.0:1788986506.353796:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1620 00000100:00100000:0.0:1788986506.353805:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971344768:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986506.353872:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971344768:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986506.353878:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1620 00000100:00080000:0.0:1788986506.354010:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986506.355052:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971344640 00000100:00100000:2.0:1788986506.355061:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971344640 00000100:00100000:2.0:1788986506.355130:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1277 00000100:00100000:2.0:1788986506.355139:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971344640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986506.355186:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971344640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 49us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986506.355192:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1277 00000100:00100000:1.0:1788986506.356707:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971344896 00000100:00100000:1.0:1788986506.356716:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971344896 00000100:00100000:1.0:1788986506.356776:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971345024 00000100:00100000:1.0:1788986506.356780:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971345024 00000100:00100000:1.0:1788986506.356805:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1197 00000100:00100000:1.0:1788986506.356815:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971344896:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986506.356867:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971344896:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 54us (3333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986506.356873:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1197 00000100:00100000:1.0:1788986506.356890:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1198 00000100:00100000:1.0:1788986506.356898:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971345024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986506.356922:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971345024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (3251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986506.356929:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1198 00000100:00080000:3.0:1788986506.357207:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986506.357211:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986507.200319:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986508.224445:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986508.294431:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986508.294463:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993548544:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986508.294559:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986508.294713:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993548544 00000100:00100000:1.0:1788986508.294724:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993548544 00000100:00100000:1.0:1788986508.294808:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1788986508.294820:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993548544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986508.294877:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986508.294937:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993548544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986508.294946:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 822 00000100:00100000:1.0:1788986508.295005:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993548544:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986508.295209:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986509.249732:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986509.313158:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993548672:0@lo:400:kworker.0 00000100:00100000:1.0:1788986509.313215:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993548928:0@lo:400:kworker.0 00000100:00100000:3.0:1788986509.313601:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993549056:0@lo:400:kworker.0 00000100:00100000:0.0:1788986509.313641:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993548800:0@lo:400:kworker.0 00000100:00100000:1.0:1788986509.317185:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986509.317236:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986509.317308:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993549184:0@lo:400:kworker.0 00000100:00100000:1.0:1788986509.317330:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993548672 00000100:00100000:1.0:1788986509.317341:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993548672 00000100:00100000:2.0:1788986509.317353:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986509.317397:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1788986509.317401:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993548928 00000100:00100000:2.0:1788986509.317408:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993548928 00000100:00100000:1.0:1788986509.317421:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993548672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986509.317459:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993549184 00000100:00100000:2.0:1788986509.317463:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993549184 00000100:00100000:1.0:1788986509.317488:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993548672:12345-0@lo:400:kworker.0 Request processed in 70us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986509.317492:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1621 00000100:00100000:1.0:1788986509.317501:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1278 00000100:00100000:2.0:1788986509.317505:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993548928:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788986509.317558:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986509.317560:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993548928:12345-0@lo:400:kworker.0 Request processed in 59us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986509.317572:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1621 00000100:00100000:1.0:1788986509.317582:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1622 00000100:00100000:1.0:1788986509.317602:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993549184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986509.317825:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993548928:0@lo:400:kworker.0 00000100:00100000:2.0:1788986509.317860:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993548672:0@lo:400:kworker.0 00000100:00100000:2.0:1788986509.318024:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993549184:0@lo:400:kworker.0 00000100:00100000:3.0:1788986509.318229:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986509.318326:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993549056 00000100:00100000:2.0:1788986509.318331:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993549056 00000100:00100000:2.0:1788986509.318546:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1788986509.318556:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993549056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986509.318812:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993549056:12345-0@lo:400:kworker.0 Request processed in 257us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986509.318820:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1199 00000100:00100000:2.0:1788986509.318985:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993549056:0@lo:400:kworker.0 00000100:00100000:0.0:1788986509.319780:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986509.319817:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993549312:0@lo:400:kworker.0 00000100:00100000:0.0:1788986509.319850:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986509.319992:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993549184:12345-0@lo:400:kworker.0 Request processed in 2399us (2636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986509.320003:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1622 00000100:00100000:1.0:1788986509.320031:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993548800 00000100:00100000:1.0:1788986509.320038:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993548800 00000100:00100000:1.0:1788986509.320114:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623 00000100:00100000:1.0:1788986509.320123:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993548800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986509.320136:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993549312 00000100:00100000:2.0:1788986509.320142:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993549312 00000100:00100000:1.0:1788986509.320176:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993548800:12345-0@lo:400:kworker.0 Request processed in 54us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986509.320185:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623 00000100:00100000:2.0:1788986509.320191:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1200 00000100:00100000:2.0:1788986509.320200:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993549312:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788986509.320207:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986509.320251:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993549312:12345-0@lo:400:kworker.0 Request processed in 52us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986509.320258:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1200 00000100:00100000:0.0:1788986509.320545:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993548800:0@lo:400:kworker.0 00000100:00100000:0.0:1788986509.320557:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993549312:0@lo:400:kworker.0 00000100:00100000:0.0:1788986509.528937:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986509.529054:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971345152 00000100:00100000:2.0:1788986509.529067:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971345152 00000100:00100000:2.0:1788986509.529202:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 917 00000100:00100000:2.0:1788986509.529215:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50955:x1875885971345152:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986509.529399:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50955:x1875885971345152:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 123us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986509.529409:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 917 00000100:00080000:1.0:1788986509.530678:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986509.533583:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986509.533798:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971345280 00000100:00100000:2.0:1788986509.533811:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971345280 00000100:00100000:2.0:1788986509.533911:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 500 00000100:00100000:2.0:1788986509.533924:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50955:x1875885971345280:12345-192.168.206.21@tcp:19:lfs.0 00000100:00080000:1.0:1788986509.534661:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986509.534891:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50955:x1875885971345280:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 967us (1320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986509.534902:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 500 00000100:00100000:3.0:1788986509.545733:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986509.546005:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971345408 00000100:00100000:1.0:1788986509.546017:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971345408 00000100:00100000:1.0:1788986509.546167:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 501 00000100:00100000:1.0:1788986509.546192:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50955:x1875885971345408:12345-192.168.206.21@tcp:19:lfs.0 00000100:00080000:2.0:1788986509.546629:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986509.548726:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50955:x1875885971345408:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 2536us (4389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986509.548741:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 501 00000100:00100000:0.0:1788986509.560665:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986509.560960:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971345536 00000100:00100000:2.0:1788986509.560974:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971345536 00000100:00100000:2.0:1788986509.561050:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 918 00000100:00100000:2.0:1788986509.561071:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50955:x1875885971345536:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986509.561942:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50955:x1875885971345536:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 878us (1288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986509.561953:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 918 00000100:00100000:0.0:1788986509.570253:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986509.570465:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971345664 00000100:00100000:1.0:1788986509.570478:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971345664 00000100:00100000:1.0:1788986509.570563:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 919 00000100:00100000:1.0:1788986509.570575:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50955:x1875885971345664:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986509.570713:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50955:x1875885971345664:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 140us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986509.570722:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 919 00000100:00100000:3.0:1788986509.575630:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986509.575717:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971345792 00000100:00100000:2.0:1788986509.575731:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971345792 00000100:00100000:2.0:1788986509.575810:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 502 00000100:00100000:2.0:1788986509.575821:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50955:x1875885971345792:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986509.576309:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50955:x1875885971345792:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 488us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986509.576318:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 502 00000100:00100000:0.0:1788986509.583627:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986509.584950:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971345920 00000100:00100000:3.0:1788986509.584968:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971345920 00000100:00100000:2.0:1788986509.585231:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 503 00000100:00100000:2.0:1788986509.585246:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50955:x1875885971345920:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986509.585736:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:50955:x1875885971345920:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 492us (2122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986509.585745:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 503 00000100:00100000:0.0:1788986509.588221:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986509.588445:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971346048 00000100:00100000:2.0:1788986509.588458:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971346048 00000100:00100000:2.0:1788986509.588525:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 920 00000100:00100000:2.0:1788986509.588537:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50955:x1875885971346048:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986509.589068:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50955:x1875885971346048:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 531us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986509.589078:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 920 00000100:00100000:1.0:1788986509.825849:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993549440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986509.825945:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986509.826038:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993549440 00000100:00100000:1.0:1788986509.826047:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993549440 00000100:00100000:0.0:1788986509.832792:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 823 00000100:00100000:0.0:1788986509.832818:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993549440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986509.832864:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986509.832949:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993549440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (7006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986509.832959:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 823 00000100:00100000:1.0:1788986509.833718:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993549440:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986510.272220:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986510.901253:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986510.901355:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971346176 00000100:00100000:2.0:1788986510.901369:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971346176 00000100:00100000:2.0:1788986510.901478:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 921 00000100:00100000:2.0:1788986510.901492:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50969:x1875885971346176:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:2.0:1788986510.901518:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986510.901546:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549234 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1368 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.901642:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54923b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.901663:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54923b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.901678:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54923b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986510.901727:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:2.0:1788986510.901732:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986510.901758:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54923b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.901790:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549234 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1368 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.901810:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54923b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1368 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.901818:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:2.0:1788986510.901822:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986510.901826:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1800, rc 0) 00000100:00100000:2.0:1788986510.901918:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50969:x1875885971346176:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 430us (681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986510.901926:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 921 00000100:00100000:0.0:1788986510.909876:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986510.909967:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971346432 00000100:00100000:2.0:1788986510.909981:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971346432 00000100:00100000:2.0:1788986510.910074:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 922 00000100:00100000:2.0:1788986510.910117:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50969:x1875885971346432:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986510.910188:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986510.910224:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54923b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1368 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.910251:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf5491d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1353 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.910265:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:2.0:1788986510.910278:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986510.910310:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549242 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.910325:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.910336:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986510.959844:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000935a56a1 reply state 000000001339616e transno 4294967646 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986510.959866:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986510.959888:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000100:00100000:2.0:1788986510.960046:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50969:x1875885971346432:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 49956us (50191us total) trans 4294967646 rc 0/0 00000100:00100000:2.0:1788986510.960056:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 922 00000001:00080000:2.0:1788986510.960141:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967646 is committed 00010000:00010000:2.0:1788986510.960167:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549242 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.960177:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549242 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.960186:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.960193:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986510.960199:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549242 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.960211:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549242 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.960228:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:2.0:1788986510.960231:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986510.960238:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549242 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986510.960244:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549242 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986511.035226:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986511.036014:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971346560 00000100:00100000:2.0:1788986511.036026:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971346560 00000100:00100000:2.0:1788986511.039101:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 923 00000100:00100000:2.0:1788986511.039114:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50973:x1875885971346560:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986511.039137:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986511.039157:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549249 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d136f expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039214:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549250 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039228:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549250 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039239:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549250 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039253:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549257 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039275:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549257 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039284:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549257 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039590:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54925e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039601:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54925e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039609:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54925e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986511.039640:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:2.0:1788986511.039644:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986511.039663:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54925e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039676:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549250 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039683:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549250 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039691:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549250 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039697:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986511.039701:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549250 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039710:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549250 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039722:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:2.0:1788986511.039725:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986511.039729:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549250 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039736:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549250 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039746:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549257 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039753:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549257 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039759:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549257 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039765:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986511.039767:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549257 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039774:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549257 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039781:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a45aca400) 00010000:00010000:2.0:1788986511.039784:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986511.039787:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549257 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039798:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549257 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039825:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549249 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d136f expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039839:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54925e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d136f expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.039847:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45aca200) 00010000:00010000:2.0:1788986511.039850:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986511.039852:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1200, rc 0) 00000100:00100000:2.0:1788986511.039909:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50973:x1875885971346560:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 798us (4693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986511.039917:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 923 00000100:00080000:2.0:1788986511.039942:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986511.296715:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986511.474380:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986511.474431:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986511.474465:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986511.474532:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971346688 00000100:00100000:1.0:1788986511.474542:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971346688 00000100:00100000:1.0:1788986511.474603:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1279 00000100:00100000:1.0:1788986511.474613:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971346688:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986511.474680:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971346688:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986511.474687:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1279 00000100:00100000:1.0:1788986511.474720:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971346816 00000100:00100000:1.0:1788986511.474724:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971346816 00000100:00100000:1.0:1788986511.474761:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971346944 00000100:00100000:1.0:1788986511.474764:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971346944 00000100:00100000:1.0:1788986511.474784:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1201 00000100:00100000:1.0:1788986511.474791:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971346816:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986511.474821:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971346816:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986511.474827:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1201 00000100:00100000:1.0:1788986511.474841:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1202 00000100:00100000:1.0:1788986511.474847:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971346944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986511.474874:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971346944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986511.474880:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1202 00000100:00080000:1.0:1788986511.475018:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986511.475022:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986511.950700:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986511.950855:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971347072 00000100:00100000:3.0:1788986511.950865:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971347072 00000100:00100000:3.0:1788986511.950931:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 924 00000100:00100000:3.0:1788986511.950942:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50992:x1875885971347072:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986511.950969:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986511.950989:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549265 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1376 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986511.951052:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54926c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986511.951066:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54926c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986511.951078:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54926c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986511.951148:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:3.0:1788986511.951152:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986511.951171:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54926c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986511.951196:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549265 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1376 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986511.951212:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54926c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1376 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986511.951220:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45aca200) 00010000:00010000:3.0:1788986511.951223:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986511.951226:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2a00, rc 0) 00000100:00100000:3.0:1788986511.951280:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50992:x1875885971347072:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 340us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986511.951287:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 924 00000100:00100000:3.0:1788986511.954222:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986511.954508:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971347328 00000100:00100000:2.0:1788986511.954517:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971347328 00000100:00100000:2.0:1788986511.954588:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 925 00000100:00100000:2.0:1788986511.954598:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:50992:x1875885971347328:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986511.954648:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986511.954673:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54926c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1376 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.954693:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54925e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d136f expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.954708:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45aca200) 00010000:00010000:2.0:1788986511.954717:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986511.954740:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549273 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.954752:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549273 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986511.954760:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549273 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788986512.018261:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967647 is committed 00000004:00010000:2.0:1788986512.018506:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007af446a7 reply state 00000000cf6b2bbb transno 4294967647 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549273 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986512.018523:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986512.018539:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00010000:00080000:2.0:1788986512.018650:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788986512.018682:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50992:x1875885971347328:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 64081us (64464us total) trans 4294967647 rc 0/0 00000100:00100000:2.0:1788986512.018690:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 925 00010000:00010000:3.0:1788986512.018717:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549273 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.018732:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549273 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.018741:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549273 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.018748:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986512.018754:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549273 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.018763:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549273 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.018782:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:3.0:1788986512.018786:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986512.018791:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549273 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.018798:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549273 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986512.106584:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986512.106710:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971347456 00000100:00100000:2.0:1788986512.106719:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971347456 00000100:00100000:2.0:1788986512.106777:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 926 00000100:00100000:2.0:1788986512.106789:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:50996:x1875885971347456:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986512.106814:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986512.106834:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54927a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d137d expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.106898:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549281 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.106913:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549281 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.106926:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549281 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.106941:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549288 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.106949:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.106956:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107351:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54928f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107361:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54928f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107369:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54928f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986512.107390:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:2.0:1788986512.107394:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986512.107411:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54928f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107427:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549281 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107433:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549281 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107439:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549281 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107445:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986512.107449:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549281 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107456:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549281 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107467:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:2.0:1788986512.107470:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986512.107475:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107481:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107493:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107499:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549288 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107505:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549288 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107510:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986512.107512:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549288 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107518:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549288 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107526:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a45aca200) 00010000:00010000:2.0:1788986512.107528:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986512.107531:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549288 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107537:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549288 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107566:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54927a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d137d expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107593:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54928f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d137d expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.107600:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986512.107603:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986512.107605:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1a00, rc 0) 00000100:00100000:2.0:1788986512.107668:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50996:x1875885971347456:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 881us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986512.107676:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 926 00000100:00100000:3.0:1788986512.119498:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986512.119675:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971347712 00000100:00100000:2.0:1788986512.119685:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971347712 00000100:00100000:2.0:1788986512.119742:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 927 00000100:00100000:2.0:1788986512.119752:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:50996:x1875885971347712:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986512.119771:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986512.119790:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549296 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1384 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.120038:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54929d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.120053:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54929d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.120065:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54929d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.120079:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5492a4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.120086:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5492a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.120361:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5492a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986512.121254:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1e:0x0], index 0: 0 00010000:00010000:2.0:1788986512.121514:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.121529:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.121543:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.121590:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54929d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.121598:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54929d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.121605:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54929d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.121611:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986512.121615:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54929d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.121623:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54929d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.121633:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986512.121636:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986512.121640:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54929d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.121647:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54929d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986512.121660:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000e3e8e04 reply state 000000006995d4c0 transno 4294967648 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5492a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986512.121669:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986512.121699:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549296 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1384 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.121713:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1384 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.121721:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986512.121723:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986512.121726:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0600, rc 0) 00000100:00100000:2.0:1788986512.121796:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50996:x1875885971347712:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 2045us (2307us total) trans 4294967648 rc 0/0 00000100:00100000:2.0:1788986512.121805:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 927 00000100:00100000:0.0:1788986512.125866:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986512.125949:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971347968 00000100:00100000:2.0:1788986512.125963:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971347968 00000100:00100000:2.0:1788986512.126043:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 928 00000100:00100000:2.0:1788986512.126054:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50996:x1875885971347968:12345-192.168.206.21@tcp:36:touch.60003 00010000:00010000:2.0:1788986512.126163:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986512.126339:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5492a4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.126354:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5492a4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.126363:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5492a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.126369:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986512.126375:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5492a4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.126388:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5492a4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.126411:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a45aca200) 00010000:00010000:2.0:1788986512.126416:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1384 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.126418:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986512.126427:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5492a4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.126437:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf5492a4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.126442:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986512.126469:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986512.126514:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.126529:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.126542:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986512.126685:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000092264c68 reply state 00000000f207706f transno 4294967649 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986512.126694:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986512.126787:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50996:x1875885971347968:12345-192.168.206.21@tcp:36:touch.60003 Request processed in 734us (935us total) trans 4294967649 rc 0/0 00000100:00100000:2.0:1788986512.126794:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 928 00000100:00100000:1.0:1788986512.137905:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986512.137996:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971348096 00000100:00100000:3.0:1788986512.138008:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971348096 00000100:00100000:3.0:1788986512.138122:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 929 00000100:00100000:3.0:1788986512.138135:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50996:x1875885971348096:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:3.0:1788986512.138165:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986512.138191:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5492c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d138b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.138274:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5492c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d138b expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.138291:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5492c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d138b expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.138312:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:3.0:1788986512.138315:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788986512.138320:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2600, rc 0) 00000100:00100000:3.0:1788986512.138392:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50996:x1875885971348096:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 259us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986512.138401:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 929 00010000:00010000:2.0:1788986512.138452:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.138471:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.138478:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.138485:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986512.138489:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.138497:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.138512:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:2.0:1788986512.138515:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986512.138520:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.138526:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986512.146534:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986512.146635:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971348224 00000100:00100000:1.0:1788986512.146648:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971348224 00000100:00100000:1.0:1788986512.146724:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 504 00000100:00100000:1.0:1788986512.146738:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971348224:12345-192.168.206.21@tcp:2:touch.60003 00000100:00100000:1.0:1788986512.147494:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971348224:12345-192.168.206.21@tcp:2:touch.60003 Request processed in 756us (970us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1788986512.147504:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 504 00000100:00100000:1.0:1788986512.149842:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986512.167458:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971348480 00000100:00100000:3.0:1788986512.167480:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971348480 00000100:00100000:2.0:1788986512.175695:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 92 00000100:00100000:2.0:1788986512.175710:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:50996:x1875885971348480:12345-192.168.206.21@tcp:35:touch.60003 00000100:00100000:2.0:1788986512.176054:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:50996:x1875885971348480:12345-192.168.206.21@tcp:35:touch.60003 Request processed in 346us (26225us total) trans 4294967650 rc 0/0 00000100:00100000:2.0:1788986512.176062:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 92 00000100:00100000:0.0:1788986512.248613:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986512.248745:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971348608 00000100:00100000:3.0:1788986512.248757:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971348608 00000100:00100000:3.0:1788986512.251215:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 930 00000100:00100000:3.0:1788986512.251251:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:51000:x1875885971348608:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:3.0:1788986512.251287:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986512.251316:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5492c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1392 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251402:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5492ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251419:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5492ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251433:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5492ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251451:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5492d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251458:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5492d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251464:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5492d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251595:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5492dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251605:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5492dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251618:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5492dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986512.251662:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4c:0x0]: returning size 0 00000004:00200000:3.0:1788986512.251667:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986512.251692:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5492dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251706:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5492dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251715:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5492ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251722:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5492ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251729:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5492ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251736:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986512.251741:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5492ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251749:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5492ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251762:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:3.0:1788986512.251765:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986512.251771:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5492ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251782:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5492ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251799:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5492d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251804:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5492d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251810:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5492d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251815:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986512.251817:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5492d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251823:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5492d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251830:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a55745100) 00010000:00010000:3.0:1788986512.251833:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986512.251835:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5492d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.251840:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5492d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.252158:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5492c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1392 expref: 13 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.252185:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5492dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1392 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.252193:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:3.0:1788986512.252196:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788986512.252199:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788986512.252370:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:51000:x1875885971348608:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 1137us (3938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986512.252379:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 930 00000100:00100000:0.0:1788986512.255993:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986512.256228:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971348736 00000100:00100000:1.0:1788986512.256240:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971348736 00000100:00100000:1.0:1788986512.256331:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 505 00000100:00100000:1.0:1788986512.256343:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971348736:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:1.0:1788986512.256367:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986512.256391:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035beff3d/0xc20d828fcf5492e3 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1399 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788986512.256424:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x6aa1c48f, atime: 0x6aa1c48f, ctime: 0x6aa1c48f, blocks: 0x1 00010000:00010000:1.0:1788986512.256514:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=2296s v=(0 0) 00010000:00010000:1.0:1788986512.256519:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986512.256532:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035beff3d/0xc20d828fcf5492e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1399 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986512.256556:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000035beff3d/0xc20d828fcf5492e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1399 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986512.256571:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031a00, rc 0) 00000100:00100000:1.0:1788986512.256644:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971348736:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 304us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986512.256652:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 505 00000100:00100000:0.0:1788986512.260178:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986512.260331:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971348992 00000100:00100000:2.0:1788986512.260344:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971348992 00000100:00100000:2.0:1788986512.260409:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 931 00000100:00100000:2.0:1788986512.260420:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:51000:x1875885971348992:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:2.0:1788986512.260498:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986512.260533:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5492dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1392 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.260562:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5492c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d138b expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.260582:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:2.0:1788986512.260596:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986512.260624:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.260640:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.260651:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.260669:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.260676:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.260681:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.260802:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5492f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.260811:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5492f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.260818:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5492f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986512.261557:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].30, 64 off10112 00000004:00080000:2.0:1788986512.261571:0:7899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2296164480741ns, next at 2297164477938ns, rc = 0 00010000:00010000:2.0:1788986512.261655:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5492ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261669:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5492ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261680:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5492ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261688:0:7899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5492ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261699:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5492ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261706:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5492ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261723:0:7899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986512.261750:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5492f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261756:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5492f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261763:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5492f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261769:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986512.261774:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5492f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261783:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5492f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261794:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:2.0:1788986512.261797:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986512.261803:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5492f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261809:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf5492f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261829:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261837:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261844:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261849:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986512.261853:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261858:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261865:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986512.261868:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986512.261871:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986512.261878:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5492ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986512.261888:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f70d525f reply state 000000004ec87cb1 transno 4294967651 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986512.261897:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986512.261997:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:51000:x1875885971348992:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 1574us (1829us total) trans 4294967651 rc 0/0 00000100:00100000:2.0:1788986512.262007:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 931 00010000:00010000:0.0:1788986512.264246:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986512.264265:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5492ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986512.264276:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986512.264281:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5492ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986512.264292:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5492ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986512.264312:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4c:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:0.0:1788986512.264315:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788986512.264321:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5492ff lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986512.264331:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5492ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986512.264361:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986512.264362:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986512.264364:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986512.268808:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.268831:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.268839:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.268846:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986512.268853:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.268861:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.268880:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a45aca700) 00010000:00010000:3.0:1788986512.268884:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986512.268889:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.268896:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf5492f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986512.320591:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788986512.496287:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967356 is committed 00010000:00010000:0.0:1788986513.345391:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788986513.409273:0:6925:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2297312178362ns, next at 2298312173807ns, rc = 0 00000100:00100000:1.0:1788986513.409307:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986513.409336:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993549568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986513.409457:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986513.409535:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993549568 00000100:00100000:1.0:1788986513.409544:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993549568 00000100:00100000:1.0:1788986513.409636:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 824 00000100:00100000:1.0:1788986513.409646:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993549568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986513.409688:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986513.409744:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b40e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993549568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986513.409751:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 824 00000100:00080000:1.0:1788986513.409774:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986513.409813:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b42a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993549568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986513.456868:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986513.456959:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971349120 00000100:00100000:2.0:1788986513.456971:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971349120 00000100:00100000:2.0:1788986513.457073:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 932 00000100:00100000:2.0:1788986513.457115:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:51019:x1875885971349120:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:2.0:1788986513.457146:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986513.457172:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549306 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13a0 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.457252:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54930d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.457271:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54930d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.457286:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54930d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986513.457331:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:2.0:1788986513.457335:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:3.0:1788986513.457475:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1788986513.457709:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54930d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.457746:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549306 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13a0 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.457766:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54930d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13a0 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.457775:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986513.457778:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986513.457782:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1200, rc 0) 00000100:00100000:2.0:1788986513.457866:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:51019:x1875885971349120:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 782us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986513.457874:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 932 00000100:00100000:1.0:1788986513.470017:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986513.470143:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971349376 00000100:00100000:2.0:1788986513.470156:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971349376 00000100:00100000:2.0:1788986513.470235:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 933 00000100:00100000:2.0:1788986513.470248:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:51019:x1875885971349376:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986513.470325:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986513.470374:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54930d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13a0 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.470398:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54928f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d137d expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.470410:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986513.470423:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986513.470455:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549314 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.470470:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.470482:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986513.470785:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000052e60387 reply state 00000000f7d5b3b3 transno 4294967652 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986513.470796:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986513.470807:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000100:00100000:2.0:1788986513.470909:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:51019:x1875885971349376:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 663us (906us total) trans 4294967652 rc 0/0 00000100:00100000:2.0:1788986513.470918:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 933 00010000:00010000:2.0:1788986513.484755:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549314 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.484778:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549314 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.484787:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549314 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.484794:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986513.484799:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549314 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.484808:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549314 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.484828:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45aca400) 00010000:00010000:2.0:1788986513.484831:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986513.484837:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549314 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.484843:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549314 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986513.660356:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986513.660596:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971349504 00000100:00100000:2.0:1788986513.660620:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971349504 00000100:00100000:2.0:1788986513.660698:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 934 00000100:00100000:2.0:1788986513.660710:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:51031:x1875885971349504:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986513.661023:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:51031:x1875885971349504:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 313us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986513.661032:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 934 00000100:00100000:1.0:1788986513.674452:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986513.674589:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971349632 00000100:00100000:2.0:1788986513.674603:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971349632 00000100:00080000:3.0:1788986513.674748:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986513.674795:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 506 00000100:00100000:2.0:1788986513.674808:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:51031:x1875885971349632:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986513.675289:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:51031:x1875885971349632:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 483us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986513.675297:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 506 00000100:00100000:1.0:1788986513.680072:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986513.680152:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971349760 00000100:00100000:3.0:1788986513.680174:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971349760 00000100:00100000:3.0:1788986513.680260:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 507 00000100:00100000:3.0:1788986513.680273:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51031:x1875885971349760:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00080000:1.0:1788986513.680383:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986513.680883:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51031:x1875885971349760:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 611us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986513.680892:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 507 00000100:00100000:0.0:1788986513.683611:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986513.686696:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971349888 00000100:00100000:2.0:1788986513.686716:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971349888 00000100:00100000:2.0:1788986513.686808:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 935 00000100:00100000:2.0:1788986513.686819:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:51031:x1875885971349888:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986513.687913:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:51031:x1875885971349888:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 1089us (4308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986513.687922:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 935 00000100:00100000:1.0:1788986513.691668:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986513.691837:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971350016 00000100:00100000:2.0:1788986513.691849:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971350016 00000100:00100000:2.0:1788986513.691987:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 936 00000100:00100000:2.0:1788986513.691998:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:51031:x1875885971350016:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986513.692167:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:51031:x1875885971350016:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 170us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986513.692175:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 936 00000100:00100000:1.0:1788986513.696792:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986513.696947:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971350144 00000100:00100000:2.0:1788986513.696961:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971350144 00000100:00100000:2.0:1788986513.699838:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 508 00000100:00100000:2.0:1788986513.699856:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:51031:x1875885971350144:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986513.700385:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:51031:x1875885971350144:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 532us (3606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986513.700394:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 508 00000100:00100000:0.0:1788986513.702930:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986513.703084:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971350272 00000100:00100000:1.0:1788986513.703123:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971350272 00000100:00100000:1.0:1788986513.703188:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 509 00000100:00100000:1.0:1788986513.703201:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51031:x1875885971350272:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986513.703988:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51031:x1875885971350272:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 780us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986513.703998:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 509 00000100:00100000:3.0:1788986513.706407:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986513.706487:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971350400 00000100:00100000:0.0:1788986513.706499:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971350400 00000100:00100000:0.0:1788986513.706583:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 937 00000100:00100000:0.0:1788986513.706596:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:51031:x1875885971350400:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986513.707160:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:51031:x1875885971350400:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 564us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986513.707169:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 937 00000100:00100000:1.0:1788986513.767316:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986513.767543:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971350528 00000100:00100000:2.0:1788986513.767556:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971350528 00000100:00100000:2.0:1788986513.767637:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 938 00000100:00100000:2.0:1788986513.767650:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:51035:x1875885971350528:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:2.0:1788986513.767677:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986513.767703:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54931b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13a7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.767781:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549322 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.767799:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.767812:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768284:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549329 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768293:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768302:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768733:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549330 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768742:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549330 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768749:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549330 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986513.768778:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:2.0:1788986513.768782:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986513.768807:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549330 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768822:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549322 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768829:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549322 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768837:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549322 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768843:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986513.768848:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549322 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768856:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549322 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768940:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:2.0:1788986513.768944:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986513.768951:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549322 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768957:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549322 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768973:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549329 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768979:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549329 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768985:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549329 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768990:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986513.768993:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549329 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.768998:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549329 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.769006:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a45aca400) 00010000:00010000:2.0:1788986513.769009:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986513.769012:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549329 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.769018:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549329 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.769383:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54931b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13a7 expref: 13 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.769407:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549330 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13a7 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.769415:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986513.769418:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986513.769420:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986513.769523:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:51035:x1875885971350528:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 1874us (2220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986513.769533:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 938 00000100:00100000:1.0:1788986513.773366:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986513.773769:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971350784 00000100:00100000:3.0:1788986513.773783:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971350784 00000100:00100000:3.0:1788986513.773891:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 939 00000100:00100000:3.0:1788986513.773904:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:51035:x1875885971350784:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:3.0:1788986513.773931:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986513.773956:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549337 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13ae expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.774147:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54933e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.774174:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54933e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.774191:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54933e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.774209:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549345 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.774217:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.774224:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788986513.774835:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1e:0x0], index 1: 0 00010000:00010000:3.0:1788986513.776011:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54934c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.776034:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54934c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.776047:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54934c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.776131:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54933e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.776710:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54933e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.776723:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54933e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.776730:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986513.776737:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54933e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.776745:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54933e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.776758:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:3.0:1788986513.776762:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986513.776766:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54933e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.776773:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54933e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986513.776791:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b3beda1e reply state 000000001a52f4e8 transno 4294967653 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986513.776800:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788986513.776850:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549337 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13ae expref: 15 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.776868:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54934c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13ae expref: 14 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.776876:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986513.776878:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788986513.776881:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2600, rc 0) 00000100:00100000:3.0:1788986513.776955:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+15:51035:x1875885971350784:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 3054us (3605us total) trans 4294967653 rc 0/0 00000100:00100000:3.0:1788986513.776965:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 939 00010000:00010000:3.0:1788986513.787328:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549345 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.787345:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549345 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.787353:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549345 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.787359:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986513.787365:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549345 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.787372:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549345 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.787388:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a55745f00) 00010000:00010000:3.0:1788986513.787392:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986513.787397:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549345 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.787406:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549345 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986513.787772:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986513.787856:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971350912 00000100:00100000:0.0:1788986513.787866:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971350912 00000100:00100000:0.0:1788986513.787920:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 510 00000100:00100000:0.0:1788986513.787931:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51035:x1875885971350912:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:0.0:1788986513.787946:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986513.787964:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf54935a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13b5 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986513.787989:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788986513.788009:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=2297s v=(0 0) 00010000:00010000:0.0:1788986513.788014:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986513.788023:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf54935a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13b5 expref: 6 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986513.788040:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf54935a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13b5 expref: 6 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986513.788051:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef000, rc 0) 00000100:00100000:0.0:1788986513.788130:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:51035:x1875885971350912:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 201us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986513.788137:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 510 00000100:00100000:1.0:1788986513.820194:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986513.820334:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971351040 00000100:00100000:0.0:1788986513.820345:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971351040 00002000:00100000:0.0:1788986513.820398:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1e:0x0] (0->1048575) req@ffff9b0a761c1c00 x1875885971351040/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:434/0 lens 488/0 e 0 to 0 dl 1788986524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1788986513.820410:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a761c1c00 with x1875885971351040 ext(0->1048575) 00002000:00010000:0.0:1788986513.820417:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a761c1c00 00000100:00100000:0.0:1788986513.820450:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:0.0:1788986513.820460:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971351040:12345-192.168.206.21@tcp:4:dd.60003 00000100:00100000:2.0:1788986513.850827:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971351040:12345-192.168.206.21@tcp:4:dd.60003 Request processed in 30358us (30632us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788986513.850841:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00002000:00100000:2.0:1788986513.850854:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1e:0x0] (0->1048575) req@ffff9b0a761c1c00 x1875885971351040/t4294967356(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:434/0 lens 488/448 e 0 to 0 dl 1788986524 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1788986513.850877:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a761c1c00 with x1875885971351040 ext(0->1048575) 00002000:00010000:2.0:1788986513.850884:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a761c1c00 00000100:00100000:1.0:1788986513.854648:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986513.854858:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971351168 00000100:00100000:2.0:1788986513.854868:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971351168 00000100:00100000:2.0:1788986513.854964:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 940 00000100:00100000:2.0:1788986513.854974:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+14:51035:x1875885971351168:12345-192.168.206.21@tcp:44:dd.60003 00000100:00100000:0.0:1788986513.902551:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+14:51035:x1875885971351168:12345-192.168.206.21@tcp:44:dd.60003 Request processed in 47570us (47903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986513.902572:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 940 00000004:00080000:1.0:1788986513.902817:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 80 committed 00000001:00080000:1.0:1788986513.902848:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967652 is committed 00000004:00080000:1.0:1788986513.902854:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 79 committed 00000001:00080000:1.0:1788986513.902864:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967653 is committed 00000100:00100000:1.0:1788986513.904929:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986513.907413:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993549696:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788986513.907489:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986513.907984:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986513.908366:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993549696 00000100:00100000:3.0:1788986513.908375:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993549696 00000100:00100000:3.0:1788986513.908427:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971351296 00000100:00100000:3.0:1788986513.908430:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971351296 00000100:00100000:3.0:1788986513.908455:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:3.0:1788986513.908465:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993549696:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788986513.908494:0:6697:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:30 count 1 00010000:00010000:3.0:1788986513.908520:0:6697:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.908551:0:6697:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000035beff3d/0xc20d828fcf5492e3 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1399 expref: 5 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.908561:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788986513.908574:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986513.908579:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986513.908869:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 512 00000100:00100000:0.0:1788986513.908880:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971351296:12345-192.168.206.21@tcp:16:dd.60003 00010000:00010000:3.0:1788986513.908949:0:6697:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000035beff3d/0xc20d828fcf5492e3 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1399 expref: 5 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986513.909512:0:6695:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788986513.909522:0:6695:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00010000:3.0:1788986513.910889:0:6697:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000035beff3d/0xc20d828fcf5492e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1399 expref: 5 pid: 6695 timeout: 2397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986513.910914:0:6697:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875885993549824:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788986513.911044:0:6697:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a47eff540 going to sleep for 11 seconds 00000100:00100000:2.0:1788986513.923465:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986513.924911:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971351424 00000100:00100000:3.0:1788986513.924922:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971351424 00010000:00010000:3.0:1788986513.924962:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000035beff3d/0xc20d828fcf5492e3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1399 expref: 6 pid: 6695 timeout: 2397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986513.925007:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 401 00000100:00100000:3.0:1788986513.925017:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971351424:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986513.925030:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986513.925184:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000035beff3d/0xc20d828fcf5492e3 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1399 expref: 6 pid: 6695 timeout: 2397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.925197:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000035beff3d/0xc20d828fcf5492e3 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1399 expref: 6 pid: 6695 timeout: 2397 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.925220:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986513.925224:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986513.925230:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.925239:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.925260:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986513.925312:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971351424:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 296us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986513.925319:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 401 00010000:00010000:3.0:1788986513.927834:0:6697:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035beff3d/0xc20d828fcf5492e3 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1399 expref: 5 pid: 6695 timeout: 2397 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986513.927861:0:6697:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca3480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6697:1875885993549824:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788986513.927883:0:6697:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.927895:0:6697:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.927903:0:6697:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.927914:0:6697:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.927922:0:6697:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986513.927942:0:6697:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986513.929157:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986513.929167:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.929177:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986513.929182:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.929193:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.929213:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.929221:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a07ea54b/0xc20d828fcf549361 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986513.929240:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986513.929242:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986513.929244:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986513.930606:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993549696:12345-0@lo:6:osp-syn-0-0.0 Request processed in 22136us (23111us total) trans 4294967357 rc 0/0 00000100:00100000:3.0:1788986513.930618:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000004:00080000:0.0:1788986513.930759:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a80d38a80/2, rc 0, transno 4294967357 00000100:00100000:0.0:1788986513.930765:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993549696:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788986513.982780:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971351296:12345-192.168.206.21@tcp:16:dd.60003 Request processed in 73894us (74790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986513.982792:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 512 00000001:00080000:2.0:1788986513.983298:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967356 is committed 00000100:00100000:2.0:1788986513.986946:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986513.987014:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971351680 00000100:00100000:0.0:1788986513.987023:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971351680 00000100:00100000:0.0:1788986513.987074:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 93 00000100:00100000:0.0:1788986513.987082:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:51035:x1875885971351680:12345-192.168.206.21@tcp:35:dd.60003 00000100:00100000:0.0:1788986513.987707:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:51035:x1875885971351680:12345-192.168.206.21@tcp:35:dd.60003 Request processed in 622us (770us total) trans 4294967654 rc 0/0 00000100:00100000:0.0:1788986513.987715:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 93 00010000:00010000:0.0:1788986514.368298:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986514.432739:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993550208:0@lo:400:kworker.0 00000100:00100000:2.0:1788986514.432805:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986514.432866:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788986514.432872:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993550080:0@lo:400:kworker.0 00000100:00100000:2.0:1788986514.432896:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986514.432912:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993550592:0@lo:400:kworker.0 00000100:00100000:2.0:1788986514.432934:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986514.432967:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993550208 00000100:00100000:2.0:1788986514.432974:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993550208 00000100:00100000:1.0:1788986514.433126:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993550592 00000100:00100000:1.0:1788986514.433131:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993550592 00000100:00100000:1.0:1788986514.433185:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1203 00000100:00100000:1.0:1788986514.433194:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993550592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986514.433246:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993550592:12345-0@lo:400:kworker.0 Request processed in 54us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986514.433254:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1203 00000100:00080000:1.0:1788986514.433276:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986514.433378:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993550080 00000100:00100000:2.0:1788986514.433382:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993550080 00000100:00100000:2.0:1788986514.433399:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:2.0:1788986514.433406:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993550208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986514.433438:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993550208:12345-0@lo:400:kworker.0 Request processed in 33us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986514.433444:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:2.0:1788986514.433456:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1625 00000100:00100000:2.0:1788986514.433462:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993550080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986514.433487:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993550080:12345-0@lo:400:kworker.0 Request processed in 26us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986514.433493:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1625 00000100:00080000:1.0:1788986514.433613:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986514.434134:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993549952:0@lo:400:kworker.0 00000100:00100000:0.0:1788986514.434173:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986514.434280:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80998000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993550080:0@lo:400:kworker.0 00000100:00100000:2.0:1788986514.434291:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993550592:0@lo:400:kworker.0 00000100:00100000:2.0:1788986514.434301:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993550208:0@lo:400:kworker.0 00000100:00100000:0.0:1788986514.434427:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8099b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993550464:0@lo:400:kworker.0 00000100:00100000:0.0:1788986514.434452:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986514.434482:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986514.434489:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993550336:0@lo:400:kworker.0 00000100:00100000:0.0:1788986514.434523:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986514.435165:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993550464 00000100:00100000:3.0:1788986514.435174:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993550464 00000100:00100000:3.0:1788986514.435235:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1626 00000100:00100000:3.0:1788986514.435243:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993550464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986514.435298:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993550464:12345-0@lo:400:kworker.0 Request processed in 56us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986514.435303:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1626 00000100:00100000:3.0:1788986514.435339:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8099b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993550464:0@lo:400:kworker.0 00000100:00100000:2.0:1788986514.435841:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993550336 00000100:00100000:2.0:1788986514.435847:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993550336 00000100:00100000:2.0:1788986514.435888:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1204 00000100:00100000:2.0:1788986514.435895:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993550336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986514.435958:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993550336:12345-0@lo:400:kworker.0 Request processed in 64us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986514.435964:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1204 00000100:00080000:0.0:1788986514.436259:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986514.436388:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80998a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993550336:0@lo:400:kworker.0 00000100:00100000:1.0:1788986514.438899:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993549952 00000100:00100000:1.0:1788986514.438911:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993549952 00000100:00100000:1.0:1788986514.439042:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:1.0:1788986514.439052:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993549952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986514.439159:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993549952:12345-0@lo:400:kworker.0 Request processed in 108us (4983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986514.439165:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1788986514.439254:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80998700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993549952:0@lo:400:kworker.0 00000100:00100000:3.0:1788986514.949974:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993550720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986514.950052:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986514.950316:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993550720 00000100:00100000:2.0:1788986514.950325:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993550720 00000100:00100000:2.0:1788986514.950385:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 825 00000100:00100000:2.0:1788986514.950395:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993550720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986514.950417:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1788986514.950468:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993550720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986514.950475:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 825 00000100:00100000:3.0:1788986514.950727:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993550720:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986515.392435:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986515.481475:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967654 is committed 00010000:00010000:0.0:1788986516.421685:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986516.595558:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986516.595610:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986516.595640:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986516.595669:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986516.595704:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971351936 00000100:00100000:2.0:1788986516.595717:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971351936 00000100:00100000:2.0:1788986516.595793:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1627 00000100:00100000:2.0:1788986516.595805:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971351936:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986516.595906:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971351936:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 103us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986516.595914:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1627 00000100:00100000:3.0:1788986516.596527:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971351808 00000100:00100000:3.0:1788986516.596534:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971351808 00000100:00100000:3.0:1788986516.596587:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1281 00000100:00100000:3.0:1788986516.596596:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971351808:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986516.596644:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971351808:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 50us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986516.596651:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1281 00000100:00100000:1.0:1788986516.597657:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971352064 00000100:00100000:1.0:1788986516.597667:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971352064 00000100:00100000:1.0:1788986516.597727:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971352192 00000100:00100000:1.0:1788986516.597731:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971352192 00000100:00100000:1.0:1788986516.597764:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1205 00000100:00100000:1.0:1788986516.597773:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971352064:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986516.597832:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971352064:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 60us (2220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986516.597839:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1205 00000100:00100000:1.0:1788986516.597856:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1206 00000100:00100000:1.0:1788986516.597863:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971352192:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986516.597893:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971352192:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (2224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986516.597899:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1206 00000100:00080000:0.0:1788986516.599402:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986516.599412:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986516.599415:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:1.0:1788986516.953888:0:86619:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2300856795465ns, next at 2298312173807ns, rc = 0 00000004:00080000:1.0:1788986516.954037:0:86619:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2300856947038ns, next at 2277138765068ns, rc = 0 00000004:00080000:0.0:1788986516.956046:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 80 committed 00000004:00080000:0.0:1788986516.956066:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 81 committed 00010000:00010000:0.0:1788986517.440621:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986517.579270:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967357 is committed 00010000:00010000:0.0:1788986518.464818:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986518.528428:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986518.528621:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993550848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986518.528687:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986518.528846:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993550848 00000100:00100000:3.0:1788986518.528854:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993550848 00000100:00080000:0.0:1788986518.529063:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986518.529225:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 826 00000100:00100000:3.0:1788986518.529236:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993550848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986518.529274:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986518.529329:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993550848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986518.529335:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 826 00000100:00100000:0.0:1788986518.531187:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986518.531386:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967357 gen 2 00000004:00080000:0.0:1788986518.531394:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a80d38a80, transno 4294967357 00000100:00100000:0.0:1788986518.531416:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993550848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986518.537049:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971352320 00000100:00100000:3.0:1788986518.537064:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971352320 00000100:00100000:3.0:1788986518.537152:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 941 00000100:00100000:3.0:1788986518.537163:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:51228:x1875885971352320:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986518.537263:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:51228:x1875885971352320:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 101us (6081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986518.537269:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 941 00000100:00080000:3.0:1788986518.537394:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986518.544858:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986518.544966:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971352448 00000100:00100000:0.0:1788986518.544977:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971352448 00000100:00100000:0.0:1788986518.545060:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 513 00000100:00100000:0.0:1788986518.545070:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51228:x1875885971352448:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00080000:3.0:1788986518.545210:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986518.547254:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51228:x1875885971352448:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 1371us (1592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986518.547270:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 513 00000100:00100000:3.0:1788986518.552338:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986518.552497:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971352576 00000100:00100000:1.0:1788986518.552507:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971352576 00000100:00080000:3.0:1788986518.552567:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986518.552599:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 514 00000100:00100000:1.0:1788986518.552612:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:51228:x1875885971352576:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986518.553067:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:51228:x1875885971352576:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 457us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986518.553075:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 514 00000100:00100000:2.0:1788986518.557407:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986518.557531:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971352704 00000100:00100000:0.0:1788986518.557550:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971352704 00000100:00100000:0.0:1788986518.557609:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 942 00000100:00100000:0.0:1788986518.557620:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:51228:x1875885971352704:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986518.558025:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:51228:x1875885971352704:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 407us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986518.558033:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 942 00000100:00100000:1.0:1788986518.564524:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986518.567772:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971352832 00000100:00100000:3.0:1788986518.567787:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971352832 00000100:00100000:3.0:1788986518.567918:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 943 00000100:00100000:3.0:1788986518.567928:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:51228:x1875885971352832:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986518.568121:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:51228:x1875885971352832:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 193us (3602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986518.568129:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 943 00000100:00100000:3.0:1788986518.575311:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986518.575357:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971352960 00000100:00100000:3.0:1788986518.575369:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971352960 00000100:00100000:3.0:1788986518.575426:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 515 00000100:00100000:3.0:1788986518.575660:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51228:x1875885971352960:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986518.576818:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51228:x1875885971352960:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 1081us (1435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986518.576895:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 515 00000100:00100000:0.0:1788986518.585455:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986518.585493:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971353088 00000100:00100000:0.0:1788986518.585503:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971353088 00000100:00100000:0.0:1788986518.585563:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 516 00000100:00100000:0.0:1788986518.585574:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:51228:x1875885971353088:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986518.585926:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:51228:x1875885971353088:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 353us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986518.585934:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 516 00000100:00100000:2.0:1788986518.593504:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986518.594341:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971353216 00000100:00100000:2.0:1788986518.594355:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971353216 00000100:00100000:2.0:1788986518.594421:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 944 00000100:00100000:2.0:1788986518.594432:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:51228:x1875885971353216:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986518.594906:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:51228:x1875885971353216:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 475us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986518.594919:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 944 00000100:00100000:2.0:1788986518.701180:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986518.701311:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971353472 00000100:00100000:1.0:1788986518.701320:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971353472 00000100:00100000:1.0:1788986518.701378:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 945 00000100:00100000:1.0:1788986518.701387:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:51232:x1875885971353472:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:1.0:1788986518.701448:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986518.701482:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54934c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13ae expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.701501:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:1.0:1788986518.701513:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986518.701534:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549368 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.701557:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549368 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.701571:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549368 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.701585:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54936f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.701592:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54936f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.701599:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54936f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.701886:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549376 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.701895:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549376 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.701902:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549376 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986518.702830:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].30, 64 off10112 00000004:00080000:1.0:1788986518.702841:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2302605751621ns, next at 2303605749174ns, rc = 0 00010000:00010000:1.0:1788986518.702938:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54937d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.702949:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54937d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.702958:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54937d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.702969:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54937d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.702975:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54937d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.702981:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54937d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.702994:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986518.703014:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549376 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703020:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549376 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703025:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549376 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703031:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986518.703035:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549376 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703043:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549376 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703053:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9b0a45316b00) 00010000:00010000:1.0:1788986518.703056:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986518.703061:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549376 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703071:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549376 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703620:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549368 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703631:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549368 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703637:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549368 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703642:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986518.703645:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549368 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703652:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549368 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703661:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:1.0:1788986518.703664:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986518.703667:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549368 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.703673:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549368 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x48:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986518.703687:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c636c1f5 reply state 000000002a15f89f transno 4294967655 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54936f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986518.703695:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986518.703785:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:51232:x1875885971353472:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 2396us (2613us total) trans 4294967655 rc 0/0 00000100:00100000:1.0:1788986518.703795:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 945 00010000:00010000:0.0:1788986518.707719:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986518.707732:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54937d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986518.707743:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986518.707747:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54937d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986518.707758:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54937d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986518.707775:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4d:0x0].0x0 (ffff9b0a45316b00) 00010000:00010000:0.0:1788986518.707777:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788986518.707782:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54937d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986518.707788:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54937d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986518.707811:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986518.707813:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986518.707814:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986518.709917:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54936f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.709933:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54936f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.709941:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54936f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.709947:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986518.709952:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54936f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.709959:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54936f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.709975:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x1c2d2f2 (ffff9b0a45316a00) 00010000:00010000:1.0:1788986518.709977:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986518.709982:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54936f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986518.709987:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54936f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x48:0x0].0x1c2d2f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986519.488301:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986519.553272:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993551360:0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.553339:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986519.553394:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788986519.553400:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8099aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993550976:0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.553428:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986519.553452:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993551488:0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.553475:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986519.553509:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8099b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993551104:0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.553532:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986519.553564:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993551616:0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.553584:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986519.553601:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986519.553606:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993551232:0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.553625:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986519.553652:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993551360 00000100:00100000:2.0:1788986519.553658:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993551360 00000100:00100000:2.0:1788986519.553696:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993551616 00000100:00100000:2.0:1788986519.553699:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993551616 00000100:00100000:2.0:1788986519.553727:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1788986519.553736:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993551360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.553786:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993551360:12345-0@lo:400:kworker.0 Request processed in 51us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986519.553795:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1207 00000100:00100000:2.0:1788986519.553811:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1788986519.553818:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993551616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.553850:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993551616:12345-0@lo:400:kworker.0 Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986519.553858:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1208 00000100:00100000:2.0:1788986519.553876:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993550976 00000100:00100000:2.0:1788986519.553879:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993550976 00000100:00100000:2.0:1788986519.553898:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1788986519.553904:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993550976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.553932:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993550976:12345-0@lo:400:kworker.0 Request processed in 28us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986519.553937:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1282 00000100:00100000:2.0:1788986519.553960:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993551488 00000100:00100000:2.0:1788986519.553963:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993551488 00000100:00100000:2.0:1788986519.553989:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993551104 00000100:00100000:2.0:1788986519.553992:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993551104 00000100:00100000:2.0:1788986519.554004:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993551232 00000100:00100000:2.0:1788986519.554006:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993551232 00000100:00100000:2.0:1788986519.554021:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1628 00000100:00100000:2.0:1788986519.554026:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993551488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.554055:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993551488:12345-0@lo:400:kworker.0 Request processed in 29us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986519.554061:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1628 00000100:00100000:2.0:1788986519.554073:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1629 00000100:00100000:2.0:1788986519.554078:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993551104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.554132:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993551104:12345-0@lo:400:kworker.0 Request processed in 54us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986519.554138:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1629 00000100:00100000:2.0:1788986519.554149:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1630 00000100:00100000:2.0:1788986519.554155:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993551232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.554182:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993551232:12345-0@lo:400:kworker.0 Request processed in 28us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986519.554188:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1630 00000100:00100000:2.0:1788986519.554233:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993551232:0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.554243:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8099b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993551104:0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.554251:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c7b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993551616:0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.554283:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8099aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993550976:0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.554292:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993551488:0@lo:400:kworker.0 00000100:00100000:2.0:1788986519.554300:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80999500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993551360:0@lo:400:kworker.0 00000100:00080000:3.0:1788986519.554460:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986519.554465:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986520.065161:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000004:00080000:2.0:1788986520.065169:0:7935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2303968078978ns, next at 2304968076411ns, rc = 0 00000100:00100000:0.0:1788986520.065182:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993551744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986520.065253:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986520.065302:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993551744 00000100:00100000:3.0:1788986520.065310:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993551744 00000100:00100000:3.0:1788986520.065357:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 827 00000100:00100000:3.0:1788986520.065366:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a4515b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993551744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986520.065398:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788986520.065451:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a4515b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993551744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986520.065458:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 827 00000100:00100000:0.0:1788986520.065604:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993551744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986520.512355:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788986520.886696:0:86767:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2304789604079ns, next at 2298312173807ns, rc = 0 00000004:00080000:0.0:1788986520.886889:0:86767:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2304789798338ns, next at 2304968076411ns, rc = 0 00000004:00080000:1.0:1788986520.945352:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 83 committed 00000004:00080000:1.0:1788986520.945375:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 82 committed 00000100:00100000:0.0:1788986520.945624:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993551872:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788986520.945687:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986520.946264:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993551872 00000100:00100000:1.0:1788986520.946272:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993551872 00000100:00100000:1.0:1788986520.946398:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:1.0:1788986520.946409:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993551872:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788986520.946437:0:86533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:30 count 1 00010000:00010000:1.0:1788986520.946459:0:86533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986520.946479:0:86533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf54935a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13b5 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986520.946487:0:86533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1788986520.946492:0:86533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986520.946495:0:86533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986520.946523:0:86533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf54935a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13b5 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986520.946548:0:86533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf54935a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13b5 expref: 5 pid: 8478 timeout: 2404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986520.946571:0:86533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:86533:1875885993552000:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986520.946639:0:86533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a46ee8c00 going to sleep for 11 seconds 00000001:00080000:1.0:1788986520.947224:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967655 is committed 00000004:00080000:1.0:1788986520.947230:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 81 committed 00000004:00080000:1.0:1788986520.947239:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 82 committed 00000100:00100000:1.0:1788986520.951652:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986520.951755:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971353600 00000100:00100000:3.0:1788986520.951764:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971353600 00010000:00010000:3.0:1788986520.951816:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf54935a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13b5 expref: 6 pid: 8478 timeout: 2404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986520.951860:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 402 00000100:00100000:3.0:1788986520.951870:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971353600:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986520.951885:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986520.951891:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf54935a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13b5 expref: 6 pid: 8478 timeout: 2404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986520.951904:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf54935a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13b5 expref: 6 pid: 8478 timeout: 2404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986520.951927:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986520.951931:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986520.951937:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986520.951946:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986520.951968:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986520.952025:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971353600:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 157us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986520.952033:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 402 00010000:00010000:0.0:1788986520.953146:0:86533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000756763aa/0xc20d828fcf54935a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13b5 expref: 5 pid: 8478 timeout: 2404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986520.953163:0:86533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:86533:1875885993552000:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788986520.953182:0:86533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986520.953192:0:86533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986520.953198:0:86533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986520.953209:0:86533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986520.953221:0:86533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986520.953236:0:86533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986520.953613:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986520.953621:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986520.953629:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986520.953633:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986520.953648:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986520.953665:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986520.953673:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf549384 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986520.953693:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986520.953695:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986520.953697:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788986520.954626:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986520.955162:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993551872:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8751us (9471us total) trans 4294967357 rc 0/0 00000100:00100000:0.0:1788986520.955173:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000004:00080000:2.0:1788986520.956898:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a80ca2a00/2, rc 0, transno 4294967357 00000100:00100000:2.0:1788986520.957006:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993551872:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788986521.537607:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986521.713751:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986521.713873:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971353728 00000100:00100000:3.0:1788986521.713882:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971353728 00000100:00100000:3.0:1788986521.713927:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1283 00000100:00100000:3.0:1788986521.713936:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971353728:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986521.713993:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971353728:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 58us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986521.714001:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1283 00000100:00100000:2.0:1788986521.714265:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986521.714375:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971353856 00000100:00100000:3.0:1788986521.714380:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971353856 00000100:00100000:3.0:1788986521.714425:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1631 00000100:00100000:3.0:1788986521.714432:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971353856:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986521.714471:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971353856:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 39us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986521.714478:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1631 00000100:00080000:2.0:1788986521.714549:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986521.721906:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986521.721948:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986521.721975:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971353984 00000100:00100000:0.0:1788986521.721984:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971353984 00000100:00100000:0.0:1788986521.722034:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971354112 00000100:00100000:0.0:1788986521.722038:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971354112 00000100:00100000:0.0:1788986521.722060:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1209 00000100:00100000:0.0:1788986521.722069:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971353984:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986521.722157:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971353984:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 89us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986521.722165:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1209 00000100:00100000:0.0:1788986521.722184:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1210 00000100:00100000:0.0:1788986521.722190:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971354112:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986521.722215:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971354112:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986521.722221:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1210 00000100:00080000:0.0:1788986521.722237:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986522.560391:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986523.585759:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986523.648303:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993552128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986523.648407:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986523.648502:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993552128 00000100:00100000:0.0:1788986523.648523:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993552128 00000100:00100000:0.0:1788986523.648597:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 828 00000100:00100000:0.0:1788986523.648608:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993552128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986523.648653:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986523.648708:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993552128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986523.648715:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 828 00000100:00080000:0.0:1788986523.648740:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986523.648786:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993552128:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788986523.731250:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967357 is committed 00010000:00010000:2.0:1788986524.608308:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986524.672368:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993552640:0@lo:400:kworker.0 00000100:00100000:2.0:1788986524.672433:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986524.672503:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986524.672522:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993552512:0@lo:400:kworker.0 00000100:00100000:2.0:1788986524.672550:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986524.672582:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993552512 00000100:00100000:1.0:1788986524.672590:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993552512 00000100:00100000:3.0:1788986524.672648:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993552384:0@lo:400:kworker.0 00000100:00100000:1.0:1788986524.672660:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1632 00000100:00100000:1.0:1788986524.672672:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993552512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986524.672682:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986524.672704:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993552896:0@lo:400:kworker.0 00000100:00100000:1.0:1788986524.672732:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993552512:12345-0@lo:400:kworker.0 Request processed in 63us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986524.672734:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986524.672744:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1632 00000100:00100000:3.0:1788986524.672759:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788986524.672761:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993552384 00000100:00100000:1.0:1788986524.672767:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993552384 00000100:00100000:3.0:1788986524.672769:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993552256:0@lo:400:kworker.0 00000100:00100000:1.0:1788986524.672792:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633 00000100:00100000:1.0:1788986524.672803:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993552384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986524.672804:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986524.672836:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993552768:0@lo:400:kworker.0 00000100:00100000:1.0:1788986524.672845:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993552384:12345-0@lo:400:kworker.0 Request processed in 45us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986524.672852:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633 00000100:00100000:3.0:1788986524.672865:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986524.672889:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993552640 00000100:00100000:1.0:1788986524.672894:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993552640 00000100:00100000:3.0:1788986524.672908:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993552384:0@lo:400:kworker.0 00000100:00100000:1.0:1788986524.672917:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993552896 00000100:00100000:1.0:1788986524.672921:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993552896 00000100:00100000:3.0:1788986524.672943:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993552768 00000100:00100000:1.0:1788986524.672947:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1211 00000100:00100000:3.0:1788986524.672950:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993552768 00000100:00100000:1.0:1788986524.672956:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993552640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986524.672987:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634 00000100:00100000:3.0:1788986524.672997:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993552768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986524.673006:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993552640:12345-0@lo:400:kworker.0 Request processed in 51us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986524.673014:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1211 00000100:00100000:1.0:1788986524.673028:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1212 00000100:00100000:1.0:1788986524.673035:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993552896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986524.673043:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993552768:12345-0@lo:400:kworker.0 Request processed in 47us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986524.673050:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634 00000100:00100000:1.0:1788986524.673069:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993552896:12345-0@lo:400:kworker.0 Request processed in 33us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986524.673073:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993552256 00000100:00100000:3.0:1788986524.673079:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993552256 00000100:00100000:1.0:1788986524.673083:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1212 00000100:00100000:3.0:1788986524.673134:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1788986524.673142:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993552256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986524.673177:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993552256:12345-0@lo:400:kworker.0 Request processed in 37us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986524.673184:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1788986524.673216:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993552256:0@lo:400:kworker.0 00000100:00100000:3.0:1788986524.673226:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993552768:0@lo:400:kworker.0 00000100:00100000:3.0:1788986524.673232:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967357 gen 2 00000004:00080000:3.0:1788986524.673236:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a80ca2a00, transno 4294967357 00000100:00100000:3.0:1788986524.673256:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993552896:0@lo:400:kworker.0 00000100:00080000:2.0:1788986524.673334:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986524.673340:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986524.673480:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993552512:0@lo:400:kworker.0 00000100:00100000:2.0:1788986524.673490:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993552640:0@lo:400:kworker.0 00000100:00100000:2.0:1788986525.190375:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986525.190398:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993553024:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986525.190473:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986525.190556:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993553024 00000100:00100000:3.0:1788986525.190565:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993553024 00000100:00100000:3.0:1788986525.190614:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 829 00000100:00100000:3.0:1788986525.190623:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993553024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986525.190657:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986525.190720:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993553024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986525.190729:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 829 00000100:00100000:2.0:1788986525.190769:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993553024:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986525.635287:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986526.656301:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986526.833200:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986526.833319:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986526.833351:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986526.833375:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971354496 00000100:00100000:3.0:1788986526.833384:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971354496 00000100:00100000:3.0:1788986526.833452:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1213 00000100:00100000:3.0:1788986526.833462:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971354496:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986526.833541:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971354496:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 80us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986526.833548:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1213 00000100:00100000:3.0:1788986526.833587:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971354240 00000100:00100000:3.0:1788986526.833592:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971354240 00000100:00100000:3.0:1788986526.833618:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1285 00000100:00100000:3.0:1788986526.833625:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971354240:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986526.833649:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971354240:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986526.833655:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1285 00000100:00080000:3.0:1788986526.833699:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986526.833707:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971354368 00000100:00100000:1.0:1788986526.833713:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971354368 00000100:00100000:0.0:1788986526.833728:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00080000:3.0:1788986526.833764:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986526.833773:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1635 00000100:00100000:1.0:1788986526.833784:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971354368:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986526.833787:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971354624 00000100:00100000:3.0:1788986526.833793:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971354624 00000100:00100000:1.0:1788986526.833821:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971354368:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986526.833831:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1214 00000100:00100000:1.0:1788986526.833831:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1635 00000100:00100000:3.0:1788986526.833846:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971354624:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986526.833876:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971354624:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (149us total) trans 0 rc 0/0 00000100:00080000:0.0:1788986526.834463:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986526.834715:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1214 00010000:00010000:0.0:1788986527.682195:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986528.704292:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986528.771037:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986528.771070:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993553152:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986528.771162:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986528.771588:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993553152 00000100:00100000:2.0:1788986528.771596:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993553152 00000100:00100000:2.0:1788986528.771657:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 830 00000100:00100000:2.0:1788986528.771666:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993553152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986528.771698:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986528.771750:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993553152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986528.771757:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 830 00000100:00100000:2.0:1788986528.771816:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993553152:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986528.772240:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986529.728316:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986529.794303:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993553408:0@lo:400:kworker.0 00000100:00100000:3.0:1788986529.794367:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986529.794438:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993553920:0@lo:400:kworker.0 00000100:00100000:3.0:1788986529.794464:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986529.794501:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788986529.794508:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993553280:0@lo:400:kworker.0 00000100:00100000:3.0:1788986529.794538:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986529.794561:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993553792:0@lo:400:kworker.0 00000100:00100000:3.0:1788986529.794583:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986529.794613:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993553920 00000100:00100000:3.0:1788986529.794621:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993553920 00000100:00100000:0.0:1788986529.794764:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993553408 00000100:00100000:0.0:1788986529.794769:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993553408 00000100:00100000:0.0:1788986529.794795:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993553792 00000100:00100000:0.0:1788986529.794799:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993553792 00000100:00100000:0.0:1788986529.794820:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1636 00000100:00100000:0.0:1788986529.794828:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993553408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986529.794883:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993553408:12345-0@lo:400:kworker.0 Request processed in 55us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986529.794892:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1636 00000100:00100000:1.0:1788986529.794911:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1637 00000100:00100000:1.0:1788986529.794923:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993553792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986529.794968:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993553664:0@lo:400:kworker.0 00000100:00100000:1.0:1788986529.794978:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993553792:12345-0@lo:400:kworker.0 Request processed in 57us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986529.795026:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1788986529.795035:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993553920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986529.795068:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993553920:12345-0@lo:400:kworker.0 Request processed in 35us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986529.795074:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1215 00000100:00100000:3.0:1788986529.795115:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993553280 00000100:00100000:3.0:1788986529.795120:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993553280 00000100:00100000:3.0:1788986529.795145:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:3.0:1788986529.795151:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993553280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986529.795182:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993553280:12345-0@lo:400:kworker.0 Request processed in 32us (644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986529.795189:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00080000:3.0:1788986529.795216:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986529.795221:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986529.795270:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993553280:0@lo:400:kworker.0 00000100:00100000:3.0:1788986529.795285:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993553792:0@lo:400:kworker.0 00000100:00100000:3.0:1788986529.795294:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993553408:0@lo:400:kworker.0 00000100:00100000:3.0:1788986529.795302:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993553920:0@lo:400:kworker.0 00000100:00100000:3.0:1788986529.795349:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993553536:0@lo:400:kworker.0 00000100:00100000:3.0:1788986529.795375:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986529.795406:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993553536 00000100:00100000:3.0:1788986529.795410:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993553536 00000100:00100000:2.0:1788986529.795685:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986529.795726:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993553664 00000100:00100000:2.0:1788986529.795730:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993553664 00000100:00100000:2.0:1788986529.795757:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1788986529.795764:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993553664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986529.795799:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993553664:12345-0@lo:400:kworker.0 Request processed in 36us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986529.795806:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1216 00000100:00100000:2.0:1788986529.795836:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993553664:0@lo:400:kworker.0 00000100:00080000:2.0:1788986529.795859:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986529.800880:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1637 00000100:00100000:3.0:1788986529.801326:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:3.0:1788986529.801347:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993553536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986529.801465:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993553536:12345-0@lo:400:kworker.0 Request processed in 129us (6087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986529.801472:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00100000:2.0:1788986529.801537:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993553536:0@lo:400:kworker.0 00000100:00100000:3.0:1788986530.305125:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986530.305147:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993554048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986530.305215:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986530.305340:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993554048 00000100:00100000:0.0:1788986530.305347:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993554048 00000100:00100000:0.0:1788986530.305390:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 831 00000100:00100000:0.0:1788986530.305398:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993554048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986530.305434:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986530.305517:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993554048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986530.305524:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 831 00000100:00100000:3.0:1788986530.305663:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993554048:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986530.752906:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986531.777183:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986531.954272:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986531.954310:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986531.954343:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986531.954372:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971354752 00000100:00100000:3.0:1788986531.954381:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971354752 00000100:00100000:1.0:1788986531.954870:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971354880 00000100:00100000:1.0:1788986531.954875:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971354880 00000100:00100000:1.0:1788986531.954918:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1639 00000100:00100000:1.0:1788986531.954927:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971354880:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986531.955009:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971354880:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 83us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986531.955016:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1639 00000100:00100000:2.0:1788986531.955248:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971355136 00000100:00100000:2.0:1788986531.955254:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971355136 00000100:00100000:2.0:1788986531.955289:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1217 00000100:00100000:2.0:1788986531.955297:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971355136:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986531.955327:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971355136:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986531.955333:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1217 00000100:00080000:2.0:1788986531.955349:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986531.955353:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986531.963848:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1287 00000100:00100000:3.0:1788986531.963869:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971354752:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986531.964775:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971354752:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 81us (9596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986531.964790:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1287 00000100:00100000:1.0:1788986531.970195:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986531.970511:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971355008 00000100:00100000:3.0:1788986531.970522:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971355008 00000100:00100000:3.0:1788986531.970596:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1218 00000100:00100000:3.0:1788986531.970608:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971355008:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986531.970859:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971355008:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 253us (671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986531.970867:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1218 00000100:00080000:1.0:1788986531.971115:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986532.800456:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986533.824415:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986533.892563:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986533.893243:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993554176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986533.893651:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986533.893761:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993554176 00000100:00100000:3.0:1788986533.893771:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993554176 00000100:00100000:3.0:1788986533.893845:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 832 00000100:00100000:3.0:1788986533.893856:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993554176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986533.893906:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986533.893981:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993554176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986533.893989:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 832 00000100:00080000:3.0:1788986533.894015:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986533.894071:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993554176:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986534.848355:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986534.916385:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993554688:0@lo:400:kworker.0 00000100:00100000:1.0:1788986534.916470:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986534.916545:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986534.916552:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993554560:0@lo:400:kworker.0 00000100:00100000:1.0:1788986534.916581:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986534.916615:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993554560 00000100:00100000:2.0:1788986534.916621:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993554304:0@lo:400:kworker.0 00000100:00100000:1.0:1788986534.916624:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993554560 00000100:00100000:2.0:1788986534.916665:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986534.916691:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640 00000100:00100000:1.0:1788986534.916702:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993554560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986534.916703:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993554816:0@lo:400:kworker.0 00000100:00100000:2.0:1788986534.916730:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986534.916752:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788986534.916760:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993554432:0@lo:400:kworker.0 00000100:00100000:1.0:1788986534.916772:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993554560:12345-0@lo:400:kworker.0 Request processed in 72us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986534.916781:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640 00000100:00100000:2.0:1788986534.916787:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986534.916807:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993554816 00000100:00100000:1.0:1788986534.916812:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993554816 00000100:00100000:2.0:1788986534.916816:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993554944:0@lo:400:kworker.0 00000100:00100000:1.0:1788986534.916843:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993554432 00000100:00100000:2.0:1788986534.916844:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986534.916848:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993554432 00000100:00100000:1.0:1788986534.916871:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00100000:1.0:1788986534.916878:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993554816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986534.916883:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993554688 00000100:00100000:2.0:1788986534.916889:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993554688 00000100:00100000:1.0:1788986534.916921:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993554816:12345-0@lo:400:kworker.0 Request processed in 42us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986534.916924:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993554944 00000100:00100000:2.0:1788986534.916929:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993554944 00000100:00100000:1.0:1788986534.916931:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00100000:1.0:1788986534.916951:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1642 00000100:00100000:2.0:1788986534.916960:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1219 00000100:00100000:1.0:1788986534.916961:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993554432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986534.916974:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993554688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986534.916995:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993554432:12345-0@lo:400:kworker.0 Request processed in 37us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986534.917002:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1642 00000100:00100000:2.0:1788986534.917021:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993554688:12345-0@lo:400:kworker.0 Request processed in 50us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986534.917028:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1219 00000100:00100000:2.0:1788986534.917045:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1220 00000100:00100000:2.0:1788986534.917052:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993554944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986534.917081:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993554944:12345-0@lo:400:kworker.0 Request processed in 30us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986534.917117:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1220 00000100:00080000:3.0:1788986534.917199:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986534.917204:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986534.917215:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993554304 00000100:00100000:3.0:1788986534.917220:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993554304 00000100:00100000:3.0:1788986534.917248:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1288 00000100:00100000:3.0:1788986534.917257:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993554304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986534.917330:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993554560:0@lo:400:kworker.0 00000100:00100000:2.0:1788986534.926041:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993554432:0@lo:400:kworker.0 00000100:00100000:2.0:1788986534.926061:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993554944:0@lo:400:kworker.0 00000100:00100000:2.0:1788986534.926073:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993554816:0@lo:400:kworker.0 00000100:00100000:3.0:1788986534.926617:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993554304:12345-0@lo:400:kworker.0 Request processed in 9359us (9949us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986534.926628:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1288 00000100:00100000:2.0:1788986534.926910:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993554304:0@lo:400:kworker.0 00000100:00100000:1.0:1788986534.931465:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993554688:0@lo:400:kworker.0 00000100:00100000:2.0:1788986535.425684:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986535.427235:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993555072:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986535.427297:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986535.427487:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993555072 00000100:00100000:3.0:1788986535.427507:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993555072 00000100:00100000:3.0:1788986535.427557:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 833 00000100:00100000:3.0:1788986535.427567:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993555072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986535.427599:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986535.427651:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993555072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986535.427658:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 833 00000100:00100000:2.0:1788986535.427982:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993555072:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986535.872328:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986536.186381:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986536.186691:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971355264 00000100:00100000:3.0:1788986536.186704:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971355264 00000100:00100000:3.0:1788986536.186807:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 946 00000100:00100000:3.0:1788986536.186821:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:51450:x1875885971355264:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986536.187208:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:51450:x1875885971355264:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 388us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986536.187218:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 946 00000100:00080000:0.0:1788986536.187525:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986536.191486:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986536.191591:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971355392 00000100:00100000:3.0:1788986536.191604:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971355392 00000100:00100000:3.0:1788986536.191767:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 518 00000100:00100000:3.0:1788986536.191780:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51450:x1875885971355392:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986536.193232:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51450:x1875885971355392:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 1448us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986536.193246:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 518 00000100:00080000:0.0:1788986536.193343:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986536.196718:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986536.205179:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971355520 00000100:00100000:0.0:1788986536.205200:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971355520 00000100:00100000:0.0:1788986536.205329:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 519 00000100:00100000:0.0:1788986536.205344:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51450:x1875885971355520:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986536.205844:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51450:x1875885971355520:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 503us (9139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986536.205853:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 519 00000100:00080000:3.0:1788986536.206203:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986536.212932:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986536.213160:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971355648 00000100:00100000:2.0:1788986536.213173:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971355648 00000100:00100000:2.0:1788986536.213254:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 947 00000100:00100000:2.0:1788986536.213267:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:51450:x1875885971355648:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986536.213837:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:51450:x1875885971355648:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 570us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986536.213846:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 947 00000100:00100000:1.0:1788986536.217551:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986536.217689:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971355776 00000100:00100000:0.0:1788986536.217701:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971355776 00000100:00100000:0.0:1788986536.217765:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 948 00000100:00100000:0.0:1788986536.217775:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:51450:x1875885971355776:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986536.217896:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:51450:x1875885971355776:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 121us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986536.217903:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 948 00000100:00100000:3.0:1788986536.224500:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986536.224698:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971355904 00000100:00100000:0.0:1788986536.224711:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971355904 00000100:00100000:0.0:1788986536.224783:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 520 00000100:00100000:0.0:1788986536.224795:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51450:x1875885971355904:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986536.225935:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51450:x1875885971355904:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 1135us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986536.225947:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 520 00000100:00100000:1.0:1788986536.233629:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986536.233741:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971356032 00000100:00100000:3.0:1788986536.233756:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971356032 00000100:00100000:3.0:1788986536.233881:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 521 00000100:00100000:3.0:1788986536.233895:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51450:x1875885971356032:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986536.234637:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:51450:x1875885971356032:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 742us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986536.234648:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 521 00000100:00100000:1.0:1788986536.237521:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986536.237700:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971356160 00000100:00100000:2.0:1788986536.237713:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971356160 00000100:00100000:2.0:1788986536.237821:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 949 00000100:00100000:2.0:1788986536.237835:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:51450:x1875885971356160:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986536.238743:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:51450:x1875885971356160:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 908us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986536.238754:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 949 00000100:00100000:3.0:1788986536.302345:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986536.302390:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971356288 00000100:00100000:3.0:1788986536.302406:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971356288 00000100:00100000:3.0:1788986536.302470:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 950 00000100:00100000:3.0:1788986536.302480:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:51451:x1875885971356288:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986536.302498:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986536.302527:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54938b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13bc expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986536.302591:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549392 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986536.302605:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986536.302619:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986536.302653:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00000004:00200000:3.0:1788986536.302657:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986536.302678:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549392 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986536.302701:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54938b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13bc expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986536.302717:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549392 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13bc expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986536.302724:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:3.0:1788986536.302726:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986536.302730:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788986536.302778:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:51451:x1875885971356288:12345-192.168.206.21@tcp:101:rm.0 Request processed in 300us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986536.302785:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 950 00000100:00100000:2.0:1788986536.316749:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986536.316781:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971356544 00000100:00100000:2.0:1788986536.316790:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971356544 00000100:00100000:2.0:1788986536.316839:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 951 00000100:00100000:2.0:1788986536.316848:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:51451:x1875885971356544:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986536.316868:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986536.316887:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549399 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13c3 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986536.316964:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00010000:00010000:2.0:1788986536.317195:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549399 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13c3 expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986536.317210:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:2.0:1788986536.317213:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788986536.317219:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549399 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13c3 expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986536.317231:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1000, rc 0) 00000100:00100000:2.0:1788986536.317285:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:51451:x1875885971356544:12345-192.168.206.21@tcp:101:rm.0 Request processed in 438us (544us total) trans 4294967656 rc 301/301 00000100:00100000:2.0:1788986536.317292:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 951 00000100:00100000:1.0:1788986536.326671:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986536.327042:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971356672 00000100:00100000:0.0:1788986536.327051:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971356672 00000100:00100000:3.0:1788986536.328410:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 94 00000100:00100000:3.0:1788986536.328424:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:51451:x1875885971356672:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:3.0:1788986536.342512:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:51451:x1875885971356672:12345-192.168.206.21@tcp:37:rm.0 Request processed in 14083us (15964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986536.342525:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 94 00000100:00100000:0.0:1788986536.353266:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986536.353345:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971356928 00000100:00100000:1.0:1788986536.353355:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971356928 00000100:00100000:1.0:1788986536.353420:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 95 00000100:00100000:1.0:1788986536.353432:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:51451:x1875885971356928:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:1.0:1788986536.353667:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:51451:x1875885971356928:12345-192.168.206.21@tcp:35:rm.0 Request processed in 238us (411us total) trans 4294967657 rc 0/0 00000100:00100000:1.0:1788986536.353675:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 95 00000100:00100000:0.0:1788986536.361238:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986536.370479:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971357184 00000100:00100000:0.0:1788986536.370493:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971357184 00000100:00100000:0.0:1788986536.370556:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 952 00000100:00100000:0.0:1788986536.370567:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:51451:x1875885971357184:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1788986536.370617:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788986536.370642:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549392 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13bc expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.370666:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549330 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x48:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13a7 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.370685:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:0.0:1788986536.370706:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549051 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d12f1 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.370716:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:0.0:1788986536.370723:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986536.370743:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5493a7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.370755:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5493a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.370764:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5493a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.370774:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5493ae lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.370781:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5493ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.370788:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5493ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.371192:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5493b5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.371203:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5493b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.371210:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5493b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986536.371953:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x48:0x0]: returning size 16384 00010000:00010000:0.0:1788986536.371972:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5493b5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.371980:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5493b5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.371987:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5493b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.371993:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986536.371997:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5493b5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.372004:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5493b5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.372013:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x48:0x0].0x0 (ffff9b0a4823bd00) 00010000:00010000:0.0:1788986536.372016:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788986536.372020:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5493b5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.372025:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5493b5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x48:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.372043:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5493a7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.372048:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5493a7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.372054:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5493a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.372059:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986536.372062:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5493a7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.372068:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5493a7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.372074:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:0.0:1788986536.372077:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986536.372080:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5493a7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986536.372085:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf5493a7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986536.372133:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000072fa1fad reply state 000000001eb38db7 transno 4294967658 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5493ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986536.372141:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986536.372227:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:51451:x1875885971357184:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1659us (10993us total) trans 4294967658 rc 0/0 00000100:00100000:0.0:1788986536.372236:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 952 00010000:00010000:3.0:1788986536.384276:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5493ae lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986536.384294:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5493ae lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986536.384302:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5493ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986536.384312:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986536.384316:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5493ae lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986536.384324:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5493ae lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986536.384340:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd3cc1b73 (ffff9b0a4823ba00) 00010000:00010000:3.0:1788986536.384344:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986536.384348:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5493ae lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986536.384354:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf5493ae lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xd3cc1b73 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788986536.500825:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967658 is committed 00010000:00010000:2.0:1788986536.918657:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986537.074981:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986537.075020:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986537.075059:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986537.075083:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986537.075136:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971357312 00000100:00100000:0.0:1788986537.075145:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971357312 00000100:00100000:1.0:1788986537.075155:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971357696 00000100:00100000:1.0:1788986537.075162:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971357696 00000100:00100000:0.0:1788986537.075199:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1289 00000100:00100000:1.0:1788986537.075203:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971357568 00000100:00100000:1.0:1788986537.075207:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971357568 00000100:00100000:0.0:1788986537.075213:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971357312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986537.075229:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1221 00000100:00100000:1.0:1788986537.075238:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971357696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986537.075282:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971357312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 71us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986537.075283:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971357696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986537.075299:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1289 00000100:00100000:1.0:1788986537.075300:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1221 00000100:00100000:1.0:1788986537.075333:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1222 00000100:00100000:1.0:1788986537.075343:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971357568:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986537.075368:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971357568:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986537.075375:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1222 00000100:00100000:3.0:1788986537.075627:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971357440 00000100:00100000:3.0:1788986537.075631:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971357440 00000100:00100000:3.0:1788986537.075666:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1643 00000100:00100000:3.0:1788986537.075672:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971357440:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986537.075713:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971357440:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 41us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986537.075719:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1643 00000020:00000080:3.0:1788986537.590783:0:86986:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe3b27bfa0 20000000:00000080:3.0:1788986537.590800:0:86986:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f8ba400 uarg=0000000000000000 00010000:00010000:2.0:1788986537.602564:0:86986:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986537.602582:0:86986:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986537.602633:0:86986:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986537.602652:0:86986:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986537.602668:0:86986:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549043 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54903c expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986537.602676:0:86986:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986537.602714:0:86986:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549043 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54903c expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986537.602729:0:86986:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549043 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54903c expref: 18 pid: 5849 timeout: 2421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986537.602742:0:86986:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86986:1875885993555200:0@lo:104: 00000100:00100000:2.0:1788986537.602800:0:86986:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986537.602858:0:86986:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0942afef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788986537.602866:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993555200 00000100:00100000:1.0:1788986537.602874:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993555200 00000100:00100000:1.0:1788986537.602922:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:1.0:1788986537.602944:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:86986:x1875885993555200:12345-0@lo:104: 00010000:00010000:1.0:1788986537.602960:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986537.603026:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986537.603033:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:86986:x1875885993555200:12345-0@lo:104: Request processed in 102us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986537.603040:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00010000:00010000:0.0:1788986537.603113:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986537.603120:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603127:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986537.603130:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603139:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986537.603146:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986537.603152:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986537.603191:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603198:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986537.603219:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603225:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3200/0xc20d828fcf54903c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549043 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603241:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986537.603243:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986537.603245:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986537.603255:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993555328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986537.603285:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986537.603323:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993555328 00000100:00100000:0.0:1788986537.603327:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993555328 00010000:00010000:0.0:1788986537.603346:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549043 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54903c expref: 19 pid: 5849 timeout: 2421 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986537.603365:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1788986537.603370:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993555328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986537.603379:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986537.603383:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549043 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54903c expref: 19 pid: 5849 timeout: 2421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603392:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549043 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54903c expref: 19 pid: 5849 timeout: 2421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603405:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603414:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603426:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603433:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603450:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603456:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603461:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986537.603466:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986537.603468:0:86986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549043 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54903c expref: 19 pid: 5849 timeout: 2421 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603473:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986537.603477:0:86986:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:86986:1875885993555200:0@lo:104: 00010000:00010000:0.0:1788986537.603482:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986537.603489:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986537.603492:0:86986:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986537.603499:0:86986:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986537.603506:0:86986:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986537.603512:0:86986:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493bc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 86986 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986537.603515:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993555328:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986537.603522:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00000100:00100000:0.0:1788986537.603546:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993555328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986537.932069:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986538.537544:0:87034:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb8ce5a60 20000000:00000080:2.0:1788986538.537565:0:87034:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b09436cbc00 uarg=0000000000000000 00010000:00010000:2.0:1788986538.537786:0:87034:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986538.537800:0:87034:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986538.537818:0:87034:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986538.537838:0:87034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493c3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986538.537852:0:87034:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493c3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986538.537862:0:87034:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493c3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986538.537872:0:87034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493c3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986538.537880:0:87034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493c3 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986538.537886:0:87034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493c3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986538.537892:0:87034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986538.537896:0:87034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493c3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986538.537903:0:87034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493c3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986538.537914:0:87034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493c3 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986538.537921:0:87034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493c3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986538.537926:0:87034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493c3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986538.691816:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986538.691823:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986538.691828:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986538.691873:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986538.691884:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986538.691908:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986538.691935:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993555456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986538.692002:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986538.692053:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f89eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788986538.699205:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993555456 00000100:00100000:3.0:1788986538.699217:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993555456 00000100:00100000:3.0:1788986538.699265:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1788986538.699275:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993555456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986538.699291:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986538.699478:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf5493d1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5493ca expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986538.699506:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf5493d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5493ca expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986538.699518:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf5493d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5493ca expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986538.699527:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788986538.699598:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993555456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 325us (7595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986538.699605:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:3.0:1788986538.699659:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993555456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986538.699675:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5493d1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986538.699685:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5493d1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986538.699706:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986538.699711:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5493d1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986538.699718:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5493d1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986538.944939:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986539.008221:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986539.008241:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993555584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986539.008302:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986539.008398:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993555584 00000100:00100000:0.0:1788986539.008406:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993555584 00000100:00100000:0.0:1788986539.008472:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 834 00000100:00100000:0.0:1788986539.008482:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993555584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986539.008515:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986539.008558:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993555584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986539.008565:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 834 00000100:00080000:0.0:1788986539.008595:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986539.012448:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993555584:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788986539.382118:0:87082:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcbd38a040 20000000:00000080:2.0:1788986539.382135:0:87082:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f8ba400 uarg=0000000000000000 00010000:00010000:2.0:1788986539.382475:0:87082:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986539.382489:0:87082:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986539.382573:0:87082:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986539.382590:0:87082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986539.382605:0:87082:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf5493d1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5493ca expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986539.382613:0:87082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986539.382646:0:87082:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf5493d1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5493ca expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986539.382659:0:87082:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf5493d1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5493ca expref: 18 pid: 5846 timeout: 2423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986539.382672:0:87082:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87082:1875885993555712:0@lo:104: 00000100:00100000:2.0:1788986539.382727:0:87082:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986539.382820:0:87082:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0942afe000 going to sleep for 11 seconds 00000100:00100000:3.0:1788986539.383065:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993555712 00000100:00100000:3.0:1788986539.383072:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993555712 00000100:00100000:3.0:1788986539.383400:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:3.0:1788986539.383408:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:87082:x1875885993555712:12345-0@lo:104: 00010000:00010000:3.0:1788986539.383421:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5493d1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986539.383489:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986539.383495:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:87082:x1875885993555712:12345-0@lo:104: Request processed in 89us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986539.383508:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00010000:00010000:0.0:1788986539.383549:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986539.383556:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5493d1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383564:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986539.383568:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5493d1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383577:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5493d1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986539.383584:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5493d1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986539.383590:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986539.383618:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5493d1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383625:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986539.383641:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5493d1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383647:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf5493ca lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5493d1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383662:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986539.383664:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986539.383665:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986539.383671:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986539.383680:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993555840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986539.383710:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986539.383741:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993555840 00000100:00100000:0.0:1788986539.383745:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993555840 00010000:00010000:0.0:1788986539.383761:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf5493d1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5493ca expref: 19 pid: 5846 timeout: 2423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986539.383780:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1788986539.383785:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993555840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986539.383795:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986539.383799:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf5493d1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5493ca expref: 19 pid: 5846 timeout: 2423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383809:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf5493d1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5493ca expref: 19 pid: 5846 timeout: 2423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383823:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383831:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383843:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383850:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383857:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383863:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383868:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986539.383873:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383880:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383888:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.383911:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986539.383935:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993555840:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986539.383940:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1788986539.383993:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993555840:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986539.384249:0:87082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf5493d1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5493ca expref: 18 pid: 5846 timeout: 2423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986539.384259:0:87082:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87082:1875885993555712:0@lo:104: 00010000:00010000:2.0:1788986539.384271:0:87082:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986539.384279:0:87082:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986539.384285:0:87082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986539.384296:0:87082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf5493d8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986539.974224:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986540.032362:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993555968:0@lo:400:kworker.0 00000100:00100000:3.0:1788986540.032456:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986540.032678:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993556096:0@lo:400:kworker.0 00000100:00100000:2.0:1788986540.032706:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986540.032759:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993555968 00000100:00100000:2.0:1788986540.032765:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993555968 00000100:00100000:2.0:1788986540.032803:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993556096 00000100:00100000:2.0:1788986540.032806:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993556096 00000100:00100000:2.0:1788986540.032844:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00100000:2.0:1788986540.032853:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993555968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986540.036465:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1645 00000100:00100000:0.0:1788986540.036487:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993556096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986540.036591:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993556096:12345-0@lo:400:kworker.0 Request processed in 114us (3883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986540.036599:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1645 00000100:00080000:0.0:1788986540.036651:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986540.036692:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993556096:0@lo:400:kworker.0 00000100:00100000:1.0:1788986540.037017:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986540.037027:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993556480:0@lo:400:kworker.0 00000100:00100000:1.0:1788986540.037079:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986540.037927:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993556224:0@lo:400:kworker.0 00000100:00100000:0.0:1788986540.037977:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986540.038006:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986540.038013:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993556352:0@lo:400:kworker.0 00000100:00100000:0.0:1788986540.038035:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986540.038404:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993556352 00000100:00100000:0.0:1788986540.038412:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993556352 00000100:00100000:0.0:1788986540.038480:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:0.0:1788986540.038487:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993556352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986540.038533:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993556352:12345-0@lo:400:kworker.0 Request processed in 46us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986540.038539:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00080000:0.0:1788986540.038557:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986540.038580:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993556352:0@lo:400:kworker.0 00000100:00100000:1.0:1788986540.039075:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993556480 00000100:00100000:1.0:1788986540.039080:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993556480 00000100:00100000:1.0:1788986540.039140:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993556224 00000100:00100000:1.0:1788986540.039144:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993556224 00000100:00100000:1.0:1788986540.039162:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1788986540.039169:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993556480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986540.039211:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993556480:12345-0@lo:400:kworker.0 Request processed in 42us (2132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986540.039217:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1223 00000100:00100000:1.0:1788986540.039229:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1788986540.039235:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993556224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986540.039263:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993556224:12345-0@lo:400:kworker.0 Request processed in 28us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986540.039269:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1224 00000100:00100000:1.0:1788986540.039299:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993556224:0@lo:400:kworker.0 00000100:00100000:1.0:1788986540.039324:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993556480:0@lo:400:kworker.0 00000100:00080000:0.0:1788986540.039466:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986540.041680:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993555968:12345-0@lo:400:kworker.0 Request processed in 8819us (9216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986540.041694:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00000100:00100000:3.0:1788986540.051057:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993555968:0@lo:400:kworker.0 00000100:00100000:3.0:1788986540.544325:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986540.544346:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993556608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986540.544403:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986540.544527:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993556608 00000100:00100000:0.0:1788986540.544535:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993556608 00000100:00100000:0.0:1788986540.544577:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 835 00000100:00100000:0.0:1788986540.544585:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993556608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986540.544613:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986540.544659:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993556608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986540.544666:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 835 00000100:00100000:3.0:1788986540.544738:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993556608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986540.993738:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788986541.189474:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986541.189483:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986541.189488:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986541.189535:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986541.189551:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986541.189562:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986541.189585:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993556736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986541.189652:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986541.189707:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51df2a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788986541.190464:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993556736 00000100:00100000:2.0:1788986541.190473:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993556736 00000100:00100000:2.0:1788986541.190525:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1788986541.190534:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993556736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986541.190547:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986541.190562:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf5493e6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5493df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986541.190586:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf5493e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5493df expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986541.190597:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf5493e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5493df expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986541.190611:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986541.190668:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993556736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986541.190675:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:2.0:1788986541.190718:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993556736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986541.190733:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5493e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986541.190741:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5493e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986541.190759:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986541.190764:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5493e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986541.190771:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5493e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986542.016250:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986542.197985:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986542.200378:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971357952 00000100:00100000:3.0:1788986542.200391:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971357952 00000100:00100000:3.0:1788986542.200552:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1647 00000100:00100000:3.0:1788986542.200563:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971357952:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986542.200643:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971357952:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 82us (2667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986542.200650:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1647 00000100:00100000:3.0:1788986542.200716:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986542.200830:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986542.200855:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986542.200875:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971357824 00000100:00100000:3.0:1788986542.200879:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971357824 00000100:00100000:3.0:1788986542.200904:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1292 00000100:00100000:3.0:1788986542.200910:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971357824:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986542.200941:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971357824:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986542.200951:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1292 00000100:00100000:3.0:1788986542.200981:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971358080 00000100:00100000:3.0:1788986542.200985:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971358080 00000100:00100000:3.0:1788986542.201011:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971358208 00000100:00100000:3.0:1788986542.201015:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971358208 00000100:00100000:3.0:1788986542.201038:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1225 00000100:00100000:3.0:1788986542.201044:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971358080:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986542.201070:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971358080:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986542.201077:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1225 00000100:00100000:3.0:1788986542.201114:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1226 00000100:00100000:3.0:1788986542.201121:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971358208:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986542.201144:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971358208:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986542.201150:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1226 00000100:00080000:1.0:1788986542.201501:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986542.201505:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986542.201508:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788986543.044342:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986543.561842:0:87278:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff7bc3e6c0 20000000:00000080:3.0:1788986543.561859:0:87278:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b09436c9c00 uarg=0000000000000000 00010000:00010000:3.0:1788986543.564357:0:87278:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986543.564376:0:87278:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986543.564395:0:87278:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986543.564535:0:87278:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986543.564552:0:87278:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf5493e6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5493df expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986543.564564:0:87278:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986543.564601:0:87278:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf5493e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5493df expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986543.564616:0:87278:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf5493e6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5493df expref: 18 pid: 5849 timeout: 2427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986543.564629:0:87278:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87278:1875885993556864:0@lo:104: 00000100:00100000:3.0:1788986543.564760:0:87278:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986543.564815:0:87278:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09429d0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788986543.564874:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993556864 00000100:00100000:1.0:1788986543.564889:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993556864 00000100:00100000:1.0:1788986543.564965:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:1.0:1788986543.564975:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:87278:x1875885993556864:12345-0@lo:104: 00010000:00010000:1.0:1788986543.564995:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5493e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565122:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986543.565128:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:87278:x1875885993556864:12345-0@lo:104: Request processed in 155us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986543.565135:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00010000:00010000:1.0:1788986543.565160:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986543.565167:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5493e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565175:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986543.565179:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5493e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565188:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5493e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986543.565196:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5493e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986543.565201:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986543.565240:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5493e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565247:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986543.565269:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5493e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565276:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf5493df lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5493e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565296:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986543.565298:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986543.565299:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986543.565322:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993556992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986543.565373:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986543.565429:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993556992 00000100:00100000:1.0:1788986543.565434:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993556992 00010000:00010000:1.0:1788986543.565455:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf5493e6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5493df expref: 19 pid: 5849 timeout: 2427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986543.565480:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1788986543.565487:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993556992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986543.565498:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986543.565502:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf5493e6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5493df expref: 19 pid: 5849 timeout: 2427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565514:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf5493e6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5493df expref: 19 pid: 5849 timeout: 2427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565532:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565542:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565563:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565571:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565578:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565585:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565590:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986543.565595:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565711:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565720:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986543.565731:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986543.565763:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993556992:12345-0@lo:103:ldlm_bl.0 Request processed in 277us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986543.565771:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00000100:00100000:1.0:1788986543.565813:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993556992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986543.566605:0:87278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf5493e6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5493df expref: 18 pid: 5849 timeout: 2427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986543.566624:0:87278:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87278:1875885993556864:0@lo:104: 00010000:00010000:3.0:1788986543.566646:0:87278:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986543.566656:0:87278:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986543.566662:0:87278:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986543.566669:0:87278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5493ed lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87278 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986544.069384:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986544.130535:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993557120:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986544.130598:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986544.131475:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993557120 00000100:00100000:0.0:1788986544.131486:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993557120 00000100:00100000:0.0:1788986544.131549:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1788986544.131561:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993557120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986544.131595:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788986544.131637:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986544.131661:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993557120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (1061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986544.131672:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 836 00000100:00100000:0.0:1788986544.131725:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993557120:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1788986544.656530:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986544.656538:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986544.656544:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986544.656591:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986544.656603:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986544.656618:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986544.656644:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993557248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986544.656702:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986544.656795:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161900 going to sleep for 11 seconds 00000100:00100000:0.0:1788986544.663450:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993557248 00000100:00100000:0.0:1788986544.663464:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993557248 00000100:00100000:0.0:1788986544.663520:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:0.0:1788986544.663534:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993557248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986544.663550:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986544.663568:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5493fb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5493f4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986544.663598:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5493fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5493f4 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986544.663609:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5493fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5493f4 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986544.663617:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef000, rc 0) 00000100:00100000:0.0:1788986544.663685:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993557248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (6982us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986544.663691:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:2.0:1788986544.666473:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993557248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986544.666508:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5493fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986544.666520:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5493fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986544.666540:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986544.666546:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5493fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986544.666554:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5493fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986545.090383:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986545.154821:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993557376:0@lo:400:kworker.0 00000100:00100000:3.0:1788986545.154860:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993557760:0@lo:400:kworker.0 00000100:00100000:1.0:1788986545.154923:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993557632:0@lo:400:kworker.0 00000100:00100000:2.0:1788986545.154950:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993557504:0@lo:400:kworker.0 00000100:00100000:3.0:1788986545.158896:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986545.159034:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993557760 00000100:00100000:3.0:1788986545.159044:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993557760 00000100:00100000:3.0:1788986545.159128:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1788986545.159139:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993557760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986545.159215:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993557760:12345-0@lo:400:kworker.0 Request processed in 79us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986545.159223:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1227 00000100:00100000:3.0:1788986545.159271:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993557760:0@lo:400:kworker.0 00000100:00100000:0.0:1788986545.162405:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986545.162516:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993557888:0@lo:400:kworker.0 00000100:00100000:0.0:1788986545.162606:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986545.162655:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993557888 00000100:00100000:0.0:1788986545.162664:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993557888 00000100:00100000:0.0:1788986545.162744:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648 00000100:00100000:0.0:1788986545.162754:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993557888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986545.162818:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993557888:12345-0@lo:400:kworker.0 Request processed in 65us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986545.162826:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648 00000100:00100000:0.0:1788986545.162880:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993557888:0@lo:400:kworker.0 00000100:00080000:3.0:1788986545.163269:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986545.164774:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993557376 00000100:00100000:3.0:1788986545.164790:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993557376 00000100:00100000:3.0:1788986545.164859:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1788986545.164870:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993557376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986545.164971:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993557376:12345-0@lo:400:kworker.0 Request processed in 102us (2587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986545.164978:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:3.0:1788986545.165040:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993557376:0@lo:400:kworker.0 00000100:00100000:1.0:1788986545.168403:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986545.168568:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993557632 00000100:00100000:0.0:1788986545.168580:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993557632 00000100:00100000:0.0:1788986545.168661:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1649 00000100:00100000:0.0:1788986545.168672:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993557632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986545.168739:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993557632:12345-0@lo:400:kworker.0 Request processed in 69us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986545.168746:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1649 00000100:00080000:1.0:1788986545.168919:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986545.168962:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993557632:0@lo:400:kworker.0 00000100:00100000:2.0:1788986545.169748:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986545.169795:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993558016:0@lo:400:kworker.0 00000100:00100000:2.0:1788986545.169832:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986545.169886:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993558016 00000100:00100000:0.0:1788986545.169892:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993558016 00000100:00100000:0.0:1788986545.169948:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1228 00000100:00100000:0.0:1788986545.169957:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993558016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986545.170003:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993558016:12345-0@lo:400:kworker.0 Request processed in 47us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986545.170009:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1228 00000100:00100000:3.0:1788986545.170071:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993557504 00000100:00100000:3.0:1788986545.170076:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993557504 00000100:00100000:3.0:1788986545.170130:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:3.0:1788986545.170138:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993557504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986545.170175:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993557504:12345-0@lo:400:kworker.0 Request processed in 38us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986545.170181:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00080000:2.0:1788986545.170288:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986545.170318:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993557504:0@lo:400:kworker.0 00000100:00100000:2.0:1788986545.170330:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993558016:0@lo:400:kworker.0 00000100:00100000:1.0:1788986545.667932:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993558144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986545.668027:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986545.668158:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993558144 00000100:00100000:1.0:1788986545.668167:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993558144 00000100:00100000:1.0:1788986545.668225:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1788986545.668235:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993558144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986545.668281:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986545.668343:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993558144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986545.668350:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 837 00000100:00100000:1.0:1788986545.668420:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993558144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986546.112458:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986547.136296:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986547.314609:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986547.314808:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971358464 00000100:00100000:0.0:1788986547.314818:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971358464 00000100:00100000:0.0:1788986547.314893:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1651 00000100:00100000:0.0:1788986547.314904:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971358464:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:1.0:1788986547.314998:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986547.318451:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971358464:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 3538us (3839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986547.318469:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1651 00000100:00100000:3.0:1788986547.320271:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986547.320585:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986547.320625:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986547.322158:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971358336 00000100:00100000:2.0:1788986547.322170:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971358336 00000100:00100000:2.0:1788986547.322223:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1295 00000100:00100000:2.0:1788986547.322232:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971358336:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986547.322324:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971358336:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 93us (1739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986547.322331:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1295 00000100:00100000:1.0:1788986547.323181:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971358720 00000100:00100000:1.0:1788986547.323187:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971358720 00000100:00100000:1.0:1788986547.323317:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971358592 00000100:00100000:1.0:1788986547.323321:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971358592 00000100:00080000:0.0:1788986547.323343:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986547.323347:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986547.323445:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1229 00000100:00100000:2.0:1788986547.323455:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971358720:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986547.323512:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971358720:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 59us (3247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986547.323525:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1229 00000100:00100000:1.0:1788986547.324444:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1230 00000100:00100000:1.0:1788986547.324453:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971358592:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986547.324513:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971358592:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 46us (3871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986547.324520:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1230 00010000:00010000:2.0:1788986548.162060:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986549.185133:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986549.252445:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993558272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986549.252749:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986549.253014:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993558272 00000100:00100000:2.0:1788986549.253027:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993558272 00000100:00080000:0.0:1788986549.253614:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986549.253961:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 838 00000100:00100000:2.0:1788986549.253976:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993558272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986549.254010:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986549.254076:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993558272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986549.255060:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 838 00000100:00100000:1.0:1788986549.255457:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993558272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986550.208467:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986550.272545:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993558784:0@lo:400:kworker.0 00000100:00100000:1.0:1788986550.272609:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986550.272671:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986550.272678:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993558656:0@lo:400:kworker.0 00000100:00100000:1.0:1788986550.272703:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986550.272735:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993558784 00000100:00100000:1.0:1788986550.272742:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993558784 00000100:00100000:1.0:1788986550.272788:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1788986550.272797:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993558784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986550.272846:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993558784:12345-0@lo:400:kworker.0 Request processed in 50us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986550.272853:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1231 00000100:00100000:1.0:1788986550.272875:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993558656 00000100:00100000:1.0:1788986550.272879:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993558656 00000100:00100000:1.0:1788986550.272912:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:1.0:1788986550.272919:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993558656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986550.272948:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993558656:12345-0@lo:400:kworker.0 Request processed in 30us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986550.272954:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00080000:1.0:1788986550.272973:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986550.273003:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993558656:0@lo:400:kworker.0 00000100:00100000:1.0:1788986550.273013:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993558784:0@lo:400:kworker.0 00000100:00100000:2.0:1788986550.273154:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993558528:0@lo:400:kworker.0 00000100:00100000:2.0:1788986550.273186:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986550.273221:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993559040:0@lo:400:kworker.0 00000100:00100000:2.0:1788986550.273243:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986550.273268:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788986550.273274:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993558400:0@lo:400:kworker.0 00000100:00100000:2.0:1788986550.273298:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986550.273317:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993558912:0@lo:400:kworker.0 00000100:00100000:2.0:1788986550.273335:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986550.273359:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993558528 00000100:00100000:2.0:1788986550.273363:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993558528 00000100:00100000:2.0:1788986550.273397:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993558912 00000100:00100000:2.0:1788986550.273400:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993558912 00000100:00100000:2.0:1788986550.273422:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1653 00000100:00100000:2.0:1788986550.273428:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993558528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986550.273464:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993558528:12345-0@lo:400:kworker.0 Request processed in 35us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986550.273469:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1653 00000100:00100000:2.0:1788986550.273483:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:2.0:1788986550.273489:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993558912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986550.273514:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993558912:12345-0@lo:400:kworker.0 Request processed in 26us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986550.273520:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00080000:2.0:1788986550.273537:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986550.273557:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993558912:0@lo:400:kworker.0 00000100:00100000:2.0:1788986550.273566:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993558528:0@lo:400:kworker.0 00000100:00100000:1.0:1788986550.275356:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993559040 00000100:00100000:1.0:1788986550.275377:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993559040 00000100:00080000:2.0:1788986550.275516:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986550.275567:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1232 00000100:00100000:1.0:1788986550.275578:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993559040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986550.275664:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993559040:12345-0@lo:400:kworker.0 Request processed in 89us (2419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986550.275670:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1232 00000100:00100000:2.0:1788986550.275759:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993559040:0@lo:400:kworker.0 00000100:00100000:3.0:1788986550.275837:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993558400 00000100:00100000:3.0:1788986550.275842:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993558400 00000100:00100000:3.0:1788986550.275876:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1788986550.275884:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993558400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986550.275925:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993558400:12345-0@lo:400:kworker.0 Request processed in 43us (2626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986550.275931:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:3.0:1788986550.275968:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993558400:0@lo:400:kworker.0 00000100:00100000:3.0:1788986550.784691:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986550.784712:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993559168:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986550.784774:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986550.784843:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993559168 00000100:00100000:3.0:1788986550.784851:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993559168 00000100:00100000:3.0:1788986550.784895:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 839 00000100:00100000:3.0:1788986550.784903:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993559168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986550.784932:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986550.784974:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993559168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986550.784981:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 839 00000100:00100000:3.0:1788986550.785022:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993559168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986551.232512:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986552.259955:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986552.435627:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986552.435672:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986552.435715:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986552.435756:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986552.435794:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971359104 00000100:00100000:3.0:1788986552.435807:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971359104 00000100:00100000:3.0:1788986552.435887:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971359232 00000100:00100000:3.0:1788986552.435890:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971359232 00000100:00100000:3.0:1788986552.435917:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1233 00000100:00100000:3.0:1788986552.435929:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971359104:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986552.436020:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971359104:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 93us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986552.436028:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1233 00000100:00100000:3.0:1788986552.436047:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1234 00000100:00100000:3.0:1788986552.436054:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971359232:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986552.436080:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971359232:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986552.436124:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1234 00000100:00100000:2.0:1788986552.436896:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971358976 00000100:00100000:2.0:1788986552.436912:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971358976 00000100:00100000:2.0:1788986552.436981:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1655 00000100:00100000:2.0:1788986552.436991:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971358976:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986552.437048:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971358976:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 60us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986552.437055:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1655 00000100:00080000:2.0:1788986552.437078:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986552.437083:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986552.437113:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986552.437255:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971358848 00000100:00100000:0.0:1788986552.437260:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971358848 00000100:00100000:0.0:1788986552.437301:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1297 00000100:00100000:0.0:1788986552.437309:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971358848:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986552.437339:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971358848:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (1727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986552.437346:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1297 00000001:02000400:1.0:1788986552.977637:0:87621:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 21: test nodemap mapped_trusted_noadmin fileops ========================================================== 16:42:31 (1788986551) 00010000:00010000:2.0:1788986553.281156:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:0.0:1788986554.252631:0:87669:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:0.0:1788986554.268694:0:87669:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:0.0:1788986554.306992:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986554.368490:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993559296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986554.368594:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986554.373139:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993559296 00000100:00100000:2.0:1788986554.373158:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993559296 00000100:00100000:2.0:1788986554.373254:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 840 00000100:00100000:2.0:1788986554.373266:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993559296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986554.373616:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788986554.374965:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986554.379465:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993559296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6042us (10712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986554.379485:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 840 00000100:00100000:3.0:1788986554.381046:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993559296:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788986555.320331:0:87717:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb259f710 20000000:00000080:1.0:1788986555.320364:0:87717:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a796ff000 uarg=0000000000000000 10000000:01000000:1.0:1788986555.321590:0:87717:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986555.321616:0:87717:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986555.321638:0:87717:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5493fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5493f4 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986555.321724:0:87717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986555.321772:0:87717:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5493fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5493f4 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986555.321788:0:87717:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5493fb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5493f4 expref: 18 pid: 5846 timeout: 2439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986555.321806:0:87717:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87717:1875885993559424:0@lo:104: 00000100:00100000:1.0:1788986555.321989:0:87717:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986555.322206:0:87717:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788986555.322254:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993559424 00000100:00100000:3.0:1788986555.322263:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993559424 00000100:00100000:3.0:1788986555.322378:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788986555.322389:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:87717:x1875885993559424:12345-0@lo:104: 00010000:00010000:3.0:1788986555.322404:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5493fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986555.322474:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986555.322480:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:87717:x1875885993559424:12345-0@lo:104: Request processed in 94us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986555.322487:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00010000:00010000:0.0:1788986555.322541:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986555.322549:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5493fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322556:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986555.322560:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5493fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322569:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5493fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986555.322576:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5493fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986555.322587:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986555.322618:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5493fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322624:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986555.322646:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5493fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322667:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf5493f4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5493fb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322682:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986555.322684:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986555.322685:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986555.322698:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993559552:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986555.322730:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986555.322763:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993559552 00000100:00100000:0.0:1788986555.322767:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993559552 00010000:00010000:0.0:1788986555.322785:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5493fb lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5493f4 expref: 19 pid: 5846 timeout: 2439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986555.322818:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1788986555.322825:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993559552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986555.322835:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986555.322839:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5493fb lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5493f4 expref: 19 pid: 5846 timeout: 2439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322849:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5493fb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5493f4 expref: 19 pid: 5846 timeout: 2439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322864:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322873:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322886:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322893:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322900:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322905:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322910:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986555.322914:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322921:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322929:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.322937:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986555.322965:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993559552:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986555.322974:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00000100:00100000:0.0:1788986555.323026:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993559552:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986555.323134:0:87717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf5493fb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5493f4 expref: 18 pid: 5846 timeout: 2439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986555.323145:0:87717:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87717:1875885993559424:0@lo:104: 00010000:00010000:1.0:1788986555.323160:0:87717:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986555.323168:0:87717:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986555.323174:0:87717:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986555.323181:0:87717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549402 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87717 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986555.328625:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986555.395299:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993559808:0@lo:400:kworker.0 00000100:00100000:2.0:1788986555.395411:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986555.395491:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986555.395500:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993559936:0@lo:400:kworker.0 00000100:00100000:2.0:1788986555.395534:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986555.395584:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993559808 00000100:00100000:2.0:1788986555.395594:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993559808 00000100:00100000:0.0:1788986555.396202:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993559680:0@lo:400:kworker.0 00000100:00100000:0.0:1788986555.396245:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986555.396271:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993560192:0@lo:400:kworker.0 00000100:00100000:0.0:1788986555.396294:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986555.396317:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986555.396322:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993560064:0@lo:400:kworker.0 00000100:00100000:0.0:1788986555.396358:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986555.396407:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993559936 00000100:00100000:3.0:1788986555.396414:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993559936 00000100:00100000:0.0:1788986555.396422:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993559680 00000100:00100000:0.0:1788986555.396428:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993559680 00000100:00100000:3.0:1788986555.396470:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993560192 00000100:00100000:0.0:1788986555.396472:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993560064 00000100:00100000:3.0:1788986555.396475:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993560192 00000100:00100000:0.0:1788986555.396478:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993560064 00000100:00100000:3.0:1788986555.396509:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1235 00000100:00100000:0.0:1788986555.396516:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1656 00000100:00100000:3.0:1788986555.396522:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993559936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986555.396528:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993559680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986555.397024:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993559680:12345-0@lo:400:kworker.0 Request processed in 498us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986555.397031:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1656 00000100:00100000:0.0:1788986555.397056:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00100000:3.0:1788986555.397057:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993559936:12345-0@lo:400:kworker.0 Request processed in 536us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986555.397066:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993560064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986555.397071:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1235 00000100:00100000:3.0:1788986555.397118:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1236 00000100:00100000:3.0:1788986555.397128:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993560192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986555.397134:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993560064:12345-0@lo:400:kworker.0 Request processed in 70us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986555.397141:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00100000:3.0:1788986555.397172:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993560192:12345-0@lo:400:kworker.0 Request processed in 47us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986555.397179:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1236 00000100:00100000:0.0:1788986555.397198:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993560064:0@lo:400:kworker.0 00000100:00100000:0.0:1788986555.397212:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993559680:0@lo:400:kworker.0 00000100:00100000:0.0:1788986555.397220:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993560192:0@lo:400:kworker.0 00000100:00100000:2.0:1788986555.397337:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1658 00000100:00100000:2.0:1788986555.397357:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993559808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986555.397529:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993559808:12345-0@lo:400:kworker.0 Request processed in 174us (2118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986555.397535:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1658 00000100:00080000:2.0:1788986555.397559:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986555.397565:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986555.397593:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993559936:0@lo:400:kworker.0 00000100:00100000:2.0:1788986555.397603:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993559808:0@lo:400:kworker.0 00000100:00100000:0.0:1788986555.905379:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986555.905401:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993560320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986555.905472:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986555.905527:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993560320 00000100:00100000:0.0:1788986555.905534:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993560320 00000100:00100000:0.0:1788986555.905577:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1788986555.905586:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993560320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986555.905617:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986555.905659:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993560320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986555.905665:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 841 00000100:00100000:0.0:1788986555.905709:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993560320:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788986556.036600:0:87766:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff4dbc4100 20000000:00000080:1.0:1788986556.036617:0:87766:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80efb800 uarg=0000000000000000 10000000:01000000:1.0:1788986556.036876:0:87766:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986556.036899:0:87766:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549409 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986556.036915:0:87766:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549409 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986556.036925:0:87766:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549409 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986556.036932:0:87766:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549409 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986556.036943:0:87766:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549409 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986556.036950:0:87766:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549409 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986556.036956:0:87766:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986556.036960:0:87766:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549409 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986556.036967:0:87766:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549409 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986556.036979:0:87766:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549409 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986556.036986:0:87766:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549409 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986556.036991:0:87766:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549409 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87766 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986556.353585:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986556.735265:0:87814:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0c20cd70 20000000:00000080:3.0:1788986556.735281:0:87814:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b09436c9400 uarg=0000000000000000 10000000:01000000:3.0:1788986556.736666:0:87814:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986556.736691:0:87814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549410 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986556.736708:0:87814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549410 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986556.736724:0:87814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549410 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986556.736730:0:87814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549410 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986556.736736:0:87814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549410 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986556.736742:0:87814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549410 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986556.736749:0:87814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986556.736753:0:87814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549410 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986556.736761:0:87814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549410 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986556.736772:0:87814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549410 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986556.736779:0:87814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549410 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986556.736785:0:87814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549410 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986557.057147:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986557.057155:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986557.057159:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986557.057202:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986557.057214:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986557.057225:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986557.057249:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993560448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986557.057322:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986557.057385:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c1480 going to sleep for 11 seconds 00000100:00100000:1.0:1788986557.057445:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993560448 00000100:00100000:1.0:1788986557.057453:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993560448 00000100:00100000:1.0:1788986557.057505:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1298 00000100:00100000:1.0:1788986557.057514:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993560448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986557.057526:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986557.057539:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54941e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549417 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.057560:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54941e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549417 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.057571:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54941e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549417 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.057580:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788986557.057621:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993560448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986557.057627:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1298 00000100:00100000:2.0:1788986557.057699:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993560448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986557.057775:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54941e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986557.057784:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54941e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986557.057800:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986557.057805:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54941e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986557.057813:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54941e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986557.377600:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986557.462530:0:87864:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeeca35130 20000000:00000080:2.0:1788986557.462549:0:87864:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a73ab7000 uarg=0000000000000000 10000000:01000000:2.0:1788986557.463675:0:87864:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986557.463697:0:87864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986557.463713:0:87864:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54941e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549417 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986557.463721:0:87864:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986557.463755:0:87864:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54941e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549417 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986557.463769:0:87864:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54941e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549417 expref: 18 pid: 5848 timeout: 2441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986557.463787:0:87864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87864:1875885993560576:0@lo:104: 00000100:00100000:2.0:1788986557.463843:0:87864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986557.463893:0:87864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788986557.463949:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788986557.463962:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993560576 00000100:00100000:3.0:1788986557.463969:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993560576 00000100:00100000:3.0:1788986557.464027:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788986557.464037:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094197f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:87864:x1875885993560576:12345-0@lo:104: 00010000:00010000:3.0:1788986557.464054:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54941e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986557.464135:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986557.464142:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094197f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:87864:x1875885993560576:12345-0@lo:104: Request processed in 107us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986557.464150:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:0.0:1788986557.464196:0:87864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87864:1875885993560576:0@lo:104: 00010000:00010000:0.0:1788986557.464217:0:87864:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464246:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986557.464255:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54941e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464263:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986557.464267:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54941e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464276:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54941e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986557.464284:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54941e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986557.464291:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986557.464341:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54941e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464348:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986557.464377:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54941e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464384:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549417 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54941e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464401:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986557.464403:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986557.464405:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986557.464411:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986557.464421:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993560704:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986557.464451:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986557.464482:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993560704 00000100:00100000:1.0:1788986557.464487:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993560704 00010000:00010000:1.0:1788986557.464507:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54941e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549417 expref: 19 pid: 5848 timeout: 2441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986557.464535:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1788986557.464542:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993560704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986557.464552:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986557.464558:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54941e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549417 expref: 19 pid: 5848 timeout: 2441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464568:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54941e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549417 expref: 19 pid: 5848 timeout: 2441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464580:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54941e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549417 expref: 19 pid: 5848 timeout: 2441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464592:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464600:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464614:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464621:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464628:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464634:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464640:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986557.464644:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464651:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464669:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986557.464679:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986557.464695:0:87864:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986557.464705:0:87864:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986557.464711:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993560704:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (258us total) trans 0 rc 0/0 00010000:00010000:0.0:1788986557.464718:0:87864:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549425 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986557.464724:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00000100:00100000:1.0:1788986557.464759:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993560704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986557.553613:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986557.553656:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986557.553718:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971359488 00000100:00100000:0.0:1788986557.553727:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971359488 00000100:00100000:0.0:1788986557.553793:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1659 00000100:00100000:0.0:1788986557.553803:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971359488:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986557.553870:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971359488:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986557.553878:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1659 00000100:00080000:3.0:1788986557.554142:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986557.554232:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971359360 00000100:00100000:2.0:1788986557.554237:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971359360 00000100:00100000:2.0:1788986557.554273:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1299 00000100:00100000:2.0:1788986557.554281:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971359360:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986557.554311:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971359360:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986557.554318:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1299 00000100:00100000:1.0:1788986557.561696:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986557.561733:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986557.561760:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971359616 00000100:00100000:1.0:1788986557.561768:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971359616 00000100:00100000:1.0:1788986557.561821:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971359744 00000100:00100000:1.0:1788986557.561825:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971359744 00000100:00100000:1.0:1788986557.561849:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 522 00000100:00100000:1.0:1788986557.561858:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971359616:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:1.0:1788986557.561884:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf548cae 00000100:00080000:1.0:1788986557.561892:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9b0a43d13800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788986557.561926:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967357 00000100:00100000:3.0:1788986557.562164:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 523 00000100:00100000:3.0:1788986557.562174:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971359744:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788986557.562187:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf548d5d 00000100:00080000:3.0:1788986557.562194:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b0a43d11000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788986557.562218:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967357 00000100:00100000:3.0:1788986557.562425:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971359744:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 251us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986557.562433:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 523 00000100:00100000:1.0:1788986557.562673:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971359616:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 815us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986557.562681:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 522 00010000:00010000:1.0:1788986557.562703:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986557.562708:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788986557.562714:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986557.562717:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788986558.196277:0:87912:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda9a755a0 20000000:00000080:2.0:1788986558.196291:0:87912:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76606400 uarg=0000000000000000 10000000:01000000:2.0:1788986558.196555:0:87912:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986558.196576:0:87912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54942c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986558.196591:0:87912:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54942c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986558.196601:0:87912:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54942c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986558.196607:0:87912:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54942c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986558.196614:0:87912:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54942c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986558.196632:0:87912:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54942c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986558.196638:0:87912:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986558.196642:0:87912:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54942c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986558.196650:0:87912:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54942c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986558.196663:0:87912:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54942c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986558.196670:0:87912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54942c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986558.196677:0:87912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54942c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.401217:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788986558.784383:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986558.784389:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986558.784393:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986558.784439:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986558.784451:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986558.784464:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986558.784490:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993560832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986558.785083:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986558.785172:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5abfeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788986558.785189:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993560832 00000100:00100000:0.0:1788986558.785199:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993560832 00000100:00100000:0.0:1788986558.785265:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:0.0:1788986558.785274:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993560832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986558.785287:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986558.785302:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54943a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549433 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986558.785334:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54943a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549433 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986558.785345:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54943a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549433 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986558.785357:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986558.785398:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993560832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986558.785403:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:0.0:1788986558.785460:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993560832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986558.785474:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54943a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986558.785483:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54943a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986558.785502:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986558.785508:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54943a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986558.785515:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54943a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788986558.945666:0:87960:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffca3f2a0a0 20000000:00000080:1.0:1788986558.945680:0:87960:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511cdc00 uarg=0000000000000000 10000000:01000000:1.0:1788986558.945984:0:87960:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986558.946005:0:87960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946022:0:87960:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54943a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549433 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946030:0:87960:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946066:0:87960:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54943a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549433 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946079:0:87960:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54943a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549433 expref: 18 pid: 5846 timeout: 2442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986558.946158:0:87960:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87960:1875885993560960:0@lo:104: 00000100:00100000:1.0:1788986558.946219:0:87960:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986558.946263:0:87960:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51df2c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788986558.946340:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993560960 00000100:00100000:3.0:1788986558.946346:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993560960 00000100:00100000:3.0:1788986558.946395:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:3.0:1788986558.946404:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:87960:x1875885993560960:12345-0@lo:104: 00010000:00010000:3.0:1788986558.946417:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54943a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986558.946547:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986558.946554:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:87960:x1875885993560960:12345-0@lo:104: Request processed in 152us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986558.946560:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00010000:00010000:1.0:1788986558.946662:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986558.946668:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54943a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946676:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986558.946680:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54943a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946688:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54943a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986558.946696:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54943a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986558.946701:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986558.946742:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54943a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946749:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986558.946770:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54943a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946776:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf549433 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54943a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946799:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986558.946801:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986558.946802:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986558.946813:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993561088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986558.946839:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986558.946873:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993561088 00000100:00100000:1.0:1788986558.946877:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993561088 00010000:00010000:1.0:1788986558.946894:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54943a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549433 expref: 19 pid: 5846 timeout: 2442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986558.946916:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1788986558.946922:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993561088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986558.946931:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986558.946936:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54943a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549433 expref: 19 pid: 5846 timeout: 2442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946945:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54943a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549433 expref: 19 pid: 5846 timeout: 2442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946959:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946966:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946982:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946989:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.946996:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.947002:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.947007:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986558.947011:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.947019:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.947028:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986558.947036:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986558.947063:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993561088:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986558.947069:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00000100:00100000:1.0:1788986558.947128:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993561088:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986558.947418:0:87960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54943a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549433 expref: 18 pid: 5846 timeout: 2442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986558.947428:0:87960:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:87960:1875885993560960:0@lo:104: 00010000:00010000:0.0:1788986558.947439:0:87960:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986558.947447:0:87960:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986558.947452:0:87960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986558.947459:0:87960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549441 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 87960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986559.425267:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986559.490923:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986559.490943:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993561216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986559.491004:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986559.491063:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993561216 00000100:00100000:1.0:1788986559.491071:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993561216 00000100:00100000:1.0:1788986559.491145:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 842 00000100:00100000:1.0:1788986559.491153:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993561216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986559.491186:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986559.491229:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993561216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986559.491236:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 842 00000100:00080000:1.0:1788986559.492208:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986559.492762:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993561216:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788986559.541324:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788986559.541333:0:6721:0:(genops.c:885:class_export_put()) final put ffff9b0a43d17000/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788986559.544769:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a43d17000/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0000 00000020:00000080:1.0:1788986559.544828:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a43d13800 for lustre-OST0000 00000001:00100000:0.0:1788986559.586357:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:0.0:1788986559.586367:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b0a43d11800/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:0.0:1788986559.586402:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a43d11800/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0001 00000020:00000080:0.0:1788986559.586446:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a43d11000 for lustre-OST0001 00010000:00010000:1.0:1788986560.448285:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986560.518967:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986560.518988:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993561344:0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.519060:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986560.519275:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993561344 00000100:00100000:0.0:1788986560.519284:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993561344 00000100:00100000:0.0:1788986560.519344:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:0.0:1788986560.519354:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993561344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.519407:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993561344:12345-0@lo:400:kworker.0 Request processed in 54us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986560.519414:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:0.0:1788986560.519460:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993561344:0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.519494:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993561472:0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.519521:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986560.519553:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993561472 00000100:00100000:0.0:1788986560.519556:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993561472 00000100:00100000:0.0:1788986560.519585:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1660 00000100:00100000:0.0:1788986560.519591:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993561472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.519625:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993561472:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986560.519631:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1660 00000100:00100000:0.0:1788986560.519661:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993561472:0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.519692:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986560.519699:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993561600:0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.519725:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986560.519748:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993561600 00000100:00100000:0.0:1788986560.519752:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993561600 00000100:00100000:0.0:1788986560.519795:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1661 00000100:00100000:0.0:1788986560.519802:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993561600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.519835:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993561600:12345-0@lo:400:kworker.0 Request processed in 34us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986560.519841:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1661 00000100:00100000:0.0:1788986560.519866:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993561600:0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.519894:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993561728:0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.519917:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986560.519945:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993561728 00000100:00100000:0.0:1788986560.519948:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993561728 00000100:00100000:0.0:1788986560.519973:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1788986560.519979:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993561728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.520010:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993561728:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986560.520017:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1237 00000100:00100000:0.0:1788986560.520045:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993561728:0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.520068:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986560.520074:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993561856:0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.520121:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986560.520145:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993561856 00000100:00100000:0.0:1788986560.520148:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993561856 00000100:00100000:0.0:1788986560.520173:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1662 00000100:00100000:0.0:1788986560.520179:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993561856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.520209:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993561856:12345-0@lo:400:kworker.0 Request processed in 30us (87us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986560.520215:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1662 00000100:00100000:0.0:1788986560.520237:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993561856:0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.520264:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993561984:0@lo:400:kworker.0 00000100:00100000:0.0:1788986560.520286:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788986560.520450:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986560.520462:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993561984 00000100:00100000:1.0:1788986560.520467:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993561984 00000100:00100000:1.0:1788986560.520507:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1788986560.520514:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993561984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986560.520554:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993561984:12345-0@lo:400:kworker.0 Request processed in 41us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986560.520560:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1238 00000100:00100000:1.0:1788986560.520588:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993561984:0@lo:400:kworker.0 00000100:00080000:0.0:1788986560.522906:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:3.0:1788986560.832884:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986560.832890:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986560.832894:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986560.832933:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986560.832945:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986560.832956:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986560.832987:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993562112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986560.833052:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986560.835361:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a50309d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788986560.835416:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993562112 00000100:00100000:2.0:1788986560.835424:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993562112 00000100:00100000:2.0:1788986560.835515:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1302 00000100:00100000:2.0:1788986560.835525:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993562112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986560.835539:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986560.835555:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54944f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549448 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986560.835582:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54944f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549448 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986560.835592:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54944f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549448 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986560.835601:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0c00, rc 0) 00000100:00100000:2.0:1788986560.835666:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993562112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (2613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986560.835673:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1302 00000100:00100000:1.0:1788986560.835756:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993562112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986560.835770:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54944f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986560.835790:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54944f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986560.835810:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986560.835816:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54944f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986560.835823:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54944f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986561.024294:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993562240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986561.024375:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986561.024435:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993562240 00000100:00100000:0.0:1788986561.024444:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993562240 00000100:00100000:0.0:1788986561.024499:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 843 00000100:00100000:0.0:1788986561.024508:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993562240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986561.024543:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986561.024611:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993562240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986561.024618:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 843 00000100:00100000:2.0:1788986561.024781:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993562240:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788986561.407446:0:88108:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe80a86000 20000000:00000080:1.0:1788986561.407461:0:88108:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511cdc00 uarg=0000000000000000 10000000:01000000:1.0:1788986561.407640:0:88108:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986561.407658:0:88108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986561.407674:0:88108:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54944f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549448 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986561.407682:0:88108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986561.407719:0:88108:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54944f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549448 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986561.407732:0:88108:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54944f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549448 expref: 18 pid: 5849 timeout: 2445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986561.407746:0:88108:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88108:1875885993562368:0@lo:104: 00000100:00100000:1.0:1788986561.407873:0:88108:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986561.408014:0:88108:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42bca840 going to sleep for 11 seconds 00000100:00100000:2.0:1788986561.408056:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993562368 00000100:00100000:2.0:1788986561.408064:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993562368 00000100:00100000:2.0:1788986561.408342:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788986561.408354:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:88108:x1875885993562368:12345-0@lo:104: 00010000:00010000:2.0:1788986561.408367:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54944f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.408439:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986561.408446:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:88108:x1875885993562368:12345-0@lo:104: Request processed in 96us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986561.408453:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00010000:00010000:0.0:1788986561.408472:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986561.408479:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54944f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986561.408487:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986561.408490:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54944f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986561.408498:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54944f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986561.408509:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54944f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986561.408514:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:3.0:1788986561.408517:0:88108:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88108:1875885993562368:0@lo:104: 00010000:00010000:3.0:1788986561.408534:0:88108:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986561.408540:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54944f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986561.408546:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986561.408575:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54944f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986561.408579:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:0.0:1788986561.408582:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549448 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54944f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986561.408589:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993562496:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986561.408595:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986561.408597:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986561.408599:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986561.408615:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986561.408676:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993562496 00000100:00100000:0.0:1788986561.408682:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993562496 00010000:00010000:2.0:1788986561.408724:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54944f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549448 expref: 19 pid: 5849 timeout: 2445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986561.408840:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1788986561.408848:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993562496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986561.408859:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986561.408864:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54944f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549448 expref: 19 pid: 5849 timeout: 2445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.408874:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54944f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549448 expref: 19 pid: 5849 timeout: 2445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.408943:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54944f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549448 expref: 19 pid: 5849 timeout: 2445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.408956:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.408965:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.408979:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.408987:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.408995:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.409002:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.409008:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986561.409012:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.409025:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.409045:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986561.409055:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986561.409071:0:88108:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986561.409079:0:88108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986561.409085:0:88108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf549456 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986561.409113:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993562496:12345-0@lo:103:ldlm_bl.0 Request processed in 267us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986561.409119:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00000100:00100000:0.0:1788986561.409181:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993562496:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986561.473346:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788986562.133818:0:88157:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdbe2cbbf0 20000000:00000080:1.0:1788986562.133833:0:88157:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511cf800 uarg=0000000000000000 10000000:01000000:1.0:1788986562.134415:0:88157:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986562.134436:0:88157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54945d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986562.134450:0:88157:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54945d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986562.134461:0:88157:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54945d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986562.134468:0:88157:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54945d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986562.134475:0:88157:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54945d lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986562.134482:0:88157:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54945d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986562.134488:0:88157:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986562.134493:0:88157:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54945d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986562.134500:0:88157:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54945d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986562.134512:0:88157:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54945d lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986562.134520:0:88157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54945d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986562.134526:0:88157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54945d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986562.504436:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986562.682418:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986562.682504:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986562.682575:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971359872 00000100:00100000:0.0:1788986562.682584:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971359872 00000100:00100000:0.0:1788986562.682631:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1303 00000100:00100000:0.0:1788986562.682640:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971359872:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986562.682704:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971359872:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986562.682711:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1303 00000100:00100000:2.0:1788986562.682943:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971360000 00000100:00100000:2.0:1788986562.682948:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971360000 00000100:00100000:2.0:1788986562.683032:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1663 00000100:00100000:2.0:1788986562.683042:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971360000:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986562.683081:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971360000:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 42us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986562.683121:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1663 00000100:00080000:0.0:1788986562.683251:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1788986563.008197:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986563.008205:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986563.008210:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986563.008255:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986563.008269:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986563.008279:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986563.008313:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993562624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986563.008382:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986563.008441:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986563.009083:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993562624 00000100:00100000:2.0:1788986563.009125:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993562624 00000100:00100000:2.0:1788986563.009170:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:2.0:1788986563.009179:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993562624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986563.009193:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986563.009207:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54946b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549464 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986563.009229:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54946b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549464 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986563.009239:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54946b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549464 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986563.009248:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1800, rc 0) 00000100:00100000:2.0:1788986563.009321:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993562624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986563.009328:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:1.0:1788986563.009716:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993562624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986563.009733:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54946b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986563.009742:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54946b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986563.009760:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986563.009765:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54946b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986563.009785:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54946b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986563.521166:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986564.548012:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986564.616635:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993562752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986564.616697:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986564.616765:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993562752 00000100:00100000:0.0:1788986564.616772:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993562752 00000100:00100000:0.0:1788986564.616820:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 844 00000100:00100000:0.0:1788986564.616828:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993562752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986564.616878:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986564.616930:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993562752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986564.616937:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 844 00000100:00080000:0.0:1788986564.616958:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986564.617176:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993562752:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1788986565.398377:0:88355:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe8a85e810 20000000:00000080:2.0:1788986565.398394:0:88355:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a45647800 uarg=0000000000000000 00010000:00010000:2.0:1788986565.398598:0:88355:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986565.398612:0:88355:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986565.398624:0:88355:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986565.398641:0:88355:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986565.398657:0:88355:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54946b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549464 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986565.398665:0:88355:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986565.398932:0:88355:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54946b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549464 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986565.398948:0:88355:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54946b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549464 expref: 18 pid: 5849 timeout: 2449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986565.398968:0:88355:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88355:1875885993562880:0@lo:104: 00000100:00100000:2.0:1788986565.399023:0:88355:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986565.399072:0:88355:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094395fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788986565.399514:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993562880 00000100:00100000:3.0:1788986565.399521:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993562880 00000100:00100000:3.0:1788986565.399607:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788986565.399617:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:88355:x1875885993562880:12345-0@lo:104: 00010000:00010000:3.0:1788986565.399631:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54946b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986565.399715:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986565.399721:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:88355:x1875885993562880:12345-0@lo:104: Request processed in 106us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986565.399728:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00010000:00010000:0.0:1788986565.399784:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986565.399790:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54946b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986565.399798:0:88355:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88355:1875885993562880:0@lo:104: 00010000:00010000:0.0:1788986565.399798:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986565.399801:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54946b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.399809:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54946b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986565.399815:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54946b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986565.399816:0:88355:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986565.399821:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986565.399849:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54946b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.399855:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986565.399884:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54946b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.399891:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ee400/0xc20d828fcf549464 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54946b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.399906:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986565.399908:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986565.399910:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986565.399924:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986565.399934:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993563008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986565.399965:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986565.399999:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993563008 00000100:00100000:0.0:1788986565.400003:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993563008 00010000:00010000:0.0:1788986565.400021:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54946b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549464 expref: 19 pid: 5849 timeout: 2449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986565.400043:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1788986565.400050:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993563008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986565.400059:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986565.400064:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54946b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549464 expref: 19 pid: 5849 timeout: 2449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.400074:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54946b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549464 expref: 19 pid: 5849 timeout: 2449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.400085:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54946b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549464 expref: 19 pid: 5849 timeout: 2449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.400114:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.400123:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.400136:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.400144:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.400150:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.400410:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.400416:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986565.400420:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.400428:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.400447:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986565.400457:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986565.400536:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993563008:12345-0@lo:103:ldlm_bl.0 Request processed in 486us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986565.400542:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1788986565.400590:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993563008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986565.401009:0:88355:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986565.401018:0:88355:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986565.401025:0:88355:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549472 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88355 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986565.570415:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986565.636188:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993563136:0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.636308:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986565.636357:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993563648:0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.636383:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986565.636409:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986565.636416:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993563264:0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.636436:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986565.636465:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993563392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.636487:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986565.636503:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986565.636509:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993563520:0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.636528:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986565.636556:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993563648 00000100:00100000:3.0:1788986565.636563:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993563648 00000100:00100000:3.0:1788986565.636609:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993563392 00000100:00100000:3.0:1788986565.636612:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993563392 00000100:00100000:3.0:1788986565.636634:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1788986565.636641:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993563648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.636691:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993563648:12345-0@lo:400:kworker.0 Request processed in 49us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986565.636698:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1239 00000100:00100000:3.0:1788986565.636714:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1788986565.636720:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993563392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.636750:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993563392:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986565.636892:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1240 00000100:00100000:3.0:1788986565.636912:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993563136 00000100:00100000:3.0:1788986565.636916:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993563136 00000100:00100000:3.0:1788986565.636940:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993563264 00000100:00100000:3.0:1788986565.636944:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993563264 00000100:00100000:3.0:1788986565.636961:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993563520 00000100:00100000:3.0:1788986565.636964:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993563520 00000100:00100000:3.0:1788986565.636979:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1664 00000100:00100000:3.0:1788986565.636985:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993563136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.637017:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993563136:12345-0@lo:400:kworker.0 Request processed in 32us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986565.637023:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1664 00000100:00100000:3.0:1788986565.637035:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1665 00000100:00100000:3.0:1788986565.637040:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993563264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.637068:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993563264:12345-0@lo:400:kworker.0 Request processed in 28us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986565.637074:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1665 00000100:00100000:3.0:1788986565.637085:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1666 00000100:00100000:3.0:1788986565.637113:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993563520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.637139:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993563520:12345-0@lo:400:kworker.0 Request processed in 28us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986565.637145:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1666 00000100:00080000:3.0:1788986565.637168:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986565.637172:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986565.637211:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993563520:0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.637222:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993563392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.637251:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993563264:0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.637262:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993563136:0@lo:400:kworker.0 00000100:00100000:3.0:1788986565.637271:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993563648:0@lo:400:kworker.0 00000100:00100000:2.0:1788986566.145599:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986566.145618:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993563776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986566.145677:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986566.145773:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993563776 00000100:00100000:0.0:1788986566.145781:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993563776 00000100:00100000:0.0:1788986566.145834:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1788986566.145843:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993563776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986566.145875:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986566.145921:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993563776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986566.145927:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 845 00000100:00100000:0.0:1788986566.145969:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993563776:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986566.594495:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788986566.786799:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986566.786805:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986566.786809:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986566.786850:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986566.786861:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986566.786878:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986566.786902:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993563904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986566.786969:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986566.787019:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094395f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788986566.787137:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993563904 00000100:00100000:3.0:1788986566.787144:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993563904 00000100:00100000:3.0:1788986566.787189:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:3.0:1788986566.787198:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993563904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986566.787210:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986566.787222:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549480 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549479 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986566.787515:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549480 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549479 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986566.787527:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549480 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549479 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986566.787536:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3800, rc 0) 00000100:00100000:3.0:1788986566.787584:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993563904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 387us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986566.787591:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00100000:2.0:1788986566.789066:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993563904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986566.789105:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549480 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986566.789116:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549480 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986566.789135:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986566.789139:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549480 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986566.789146:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549480 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986567.626578:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986567.796870:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986567.796913:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986567.797011:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971360128 00000100:00100000:2.0:1788986567.797021:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971360128 00000100:00100000:2.0:1788986567.797079:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1306 00000100:00100000:2.0:1788986567.797107:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971360128:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986567.797186:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971360128:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 98us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986567.797194:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1306 00000100:00100000:1.0:1788986567.801458:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971360256 00000100:00100000:1.0:1788986567.801472:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971360256 00000100:00100000:1.0:1788986567.801540:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1667 00000100:00100000:1.0:1788986567.801549:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971360256:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986567.801619:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971360256:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 71us (4706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986567.801626:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1667 00000100:00080000:1.0:1788986567.801645:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788986568.645294:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986568.717019:0:88553:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee617b5e0 20000000:00000080:3.0:1788986568.717036:0:88553:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a60c8c800 uarg=0000000000000000 10000000:01000000:3.0:1788986568.717295:0:88553:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986568.717315:0:88553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986568.717332:0:88553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549480 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549479 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986568.717342:0:88553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986568.717379:0:88553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549480 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549479 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986568.717391:0:88553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549480 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549479 expref: 18 pid: 5848 timeout: 2452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986568.717404:0:88553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88553:1875885993564032:0@lo:104: 00000100:00100000:3.0:1788986568.717463:0:88553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986568.717570:0:88553:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51a11780 going to sleep for 11 seconds 00000100:00100000:2.0:1788986568.717669:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993564032 00000100:00100000:2.0:1788986568.717676:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993564032 00000100:00100000:2.0:1788986568.717758:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788986568.717768:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:88553:x1875885993564032:12345-0@lo:104: 00010000:00010000:2.0:1788986568.717781:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549480 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986568.717854:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986568.717860:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:88553:x1875885993564032:12345-0@lo:104: Request processed in 95us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986568.717867:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00010000:00010000:0.0:1788986568.717910:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986568.717917:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549480 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.717925:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986568.717929:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549480 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.717938:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549480 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986568.717946:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549480 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986568.717952:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986568.717982:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549480 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.717989:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986568.718008:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549480 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718015:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549479 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549480 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718030:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986568.718032:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986568.718033:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986568.718044:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993564160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986568.718076:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986568.718142:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993564160 00000100:00100000:0.0:1788986568.718146:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993564160 00010000:00010000:0.0:1788986568.718165:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549480 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549479 expref: 19 pid: 5848 timeout: 2452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986568.718185:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1788986568.718191:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993564160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986568.718200:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986568.718205:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549480 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549479 expref: 19 pid: 5848 timeout: 2452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718228:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549480 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549479 expref: 19 pid: 5848 timeout: 2452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718241:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718251:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718265:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718282:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718289:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718296:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718306:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986568.718311:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718318:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718326:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986568.718335:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986568.718363:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51af3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993564160:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986568.718370:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00000100:00100000:0.0:1788986568.718421:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993564160:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986568.718514:0:88553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549480 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549479 expref: 18 pid: 5848 timeout: 2452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986568.718537:0:88553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88553:1875885993564032:0@lo:104: 00010000:00010000:3.0:1788986568.718551:0:88553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986568.718560:0:88553:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986568.718567:0:88553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986568.718573:0:88553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549487 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788986569.586819:0:88601:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffa2f91860 20000000:00000080:3.0:1788986569.586836:0:88601:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a60c8c800 uarg=0000000000000000 00010000:00010000:3.0:1788986569.587681:0:88601:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986569.587698:0:88601:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986569.587716:0:88601:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986569.587798:0:88601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54948e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986569.587813:0:88601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54948e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986569.587823:0:88601:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54948e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986569.587830:0:88601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54948e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986569.587837:0:88601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54948e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986569.587844:0:88601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54948e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986569.587849:0:88601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986569.587853:0:88601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54948e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986569.587862:0:88601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54948e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986569.587875:0:88601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54948e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986569.587887:0:88601:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54948e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986569.587894:0:88601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54948e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986569.664283:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986569.729546:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986569.729568:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993564288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986569.729633:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986569.729688:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993564288 00000100:00100000:0.0:1788986569.729695:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993564288 00000100:00100000:0.0:1788986569.729741:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:0.0:1788986569.729750:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993564288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986569.729780:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986569.729822:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993564288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986569.729829:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00080000:0.0:1788986569.729848:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986569.729876:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993564288:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1788986570.117486:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986570.117494:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986570.117498:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986570.117539:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986570.117551:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986570.117561:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986570.117585:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993564416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986570.117646:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986570.117697:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5ab76e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788986570.118517:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993564416 00000100:00100000:3.0:1788986570.118526:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993564416 00000100:00100000:3.0:1788986570.118571:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1307 00000100:00100000:3.0:1788986570.118580:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993564416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986570.118593:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986570.118609:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54949c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549495 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986570.118632:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54949c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549495 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986570.118643:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54949c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549495 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986570.118652:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986570.118709:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993564416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986570.118715:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1307 00000100:00100000:0.0:1788986570.118830:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993564416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986570.118845:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54949c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986570.118853:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54949c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986570.118870:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986570.118875:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54949c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986570.118882:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54949c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986570.688384:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986570.753388:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993564544:0@lo:400:kworker.0 00000100:00100000:0.0:1788986570.753494:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986570.753555:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993565056:0@lo:400:kworker.0 00000100:00100000:0.0:1788986570.753594:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986570.753617:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986570.753624:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993564672:0@lo:400:kworker.0 00000100:00100000:0.0:1788986570.753643:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986570.753875:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993564800:0@lo:400:kworker.0 00000100:00100000:2.0:1788986570.753907:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986570.753941:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986570.753947:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993564928:0@lo:400:kworker.0 00000100:00100000:2.0:1788986570.753970:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986570.754064:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993565056 00000100:00100000:0.0:1788986570.754074:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993565056 00000100:00100000:0.0:1788986570.754159:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993564800 00000100:00100000:0.0:1788986570.754163:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993564800 00000100:00100000:0.0:1788986570.754186:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1241 00000100:00100000:0.0:1788986570.754196:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993565056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986570.754266:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993565056:12345-0@lo:400:kworker.0 Request processed in 61us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986570.754283:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1241 00000100:00100000:0.0:1788986570.754304:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1242 00000100:00100000:0.0:1788986570.754312:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993564800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986570.754349:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993564800:12345-0@lo:400:kworker.0 Request processed in 38us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986570.754356:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1242 00000100:00100000:0.0:1788986570.754397:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993565056:0@lo:400:kworker.0 00000100:00100000:1.0:1788986570.754521:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993564544 00000100:00100000:1.0:1788986570.754526:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993564544 00000100:00100000:1.0:1788986570.754569:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993564672 00000100:00100000:1.0:1788986570.754572:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993564672 00000100:00100000:1.0:1788986570.754593:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993564928 00000100:00100000:1.0:1788986570.754596:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993564928 00000100:00100000:1.0:1788986570.754610:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1668 00000100:00100000:1.0:1788986570.754615:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993564544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986570.754653:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993564544:12345-0@lo:400:kworker.0 Request processed in 38us (1160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986570.754659:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1668 00000100:00100000:1.0:1788986570.754672:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1669 00000100:00100000:1.0:1788986570.754677:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993564672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986570.754704:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993564672:12345-0@lo:400:kworker.0 Request processed in 27us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986570.754710:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1669 00000100:00100000:1.0:1788986570.754719:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1670 00000100:00100000:1.0:1788986570.754737:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993564928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986570.754762:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993564928:12345-0@lo:400:kworker.0 Request processed in 38us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986570.754767:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1670 00000100:00100000:1.0:1788986570.754795:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993564672:0@lo:400:kworker.0 00000100:00100000:1.0:1788986570.754805:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993564544:0@lo:400:kworker.0 00000100:00080000:2.0:1788986570.754976:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986570.754981:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986570.755002:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993564928:0@lo:400:kworker.0 00000100:00100000:2.0:1788986570.755013:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993564800:0@lo:400:kworker.0 00000100:00100000:2.0:1788986571.265672:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986571.265697:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993565184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986571.265773:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986571.265941:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993565184 00000100:00100000:0.0:1788986571.265949:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993565184 00000100:00100000:0.0:1788986571.265997:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:0.0:1788986571.266006:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993565184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986571.266038:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986571.266109:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993565184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986571.266116:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:3.0:1788986571.266206:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993565184:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986571.712400:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986572.738547:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986572.917136:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986572.917173:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986572.917309:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971360512 00000100:00100000:1.0:1788986572.917318:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971360512 00000100:00080000:3.0:1788986572.917441:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986572.917496:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1671 00000100:00100000:1.0:1788986572.917506:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971360512:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986572.917574:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971360512:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 70us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986572.917581:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1671 00000100:00100000:3.0:1788986572.921671:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971360384 00000100:00100000:3.0:1788986572.921684:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971360384 00000100:00100000:3.0:1788986572.921804:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1308 00000100:00100000:3.0:1788986572.921814:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971360384:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986572.922253:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971360384:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 429us (5067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986572.922262:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1308 00010000:00010000:1.0:1788986573.761426:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986574.784572:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986574.855047:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993565312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986574.855125:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986574.855176:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993565312 00000100:00100000:2.0:1788986574.855185:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993565312 00000100:00100000:2.0:1788986574.855257:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1788986574.855268:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993565312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986574.855300:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986574.855360:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993565312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986574.855368:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:0.0:1788986574.860831:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993565312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986574.861333:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1788986575.090876:0:88896:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd0308df0 20000000:00000080:0.0:1788986575.090898:0:88896:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0941d38c00 uarg=0000000000000000 00010000:00010000:0.0:1788986575.092897:0:88896:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986575.092919:0:88896:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986575.092936:0:88896:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986575.092956:0:88896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986575.092974:0:88896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54949c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549495 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986575.092983:0:88896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986575.093026:0:88896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54949c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549495 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986575.093042:0:88896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54949c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549495 expref: 18 pid: 5848 timeout: 2458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986575.093056:0:88896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88896:1875885993565440:0@lo:104: 00000100:00100000:0.0:1788986575.093256:0:88896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986575.093325:0:88896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76582f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788986575.093391:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993565440 00000100:00100000:3.0:1788986575.093399:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993565440 00000100:00100000:3.0:1788986575.093443:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788986575.093453:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:88896:x1875885993565440:12345-0@lo:104: 00010000:00010000:3.0:1788986575.093465:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54949c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986575.093531:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986575.093537:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:88896:x1875885993565440:12345-0@lo:104: Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986575.093544:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00010000:00010000:1.0:1788986575.093636:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986575.093642:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54949c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.093651:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986575.093655:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54949c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.093663:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54949c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986575.093674:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54949c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986575.093680:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986575.094138:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54949c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094146:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986575.094170:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54949c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094179:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf549495 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54949c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094193:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986575.094195:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986575.094197:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986575.094204:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986575.094215:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993565568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986575.094266:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986575.094303:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993565568 00000100:00100000:1.0:1788986575.094307:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993565568 00010000:00010000:1.0:1788986575.094328:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54949c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549495 expref: 19 pid: 5848 timeout: 2458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986575.094350:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1788986575.094356:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993565568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986575.094366:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986575.094372:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54949c lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549495 expref: 19 pid: 5848 timeout: 2458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094382:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54949c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549495 expref: 19 pid: 5848 timeout: 2458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094397:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094405:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094419:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094427:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094434:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094440:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094447:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986575.094451:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094459:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094468:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986575.094478:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986575.094508:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993565568:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986575.094514:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:1.0:1788986575.094548:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993565568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986575.094956:0:88896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf54949c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549495 expref: 18 pid: 5848 timeout: 2458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986575.094969:0:88896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:88896:1875885993565440:0@lo:104: 00010000:00010000:0.0:1788986575.094984:0:88896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986575.094993:0:88896:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986575.095000:0:88896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986575.095007:0:88896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf5494a3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986575.809139:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986575.875800:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993565952:0@lo:400:kworker.0 00000100:00100000:0.0:1788986575.875871:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986575.875923:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986575.875929:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993566080:0@lo:400:kworker.0 00000100:00100000:0.0:1788986575.875954:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986575.875992:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993565952 00000100:00100000:0.0:1788986575.876000:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993565952 00000100:00100000:0.0:1788986575.876058:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1672 00000100:00100000:0.0:1788986575.876066:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993565952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986575.876139:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993565952:12345-0@lo:400:kworker.0 Request processed in 73us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986575.876146:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1672 00000100:00100000:0.0:1788986575.876168:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993566080 00000100:00100000:0.0:1788986575.876172:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993566080 00000100:00100000:0.0:1788986575.876195:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1243 00000100:00100000:0.0:1788986575.876201:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993566080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986575.876240:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b42300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993566080:12345-0@lo:400:kworker.0 Request processed in 39us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986575.876246:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1243 00000100:00080000:0.0:1788986575.876261:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986575.876295:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993566080:0@lo:400:kworker.0 00000100:00100000:0.0:1788986575.876304:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993565952:0@lo:400:kworker.0 00000100:00100000:2.0:1788986575.876517:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993565696:0@lo:400:kworker.0 00000100:00100000:2.0:1788986575.876556:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986575.876584:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993566208:0@lo:400:kworker.0 00000100:00100000:2.0:1788986575.876607:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986575.876627:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788986575.876633:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993565824:0@lo:400:kworker.0 00000100:00100000:2.0:1788986575.876652:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986575.876670:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993566336:0@lo:400:kworker.0 00000100:00100000:2.0:1788986575.876689:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986575.876713:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993565696 00000100:00100000:2.0:1788986575.876716:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993565696 00000100:00100000:2.0:1788986575.876743:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1788986575.876750:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993565696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986575.876784:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993565696:12345-0@lo:400:kworker.0 Request processed in 34us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986575.876790:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00100000:2.0:1788986575.876814:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993566208 00000100:00100000:2.0:1788986575.876818:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993566208 00000100:00100000:2.0:1788986575.876845:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993565824 00000100:00100000:2.0:1788986575.876848:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993565824 00000100:00100000:2.0:1788986575.876865:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1673 00000100:00100000:2.0:1788986575.876871:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993566208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986575.876903:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993566208:12345-0@lo:400:kworker.0 Request processed in 33us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986575.876909:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1673 00000100:00100000:2.0:1788986575.876920:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1674 00000100:00100000:2.0:1788986575.876926:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993565824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986575.876953:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993565824:12345-0@lo:400:kworker.0 Request processed in 27us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986575.876958:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1674 00000100:00100000:2.0:1788986575.876978:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993566336 00000100:00100000:2.0:1788986575.876981:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993566336 00000100:00100000:2.0:1788986575.877004:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1244 00000100:00100000:2.0:1788986575.877010:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993566336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986575.877039:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993566336:12345-0@lo:400:kworker.0 Request processed in 28us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986575.877044:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1244 00000100:00080000:2.0:1788986575.877065:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986575.877067:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986575.877116:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993565824:0@lo:400:kworker.0 00000100:00100000:2.0:1788986575.877128:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993566336:0@lo:400:kworker.0 00000100:00100000:2.0:1788986575.877136:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993565696:0@lo:400:kworker.0 00000100:00100000:2.0:1788986575.877144:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993566208:0@lo:400:kworker.0 00000020:00000080:3.0:1788986575.939825:0:88944:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed76a00d0 20000000:00000080:3.0:1788986575.939843:0:88944:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80874800 uarg=0000000000000000 10000000:01000000:3.0:1788986575.940036:0:88944:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986575.940057:0:88944:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf5494aa lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986575.940072:0:88944:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf5494aa lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986575.940083:0:88944:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf5494aa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986575.940128:0:88944:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf5494aa lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986575.940135:0:88944:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf5494aa lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986575.940142:0:88944:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf5494aa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986575.940149:0:88944:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986575.940155:0:88944:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf5494aa lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986575.940163:0:88944:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf5494aa lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986575.940176:0:88944:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf5494aa lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986575.940184:0:88944:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf5494aa lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986575.940191:0:88944:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf5494aa lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 88944 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986576.386677:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986576.386814:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993566464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986576.386870:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986576.386946:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993566464 00000100:00100000:3.0:1788986576.386953:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993566464 00000100:00100000:3.0:1788986576.386997:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 849 00000100:00100000:3.0:1788986576.387005:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993566464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986576.387033:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986576.387081:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993566464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986576.387136:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 849 00000100:00100000:1.0:1788986576.387240:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b40e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993566464:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1788986576.448182:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986576.448190:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986576.448194:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986576.448243:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986576.448255:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986576.448267:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986576.448291:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993566592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986576.448350:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986576.448400:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7977d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986576.448462:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993566592 00000100:00100000:2.0:1788986576.448470:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993566592 00000100:00100000:2.0:1788986576.448524:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1310 00000100:00100000:2.0:1788986576.448534:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993566592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986576.448546:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986576.448560:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf5494b8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5494b1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986576.448582:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf5494b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5494b1 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986576.448593:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf5494b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5494b1 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986576.448601:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1a00, rc 0) 00000100:00100000:2.0:1788986576.449017:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993566592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 484us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986576.449025:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1310 00000100:00100000:0.0:1788986576.449775:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993566592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986576.449795:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5494b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986576.449807:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5494b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986576.449827:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986576.449832:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5494b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986576.449839:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5494b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986576.835357:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986577.857857:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986578.032616:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986578.032666:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986578.032709:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971360640 00000100:00100000:3.0:1788986578.032718:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971360640 00000100:00100000:3.0:1788986578.032765:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1311 00000100:00100000:3.0:1788986578.032774:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971360640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986578.032833:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971360640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 59us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986578.032841:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1311 00000100:00100000:2.0:1788986578.033246:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971360768 00000100:00100000:2.0:1788986578.033251:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971360768 00000100:00100000:2.0:1788986578.033307:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1675 00000100:00100000:2.0:1788986578.033315:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971360768:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986578.033362:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971360768:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 48us (755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986578.033369:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1675 00000100:00080000:3.0:1788986578.034896:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986578.725470:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986578.725685:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971360896 00000100:00100000:2.0:1788986578.725808:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971360896 00000100:00100000:2.0:1788986578.725968:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 953 00000100:00100000:2.0:1788986578.725978:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:52681:x1875885971360896:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986578.725999:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986578.726075:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5494bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13ca expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.726175:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5494c6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.726190:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5494c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.726203:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5494c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986578.726248:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788986578.726252:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986578.726273:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5494c6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.726316:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5494bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13ca expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.726335:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5494c6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13ca expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.726344:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:2.0:1788986578.726347:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986578.726350:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788986578.726407:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:52681:x1875885971360896:12345-192.168.206.21@tcp:101:rm.0 Request processed in 431us (946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986578.726414:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 953 00000100:00100000:1.0:1788986578.730800:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986578.730956:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971361024 00000100:00100000:2.0:1788986578.730966:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971361024 00000100:00100000:2.0:1788986578.731074:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 954 00000100:00100000:2.0:1788986578.731085:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:52681:x1875885971361024:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986578.731151:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986578.731170:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13d1 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731236:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5494d4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731251:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5494d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731262:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5494d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731320:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494db lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731327:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731334:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731517:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5494d4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731525:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5494d4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731531:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5494d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731536:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986578.731540:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5494d4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731548:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5494d4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731559:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:2.0:1788986578.731562:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986578.731566:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5494d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731573:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5494d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731585:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494db lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731591:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494db lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731597:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731602:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986578.731604:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494db lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731611:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494db lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731618:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a45aca300) 00010000:00010000:2.0:1788986578.731620:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986578.731623:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494db lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731628:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494db lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731658:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13d1 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731667:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:2.0:1788986578.731669:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986578.731674:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13d1 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.731683:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986578.731745:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:52681:x1875885971361024:12345-192.168.206.21@tcp:101:rm.0 Request processed in 662us (953us total) trans 0 rc 301/301 00000100:00100000:2.0:1788986578.731752:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 954 00000100:00100000:0.0:1788986578.814166:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986578.814208:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986578.814254:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971361152 00000100:00100000:2.0:1788986578.814265:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971361152 00000100:00100000:2.0:1788986578.814309:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971361408 00000100:00100000:2.0:1788986578.814313:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971361408 00000100:00100000:3.0:1788986578.814325:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 955 00000100:00100000:3.0:1788986578.814338:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971361152:12345-192.168.206.21@tcp:41:mkdir.0 00000100:00100000:2.0:1788986578.814359:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 956 00000100:00100000:2.0:1788986578.814370:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:52685:x1875885971361408:12345-192.168.206.21@tcp:36:mkdir.0 00000004:00000024:3.0:1788986578.814382:0:5854:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00010000:00010000:2.0:1788986578.814407:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986578.814434:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5494c6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13ca expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.814453:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca000) 00000100:00100000:3.0:1788986578.814456:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971361152:12345-192.168.206.21@tcp:41:mkdir.0 Request processed in 121us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986578.814466:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 955 00010000:00010000:2.0:1788986578.814466:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986578.814691:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494e2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.814704:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.814726:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.814740:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494e9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.814752:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.814759:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986578.815776:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00010000:00010000:2.0:1788986578.815789:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494e2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.815798:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494e2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.815805:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.815811:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986578.815815:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494e2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.815822:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494e2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.815833:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986578.815836:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986578.815840:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494e2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.815846:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494e2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986578.815880:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008bf209a1 reply state 00000000b81275ef transno 4294967659 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986578.815889:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986578.815956:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:52685:x1875885971361408:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 1587us (1744us total) trans 4294967659 rc 0/0 00000100:00100000:2.0:1788986578.815964:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 956 00010000:00010000:1.0:1788986578.822362:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494e9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986578.822382:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494e9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986578.822390:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986578.822395:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986578.822399:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494e9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986578.822406:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494e9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986578.822421:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a45acaa00) 00010000:00010000:1.0:1788986578.822424:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986578.822429:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494e9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986578.822440:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5494e9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.880236:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986578.893185:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986578.893270:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971361536 00000100:00100000:2.0:1788986578.893281:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971361536 00000100:00100000:2.0:1788986578.893340:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 957 00000100:00100000:2.0:1788986578.893350:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:52689:x1875885971361536:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:2.0:1788986578.893372:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986578.893393:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13d8 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.893450:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5494f7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.893463:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5494f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.893475:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5494f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986578.893508:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788986578.893512:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986578.893531:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5494f7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.893558:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5494f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13d8 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.893575:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5494f7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13d8 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.893584:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986578.893587:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986578.893591:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788986578.893650:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:52689:x1875885971361536:12345-192.168.206.21@tcp:101:chown.0 Request processed in 302us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986578.893656:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 957 00000100:00100000:0.0:1788986578.901180:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986578.901273:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971361664 00000100:00100000:3.0:1788986578.901284:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971361664 00000100:00100000:3.0:1788986578.901340:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 958 00000100:00100000:3.0:1788986578.901348:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:52689:x1875885971361664:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:3.0:1788986578.901367:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986578.901386:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5494fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13df expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901439:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549505 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901452:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549505 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901463:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549505 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901476:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54950c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901483:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54950c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901490:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54950c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901591:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549513 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901599:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901606:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986578.901632:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:3.0:1788986578.901636:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986578.901653:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549513 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901664:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549505 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901670:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549505 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901676:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549505 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901698:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986578.901702:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549505 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901708:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549505 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901720:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:3.0:1788986578.901722:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986578.901727:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549505 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901734:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549505 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901746:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54950c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901751:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54950c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901757:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54950c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901762:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986578.901764:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54950c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901770:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54950c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901778:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a55745f00) 00010000:00010000:3.0:1788986578.901780:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986578.901783:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54950c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901789:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54950c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901821:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5494fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13df expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901833:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549513 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13df expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.901839:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745400) 00010000:00010000:3.0:1788986578.901842:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986578.901844:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788986578.901902:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:52689:x1875885971361664:12345-192.168.206.21@tcp:101:chown.0 Request processed in 554us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986578.901909:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 958 00000100:00100000:3.0:1788986578.909527:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986578.909677:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971361920 00000100:00100000:2.0:1788986578.909701:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971361920 00000100:00100000:2.0:1788986578.909759:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 959 00000100:00100000:2.0:1788986578.909769:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:52689:x1875885971361920:12345-192.168.206.21@tcp:36:chown.0 00010000:00010000:2.0:1788986578.909814:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986578.909840:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549513 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13df expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.909857:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745400) 00010000:00010000:2.0:1788986578.909868:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986578.909891:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54951a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.909904:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54951a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986578.909915:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54951a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986578.910178:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000089c79018 reply state 0000000016a2cc7c transno 4294967660 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54951a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986578.910187:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986578.910195:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000100:00100000:2.0:1788986578.910285:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:52689:x1875885971361920:12345-192.168.206.21@tcp:36:chown.0 Request processed in 518us (766us total) trans 4294967660 rc 0/0 00000100:00100000:2.0:1788986578.910293:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 959 00010000:00010000:3.0:1788986578.912548:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54951a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.912563:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54951a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.912570:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54951a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.912576:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986578.912582:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54951a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.912589:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54951a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.912607:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:3.0:1788986578.912610:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986578.912615:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54951a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986578.912621:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54951a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788986579.648818:0:89143:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe1b798650 20000000:00000080:1.0:1788986579.648833:0:89143:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511ce800 uarg=0000000000000000 00010000:00010000:1.0:1788986579.653802:0:89143:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788986579.653842:0:89143:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:1.0:1788986579.653846:0:89143:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986579.653857:0:89143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5494f7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13d8 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986579.653879:0:89143:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1788986579.653896:0:89143:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986579.653909:0:89143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986579.653921:0:89143:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf5494b8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5494b1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986579.653929:0:89143:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986579.653965:0:89143:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf5494b8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5494b1 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986579.653979:0:89143:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf5494b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5494b1 expref: 18 pid: 5846 timeout: 2463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986579.653996:0:89143:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89143:1875885993566720:0@lo:104: 00000100:00100000:1.0:1788986579.654054:0:89143:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986579.654124:0:89143:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09429d0180 going to sleep for 11 seconds 00000100:00100000:2.0:1788986579.654509:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993566720 00000100:00100000:2.0:1788986579.654516:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993566720 00000100:00100000:2.0:1788986579.654567:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788986579.654577:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:89143:x1875885993566720:12345-0@lo:104: 00010000:00010000:2.0:1788986579.654590:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5494b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.654655:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986579.654662:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:89143:x1875885993566720:12345-0@lo:104: Request processed in 87us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986579.654669:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00010000:00010000:2.0:1788986579.654744:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986579.654750:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5494b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.654758:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986579.654762:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5494b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.654771:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5494b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986579.654778:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5494b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986579.654784:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986579.654906:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5494b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.654914:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986579.654933:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5494b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.654940:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf5494b1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5494b8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.654955:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986579.654957:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986579.654958:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986579.654974:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993566848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986579.655002:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986579.655035:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993566848 00000100:00100000:2.0:1788986579.655039:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993566848 00010000:00010000:2.0:1788986579.655056:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf5494b8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5494b1 expref: 19 pid: 5846 timeout: 2463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986579.655076:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1788986579.655083:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993566848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986579.655115:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986579.655120:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf5494b8 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5494b1 expref: 19 pid: 5846 timeout: 2463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.655130:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf5494b8 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5494b1 expref: 19 pid: 5846 timeout: 2463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.655145:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.655153:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.655166:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.655174:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.655180:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.655186:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.655192:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986579.655196:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.655204:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.655226:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986579.655235:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986579.655264:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993566848:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986579.655271:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:2.0:1788986579.655306:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993566848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986579.656303:0:89143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1a00/0xc20d828fcf5494b8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5494b1 expref: 18 pid: 5846 timeout: 2463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986579.656317:0:89143:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89143:1875885993566720:0@lo:104: 00010000:00010000:0.0:1788986579.656335:0:89143:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986579.656344:0:89143:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986579.656350:0:89143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986579.656356:0:89143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549521 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986579.906806:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986579.982269:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993566976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986579.982335:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986579.982459:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993566976 00000100:00100000:2.0:1788986579.982468:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993566976 00000100:00100000:2.0:1788986579.982519:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1788986579.982527:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993566976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986579.982559:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986579.982607:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993566976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986579.982614:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00080000:0.0:1788986579.983147:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986579.984255:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993566976:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788986580.528832:0:89191:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc0b37df90 20000000:00000080:1.0:1788986580.528849:0:89191:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511cf800 uarg=0000000000000000 10000000:01000000:1.0:1788986580.528895:0:89191:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986580.528914:0:89191:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549528 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986580.528929:0:89191:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549528 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986580.528939:0:89191:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549528 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986580.528945:0:89191:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549528 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986580.528952:0:89191:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549528 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986580.528960:0:89191:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549528 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986580.528966:0:89191:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986580.528970:0:89191:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549528 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986580.528977:0:89191:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549528 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986580.528990:0:89191:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549528 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986580.528998:0:89191:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549528 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986580.529004:0:89191:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549528 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89191 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986580.931210:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986580.992710:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993567232:0@lo:400:kworker.0 00000100:00100000:2.0:1788986580.992774:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986580.992826:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993567744:0@lo:400:kworker.0 00000100:00100000:2.0:1788986580.992849:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986580.992874:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986580.992880:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993567360:0@lo:400:kworker.0 00000100:00100000:2.0:1788986580.992900:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986580.992934:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993567232 00000100:00100000:2.0:1788986580.992942:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993567232 00000100:00100000:2.0:1788986580.992980:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993567360 00000100:00100000:2.0:1788986580.992983:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993567360 00000100:00100000:2.0:1788986580.993025:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1676 00000100:00100000:2.0:1788986580.993035:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993567232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986580.993269:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993567488:0@lo:400:kworker.0 00000100:00100000:3.0:1788986580.993297:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986580.993321:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788986580.993326:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993567104:0@lo:400:kworker.0 00000100:00100000:3.0:1788986580.993353:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986580.993374:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993567616:0@lo:400:kworker.0 00000100:00100000:3.0:1788986580.993393:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986580.993525:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993567616 00000100:00100000:0.0:1788986580.993530:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993567616 00000100:00100000:0.0:1788986580.993552:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1677 00000100:00100000:0.0:1788986580.993559:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993567360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986580.993607:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993567360:12345-0@lo:400:kworker.0 Request processed in 48us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986580.993614:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1677 00000100:00100000:0.0:1788986580.993630:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1678 00000100:00100000:0.0:1788986580.993636:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993567616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986580.993675:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993567616:12345-0@lo:400:kworker.0 Request processed in 39us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986580.993681:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1678 00000100:00080000:0.0:1788986580.993698:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986580.993710:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993567744 00000100:00100000:0.0:1788986580.993713:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993567744 00000100:00100000:0.0:1788986580.993741:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993567488 00000100:00100000:0.0:1788986580.993745:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993567488 00000100:00100000:0.0:1788986580.993764:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1788986580.993770:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993567744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986580.993799:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993567744:12345-0@lo:400:kworker.0 Request processed in 29us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986580.993805:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1245 00000100:00100000:0.0:1788986580.993816:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1246 00000100:00100000:0.0:1788986580.993821:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993567488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986580.993845:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993567488:12345-0@lo:400:kworker.0 Request processed in 24us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986580.993851:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1246 00000100:00080000:0.0:1788986580.993874:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986580.994136:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993567616:0@lo:400:kworker.0 00000100:00100000:3.0:1788986580.994147:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993567488:0@lo:400:kworker.0 00000100:00100000:2.0:1788986580.995504:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993567232:12345-0@lo:400:kworker.0 Request processed in 53us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986580.995522:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1676 00000100:00100000:2.0:1788986580.995555:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993567104 00000100:00100000:2.0:1788986580.995561:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993567104 00000100:00100000:2.0:1788986580.995595:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1788986580.995603:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993567104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986580.995778:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993567104:12345-0@lo:400:kworker.0 Request processed in 68us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986580.995786:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00100000:2.0:1788986580.995839:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993567104:0@lo:400:kworker.0 00000100:00100000:2.0:1788986580.995878:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993567360:0@lo:400:kworker.0 00000100:00100000:2.0:1788986580.995890:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993567232:0@lo:400:kworker.0 00000100:00100000:2.0:1788986580.995902:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993567744:0@lo:400:kworker.0 10000000:01000000:1.0:1788986581.249170:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986581.249178:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986581.249183:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986581.249237:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986581.249248:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986581.249259:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986581.249282:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993567872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986581.249351:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986581.249396:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09429d0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788986581.252521:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993567872 00000100:00100000:3.0:1788986581.252534:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993567872 00000100:00100000:3.0:1788986581.252713:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1788986581.252725:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993567872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986581.252740:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986581.252759:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf549536 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54952f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986581.252786:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf549536 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54952f expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986581.252797:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf549536 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54952f expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986581.252805:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2a00, rc 0) 00000100:00100000:3.0:1788986581.252889:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993567872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (3537us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986581.252895:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:3.0:1788986581.252947:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993567872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986581.252963:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549536 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986581.252972:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549536 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986581.252992:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986581.252998:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549536 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986581.253005:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549536 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986581.506496:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986581.506516:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993568000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986581.506574:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986581.506632:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993568000 00000100:00100000:2.0:1788986581.506639:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993568000 00000100:00100000:2.0:1788986581.506698:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1788986581.506707:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993568000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986581.506738:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986581.506783:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993568000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986581.506790:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1788986581.506840:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993568000:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986581.952406:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986582.624924:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967660 is committed 00010000:00010000:1.0:1788986582.976452:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986583.156226:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986583.156271:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986583.156305:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971362176 00000100:00100000:3.0:1788986583.156314:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971362176 00000100:00100000:3.0:1788986583.156371:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1679 00000100:00100000:3.0:1788986583.156382:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971362176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986583.156455:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971362176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 75us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986583.156462:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1679 00000100:00080000:3.0:1788986583.156483:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986583.156765:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971362048 00000100:00100000:1.0:1788986583.156770:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971362048 00000100:00100000:1.0:1788986583.156803:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1314 00000100:00100000:1.0:1788986583.156809:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971362048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986583.156846:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971362048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986583.156852:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1314 00000100:00100000:3.0:1788986583.591578:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986583.592027:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971362304 00000100:00100000:1.0:1788986583.592042:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971362304 00000100:00100000:1.0:1788986583.592162:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 15 00000100:00100000:1.0:1788986583.592175:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5588:x1875885971362304:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986583.592200:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986583.592203:0:5840:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf5494f7) 00010000:00010000:1.0:1788986583.592205:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986583.592275:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5588:x1875885971362304:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 104us (712us total) trans 0 rc 116/116 00000100:00100000:1.0:1788986583.592282:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 15 00010000:00010000:3.0:1788986584.000180:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986585.026410:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986585.089761:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993568128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986585.089848:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986585.089947:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993568128 00000100:00100000:2.0:1788986585.089955:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993568128 00000100:00100000:2.0:1788986585.090007:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:2.0:1788986585.090017:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993568128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986585.090048:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986585.090120:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993568128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986585.090127:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00080000:2.0:1788986585.090149:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986585.090464:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993568128:0@lo:13:osp-pre-0-0.0 00000020:00000080:1.0:1788986585.380832:0:89437:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffccd2e8d80 20000000:00000080:1.0:1788986585.380856:0:89437:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511cdc00 uarg=0000000000000000 00010000:00010000:1.0:1788986585.382072:0:89437:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788986585.382160:0:89437:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788986585.382186:0:89437:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986585.382203:0:89437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986585.382219:0:89437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf549536 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54952f expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986585.382227:0:89437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986585.382266:0:89437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf549536 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54952f expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986585.382281:0:89437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf549536 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54952f expref: 18 pid: 5849 timeout: 2469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986585.382294:0:89437:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89437:1875885993568256:0@lo:104: 00000100:00100000:1.0:1788986585.382353:0:89437:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986585.382513:0:89437:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986585.382671:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788986585.382684:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993568256 00000100:00100000:2.0:1788986585.382690:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993568256 00000100:00100000:2.0:1788986585.382778:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:2.0:1788986585.382788:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a796ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:89437:x1875885993568256:12345-0@lo:104: 00010000:00010000:2.0:1788986585.382800:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549536 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986585.382874:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986585.382880:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a796ff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:89437:x1875885993568256:12345-0@lo:104: Request processed in 95us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986585.382887:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00010000:00010000:3.0:1788986585.382962:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986585.382969:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549536 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.382976:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986585.382980:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549536 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.382988:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549536 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986585.382995:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549536 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986585.383001:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986585.383031:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549536 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383038:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986585.383058:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549536 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383066:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54952f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549536 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383083:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986585.383085:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986585.383114:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986585.383144:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993568384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986585.383186:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986585.383238:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993568384 00000100:00100000:3.0:1788986585.383242:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993568384 00010000:00010000:3.0:1788986585.383263:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf549536 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54952f expref: 19 pid: 5849 timeout: 2469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986585.383284:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:3.0:1788986585.383291:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993568384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986585.383300:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986585.383305:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf549536 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54952f expref: 19 pid: 5849 timeout: 2469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383315:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf549536 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54952f expref: 19 pid: 5849 timeout: 2469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383330:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383339:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383357:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383364:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383372:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383379:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383385:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986585.383389:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383397:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383405:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986585.383414:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986585.383441:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993568384:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986585.383447:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00010000:00010000:1.0:1788986585.383584:0:89437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf549536 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54952f expref: 19 pid: 5849 timeout: 2469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986585.383610:0:89437:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89437:1875885993568256:0@lo:104: 00010000:00010000:1.0:1788986585.383630:0:89437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986585.383640:0:89437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986585.383647:0:89437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986585.383654:0:89437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54953d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986585.384504:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993568384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986586.048592:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986586.116924:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993568640:0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.116990:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986586.117034:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993569152:0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.117061:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986586.117108:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788986586.117116:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993568512:0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.117143:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986586.117169:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993569024:0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.117204:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986586.117229:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993568768:0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.117249:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986586.117269:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986586.117275:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993568896:0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.117299:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986586.117329:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993568640 00000100:00100000:0.0:1788986586.117335:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993568640 00000100:00100000:0.0:1788986586.117391:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993569024 00000100:00100000:0.0:1788986586.117395:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993569024 00000100:00100000:0.0:1788986586.117427:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993568768 00000100:00100000:0.0:1788986586.117431:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993568768 00000100:00100000:0.0:1788986586.117453:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1680 00000100:00100000:0.0:1788986586.117463:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993568640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.117514:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993568640:12345-0@lo:400:kworker.0 Request processed in 52us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986586.117521:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1680 00000100:00100000:0.0:1788986586.117544:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1681 00000100:00100000:0.0:1788986586.117551:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993569024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.117579:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993569024:12345-0@lo:400:kworker.0 Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986586.117585:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1681 00000100:00100000:0.0:1788986586.117599:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1788986586.117605:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993568768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.117636:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993568768:12345-0@lo:400:kworker.0 Request processed in 32us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986586.117642:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1682 00000100:00100000:0.0:1788986586.117663:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993569152 00000100:00100000:0.0:1788986586.117666:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993569152 00000100:00100000:0.0:1788986586.117801:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993568896 00000100:00100000:0.0:1788986586.117805:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993568896 00000100:00100000:0.0:1788986586.117828:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1788986586.117835:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993569152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.117876:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993569152:12345-0@lo:400:kworker.0 Request processed in 42us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986586.117882:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1247 00000100:00100000:0.0:1788986586.117894:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1788986586.117900:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993568896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.117930:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993568896:12345-0@lo:400:kworker.0 Request processed in 30us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986586.117935:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1248 00000100:00100000:0.0:1788986586.117955:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993568512 00000100:00100000:0.0:1788986586.117959:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993568512 00000100:00100000:0.0:1788986586.117984:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1315 00000100:00100000:0.0:1788986586.117992:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993568512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.118028:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993568512:12345-0@lo:400:kworker.0 Request processed in 37us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986586.118034:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1315 00000100:00080000:0.0:1788986586.118077:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986586.118082:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986586.118133:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993568512:0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.118147:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993569024:0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.118156:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993568640:0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.118165:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993569152:0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.118216:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993568896:0@lo:400:kworker.0 00000100:00100000:0.0:1788986586.118600:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993568768:0@lo:400:kworker.0 00000100:00100000:3.0:1788986586.624345:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986586.624369:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993569280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986586.624433:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986586.624719:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993569280 00000100:00100000:2.0:1788986586.624727:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993569280 00000100:00100000:2.0:1788986586.624778:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 853 00000100:00100000:2.0:1788986586.624787:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993569280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986586.624820:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986586.624881:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993569280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986586.624888:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 853 00000100:00100000:3.0:1788986586.624975:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993569280:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788986586.754963:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986586.754972:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986586.754976:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986586.755017:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986586.755028:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986586.755039:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986586.755062:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993569408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986586.755141:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986586.755199:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b6600 going to sleep for 11 seconds 00000100:00100000:1.0:1788986586.755437:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993569408 00000100:00100000:1.0:1788986586.755444:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993569408 00000100:00100000:1.0:1788986586.755529:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1788986586.755538:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993569408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986586.755550:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986586.755562:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54954b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549544 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986586.755583:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54954b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549544 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986586.755594:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54954b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549544 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986586.755601:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788986586.755648:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993569408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986586.755655:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1788986586.755791:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993569408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986586.755872:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54954b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986586.755883:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54954b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986586.755901:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986586.755906:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54954b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986586.755984:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54954b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986587.072233:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986588.096381:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986588.277191:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986588.277228:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986588.277338:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971362432 00000100:00100000:0.0:1788986588.277348:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971362432 00000100:00100000:0.0:1788986588.277396:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1317 00000100:00100000:0.0:1788986588.277405:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971362432:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986588.277471:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971362432:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986588.277478:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1317 00000100:00100000:0.0:1788986588.277507:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971362560 00000100:00100000:0.0:1788986588.277511:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971362560 00000100:00100000:0.0:1788986588.277543:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1683 00000100:00100000:0.0:1788986588.277549:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971362560:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986588.277576:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971362560:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986588.277582:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1683 00000100:00080000:0.0:1788986588.277596:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986588.402252:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986588.402441:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971362688 00000100:00100000:0.0:1788986588.402450:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971362688 00000100:00100000:0.0:1788986588.402511:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 960 00000100:00100000:0.0:1788986588.402521:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:52866:x1875885971362688:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986588.402542:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986588.402566:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549552 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13e6 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.402871:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf549559 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.402885:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf549559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.402899:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf549559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986588.402933:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788986588.402937:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986588.402959:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf549559 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.402983:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549552 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13e6 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.403001:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf549559 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13e6 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.403010:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:0.0:1788986588.403012:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986588.403015:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788986588.403075:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:52866:x1875885971362688:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 556us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986588.403083:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 960 00000100:00100000:3.0:1788986588.409196:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986588.409525:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971362816 00000100:00100000:0.0:1788986588.409535:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971362816 00000100:00100000:0.0:1788986588.409593:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 961 00000100:00100000:0.0:1788986588.409604:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:52866:x1875885971362816:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986588.409623:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986588.409643:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549560 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13ed expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.409706:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549567 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.409720:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549567 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.409731:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549567 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.409745:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54956e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.409752:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54956e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.409758:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54956e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410045:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549575 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410054:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410061:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986588.410123:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:0.0:1788986588.410127:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986588.410147:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549575 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410172:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549567 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410179:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549567 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410185:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549567 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410191:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986588.410195:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549567 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410203:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549567 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410214:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:0.0:1788986588.410217:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986588.410221:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549567 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410227:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549567 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410240:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54956e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410246:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54956e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410253:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54956e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410259:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986588.410262:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54956e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410268:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54956e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410275:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a4823b400) 00010000:00010000:0.0:1788986588.410277:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986588.410280:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54956e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410286:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54956e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410312:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549560 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13ed expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410325:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549575 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13ed expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.410333:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a4823b800) 00010000:00010000:0.0:1788986588.410336:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986588.410338:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986588.410397:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:52866:x1875885971362816:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 795us (1209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986588.410404:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 961 00000100:00100000:1.0:1788986588.414270:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986588.414350:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971363072 00000100:00100000:0.0:1788986588.414360:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971363072 00000100:00100000:0.0:1788986588.414436:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 962 00000100:00100000:0.0:1788986588.414446:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:52866:x1875885971363072:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788986588.414496:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986588.414522:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549575 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13ed expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.414541:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a4823b800) 00010000:00010000:0.0:1788986588.414551:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986588.414770:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54957c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.414785:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54957c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986588.414795:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54957c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788986588.468287:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967661 is committed 00000004:00010000:3.0:1788986588.468420:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000227ed3e2 reply state 000000009fa5d373 transno 4294967661 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54957c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986588.468434:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986588.468448:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00010000:00080000:3.0:1788986588.468544:0:5855:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788986588.468564:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:52866:x1875885971363072:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 54115us (54298us total) trans 4294967661 rc 0/0 00010000:00010000:1.0:1788986588.468660:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54957c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986588.468668:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54957c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986588.468676:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54957c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986588.468682:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986588.468686:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54957c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986588.468697:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54957c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986588.468712:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a4823b000) 00010000:00010000:1.0:1788986588.468715:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986588.468720:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54957c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986588.468725:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54957c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986588.468773:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 962 00010000:00010000:3.0:1788986589.121081:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986589.223875:0:89634:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff767ca0b0 20000000:00000080:3.0:1788986589.223890:0:89634:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7baa7c00 uarg=0000000000000000 00010000:00010000:3.0:1788986589.224377:0:89634:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788986589.224409:0:89634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:3.0:1788986589.224413:0:89634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986589.224424:0:89634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf549559 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13e6 expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986589.224444:0:89634:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1788986589.224460:0:89634:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986589.224473:0:89634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986589.224487:0:89634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54954b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549544 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986589.224496:0:89634:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986589.224528:0:89634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54954b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549544 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986589.224542:0:89634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54954b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549544 expref: 18 pid: 5849 timeout: 2473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986589.224555:0:89634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89634:1875885993569536:0@lo:104: 00000100:00100000:3.0:1788986589.224609:0:89634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986589.224667:0:89634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c61cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986589.224685:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993569536 00000100:00100000:1.0:1788986589.224692:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993569536 00000100:00100000:1.0:1788986589.224730:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788986589.224739:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:89634:x1875885993569536:12345-0@lo:104: 00010000:00010000:1.0:1788986589.224751:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54954b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986589.224829:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986589.224835:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:89634:x1875885993569536:12345-0@lo:104: Request processed in 98us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986589.224842:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00010000:00010000:2.0:1788986589.225045:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986589.225052:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54954b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986589.225059:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986589.225063:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54954b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986589.225072:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54954b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986589.225079:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54954b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986589.225085:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986589.225135:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54954b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986589.225141:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986589.225173:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54954b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986589.225181:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549544 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54954b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986589.225196:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986589.225199:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986589.225201:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986589.225215:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993569664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986589.225264:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986589.225325:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993569664 00000100:00100000:1.0:1788986589.225329:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993569664 00010000:00010000:1.0:1788986589.225349:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54954b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549544 expref: 19 pid: 5849 timeout: 2473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986589.225383:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:1.0:1788986589.225391:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993569664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986589.225401:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986589.225406:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54954b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549544 expref: 19 pid: 5849 timeout: 2473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986589.225415:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54954b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549544 expref: 19 pid: 5849 timeout: 2473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986589.225430:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986589.225438:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986589.225452:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986589.225459:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986589.225466:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986589.225472:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986589.225477:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986589.225481:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986589.225487:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986589.225499:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986589.225508:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986589.225542:0:89634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54954b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549544 expref: 19 pid: 5849 timeout: 2473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986589.225552:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993569664:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986589.225557:0:89634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89634:1875885993569536:0@lo:104: 00000100:00100000:1.0:1788986589.225563:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00010000:00010000:3.0:1788986589.225579:0:89634:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986589.225589:0:89634:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986589.225596:0:89634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986589.225650:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993569664:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986589.225742:0:89634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549583 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986590.148629:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986590.209244:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986590.209266:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993569792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986590.209334:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986590.209820:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993569792 00000100:00100000:3.0:1788986590.209829:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993569792 00000100:00100000:3.0:1788986590.209875:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:3.0:1788986590.209884:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993569792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986590.209913:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986590.209959:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993569792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986590.209966:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:2.0:1788986590.210271:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993569792:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986590.210402:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1788986590.401212:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986590.401220:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986590.401226:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986590.401274:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986590.401285:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986590.401296:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986590.401320:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993569920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986590.401384:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986590.401448:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09426a6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788986590.402266:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993569920 00000100:00100000:3.0:1788986590.402274:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993569920 00000100:00100000:3.0:1788986590.402327:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1318 00000100:00100000:3.0:1788986590.402336:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993569920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986590.402348:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986590.402362:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549591 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54958a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986590.402385:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549591 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54958a expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986590.402396:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549591 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54958a expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986590.402405:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986590.402457:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993569920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986590.402464:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1318 00000100:00100000:1.0:1788986590.402663:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993569920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986590.402678:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549591 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986590.402686:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549591 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986590.402705:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986590.402709:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549591 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986590.402717:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549591 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986591.172241:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986591.236426:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993570432:0@lo:400:kworker.0 00000100:00100000:1.0:1788986591.236490:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986591.236540:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788986591.236547:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993570048:0@lo:400:kworker.0 00000100:00100000:1.0:1788986591.236574:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986591.236599:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993570560:0@lo:400:kworker.0 00000100:00100000:1.0:1788986591.236632:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986591.236634:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993570176:0@lo:400:kworker.0 00000100:00100000:1.0:1788986591.236662:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993570432 00000100:00100000:0.0:1788986591.236662:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986591.236668:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993570432 00000100:00100000:0.0:1788986591.236679:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993570688:0@lo:400:kworker.0 00000100:00100000:0.0:1788986591.236698:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986591.236706:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993570688 00000100:00100000:1.0:1788986591.236709:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993570688 00000100:00100000:0.0:1788986591.236713:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986591.236730:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993570304:0@lo:400:kworker.0 00000100:00100000:1.0:1788986591.236736:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1249 00000100:00100000:1.0:1788986591.236744:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993570432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986591.236752:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986591.236778:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993570560 00000100:00100000:0.0:1788986591.236782:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993570560 00000100:00100000:1.0:1788986591.236791:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993570432:12345-0@lo:400:kworker.0 Request processed in 47us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986591.236797:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1249 00000100:00100000:0.0:1788986591.236806:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993570176 00000100:00100000:0.0:1788986591.236809:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993570176 00000100:00100000:1.0:1788986591.236811:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1250 00000100:00100000:1.0:1788986591.236815:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993570688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986591.236825:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993570304 00000100:00100000:0.0:1788986591.236827:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993570304 00000100:00100000:0.0:1788986591.236842:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1684 00000100:00100000:1.0:1788986591.236845:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993570688:12345-0@lo:400:kworker.0 Request processed in 30us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986591.236847:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993570560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986591.236851:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1250 00000100:00100000:1.0:1788986591.236867:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993570048 00000100:00100000:1.0:1788986591.236870:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993570048 00000100:00100000:0.0:1788986591.236875:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993570560:12345-0@lo:400:kworker.0 Request processed in 28us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986591.236881:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1684 00000100:00100000:0.0:1788986591.236893:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1685 00000100:00100000:0.0:1788986591.236899:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993570176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986591.236907:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1319 00000100:00100000:1.0:1788986591.236912:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993570048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986591.236925:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993570176:12345-0@lo:400:kworker.0 Request processed in 27us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986591.236931:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1685 00000100:00100000:1.0:1788986591.236934:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993570048:12345-0@lo:400:kworker.0 Request processed in 23us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986591.236939:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1319 00000100:00100000:0.0:1788986591.236942:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1686 00000100:00100000:0.0:1788986591.236947:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993570304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986591.236971:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993570304:12345-0@lo:400:kworker.0 Request processed in 24us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986591.236974:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993570048:0@lo:400:kworker.0 00000100:00100000:0.0:1788986591.236977:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1686 00000100:00100000:1.0:1788986591.236986:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993570560:0@lo:400:kworker.0 00000100:00100000:1.0:1788986591.236994:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993570432:0@lo:400:kworker.0 00000100:00080000:0.0:1788986591.236999:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986591.237003:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986591.237026:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993570304:0@lo:400:kworker.0 00000100:00100000:0.0:1788986591.237035:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993570176:0@lo:400:kworker.0 00000100:00100000:0.0:1788986591.237043:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993570688:0@lo:400:kworker.0 00000100:00100000:1.0:1788986591.747848:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993570816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986591.747913:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986591.747990:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993570816 00000100:00100000:1.0:1788986591.747997:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993570816 00000100:00100000:1.0:1788986591.748043:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:1.0:1788986591.748052:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993570816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986591.748082:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986591.748156:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993570816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986591.748163:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:1.0:1788986591.748209:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993570816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986592.192737:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986592.196230:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986592.196663:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971363200 00000100:00100000:0.0:1788986592.196674:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971363200 00000100:00100000:0.0:1788986592.196739:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 963 00000100:00100000:0.0:1788986592.196748:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:52942:x1875885971363200:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788986592.196773:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986592.196792:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549598 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13f4 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.196847:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54959f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.196868:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54959f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.196880:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54959f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.196892:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.196898:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.196904:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197204:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5495ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197212:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5495ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197220:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5495ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986592.197239:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:0.0:1788986592.197242:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986592.197259:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5495ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197270:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54959f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197276:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54959f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197282:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54959f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197288:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efe00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986592.197292:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54959f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197299:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54959f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197309:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986592.197311:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986592.197315:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54959f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197320:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54959f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197330:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197341:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197347:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197351:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986592.197354:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197359:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197365:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a4823bd00) 00010000:00010000:0.0:1788986592.197367:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986592.197370:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495a6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197375:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197398:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549598 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13f4 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197411:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5495ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13f4 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.197417:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:0.0:1788986592.197419:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986592.197422:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efc00, rc 0) 00000100:00100000:0.0:1788986592.197467:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:52942:x1875885971363200:12345-192.168.206.21@tcp:101:touch.0 Request processed in 720us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986592.197474:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 963 00000100:00080000:2.0:1788986592.197828:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986592.200707:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986592.200779:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971363456 00000100:00100000:0.0:1788986592.200788:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971363456 00000100:00100000:0.0:1788986592.200846:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 964 00000100:00100000:0.0:1788986592.200855:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:52942:x1875885971363456:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788986592.200885:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986592.200903:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5495b4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d13fb expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.201294:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5495bb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.201309:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5495bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.201319:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5495bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.201377:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5495c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.201385:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5495c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.201392:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5495c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986592.202041:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x1f:0x0], index 0: 0 00010000:00010000:0.0:1788986592.202338:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5495c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.202349:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5495c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.202357:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5495c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.202390:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5495bb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.202397:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5495bb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.202403:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5495bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.202409:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986592.202414:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5495bb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.202421:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5495bb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.202432:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:0.0:1788986592.202435:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986592.202439:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5495bb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.202446:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5495bb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986592.202459:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fa916e24 reply state 0000000019fc74b9 transno 4294967662 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5495c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986592.202466:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788986592.202494:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5495b4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13fb expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.202508:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5495c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13fb expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.202515:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:0.0:1788986592.202518:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986592.202520:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef800, rc 0) 00000100:00100000:0.0:1788986592.202587:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:52942:x1875885971363456:12345-192.168.206.21@tcp:101:touch.0 Request processed in 1732us (1889us total) trans 4294967662 rc 0/0 00000100:00100000:0.0:1788986592.202595:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 964 00000100:00100000:3.0:1788986592.205472:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:1.0:1788986592.206120:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5495c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.206132:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5495c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.206156:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5495c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.206163:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986592.206168:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5495c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.206175:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5495c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.206190:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a4823b200) 00010000:00010000:1.0:1788986592.206194:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986592.206198:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5495c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.206203:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf5495c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986592.206308:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971363712 00000100:00100000:2.0:1788986592.206317:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971363712 00000100:00100000:2.0:1788986592.206377:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 965 00000100:00100000:2.0:1788986592.206387:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:52942:x1875885971363712:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:2.0:1788986592.206438:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986592.206454:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf5495c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13fb expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.206472:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:2.0:1788986592.206478:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986592.206514:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5495d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.206526:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5495d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.206535:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5495d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986592.206650:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000082dd3680 reply state 000000002f084fff transno 4294967663 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5495d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986592.206658:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986592.206742:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:52942:x1875885971363712:12345-192.168.206.21@tcp:36:touch.0 Request processed in 356us (1277us total) trans 4294967663 rc 0/0 00000100:00100000:2.0:1788986592.206749:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 965 00010000:00010000:3.0:1788986592.208862:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5495d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986592.208882:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5495d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986592.208889:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5495d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986592.208895:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986592.208899:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5495d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986592.208906:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5495d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986592.208920:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:3.0:1788986592.208923:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986592.208928:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5495d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986592.208934:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5495d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986592.210609:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986592.210676:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971363840 00000100:00100000:0.0:1788986592.210685:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971363840 00000100:00100000:0.0:1788986592.210740:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 966 00000100:00100000:0.0:1788986592.210752:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:52942:x1875885971363840:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788986592.210774:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986592.210802:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5495de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1402 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.210856:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5495de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1402 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.210876:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5495de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1402 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.210894:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986592.210897:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788986592.210901:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee400, rc 0) 00000100:00100000:0.0:1788986592.210957:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:52942:x1875885971363840:12345-192.168.206.21@tcp:101:touch.0 Request processed in 209us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986592.210964:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 966 00000100:00100000:2.0:1788986592.214229:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986592.215418:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971363968 00000100:00100000:0.0:1788986592.215429:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971363968 00000100:00100000:0.0:1788986592.215485:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 524 00000100:00100000:0.0:1788986592.215494:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2345:x1875885971363968:12345-192.168.206.21@tcp:8:touch.0 00010000:00080000:0.0:1788986592.215525:0:86533:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 2376 last 0 00000020:00000080:0.0:1788986592.215554:0:86533:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf5495e5 00002000:00100000:0.0:1788986592.215565:0:86533:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b094371a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788986592.215587:0:86533:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788986592.215869:0:86533:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788986592.215898:0:86533:0:(import.c:65:import_set_state_nolock()) ffff9b094371e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788986592.216084:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971363968:12345-192.168.206.21@tcp:8:touch.0 Request processed in 588us (1862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986592.216162:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 524 00000100:00100000:3.0:1788986592.218874:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986592.219047:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971364096 00000100:00100000:0.0:1788986592.219056:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971364096 00000100:00100000:0.0:1788986592.219167:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 525 00000100:00100000:0.0:1788986592.219177:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:0:x1875885971364096:12345-192.168.206.21@tcp:2:touch.0 00000100:00080000:2.0:1788986592.219962:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788986592.261164:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967358 is committed 00000001:00100000:1.0:1788986592.261176:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:0.0:1788986592.261547:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:0:x1875885971364096:12345-192.168.206.21@tcp:2:touch.0 Request processed in 42367us (42675us total) trans 4294967358 rc 0/0 00000100:00100000:0.0:1788986592.261558:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 525 00000100:00100000:3.0:1788986592.264081:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986592.264219:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971364352 00000100:00100000:0.0:1788986592.264229:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971364352 00000100:00100000:0.0:1788986592.264291:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:0.0:1788986592.264301:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:52942:x1875885971364352:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:0.0:1788986592.264591:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:52942:x1875885971364352:12345-192.168.206.21@tcp:35:touch.0 Request processed in 291us (518us total) trans 4294967664 rc 0/0 00000100:00100000:0.0:1788986592.264598:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 96 00000100:00100000:3.0:1788986592.334917:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986592.335071:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971364480 00000100:00100000:0.0:1788986592.335080:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971364480 00000100:00100000:0.0:1788986592.335172:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 967 00000100:00100000:0.0:1788986592.335182:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:52946:x1875885971364480:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986592.335203:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986592.335221:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5495ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1409 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335287:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5495f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335300:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5495f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335310:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5495f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335322:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335329:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335335:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335417:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549601 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335424:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335430:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986592.335458:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4f:0x0]: returning size 0 00000004:00200000:0.0:1788986592.335462:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986592.335478:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335488:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549601 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335495:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5495f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335501:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5495f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335513:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5495f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335519:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986592.335522:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5495f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335529:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5495f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335550:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:0.0:1788986592.335552:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986592.335556:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5495f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335562:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5495f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335574:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335581:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335586:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335591:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986592.335593:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335604:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335616:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a4823be00) 00010000:00010000:0.0:1788986592.335619:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986592.335622:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335628:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5495fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335651:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5495ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1409 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335663:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549601 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1409 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.335671:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986592.335673:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986592.335675:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efe00, rc 0) 00000100:00100000:0.0:1788986592.335723:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:52946:x1875885971364480:12345-192.168.206.21@tcp:101:rm.0 Request processed in 543us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986592.335729:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 967 00000100:00100000:3.0:1788986592.341668:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986592.341751:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971364608 00000100:00100000:0.0:1788986592.341760:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971364608 00000100:00100000:0.0:1788986592.341822:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 526 00000100:00100000:0.0:1788986592.341832:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971364608:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986592.341853:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986592.341882:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000756763aa/0xc20d828fcf549608 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1410 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986592.341917:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x6aa1c4df, atime: 0x6aa1c4df, ctime: 0x6aa1c4df, blocks: 0x1 00010000:00010000:0.0:1788986592.341936:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=2376s v=(0 0) 00010000:00010000:0.0:1788986592.341941:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986592.341951:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000756763aa/0xc20d828fcf549608 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1410 expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.341970:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000756763aa/0xc20d828fcf549608 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1410 expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986592.341983:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef000, rc 0) 00000100:00100000:0.0:1788986592.342048:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971364608:12345-192.168.206.21@tcp:101:rm.0 Request processed in 217us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986592.342056:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 526 00000100:00100000:1.0:1788986592.346574:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986592.346710:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971364864 00000100:00100000:2.0:1788986592.346719:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971364864 00000100:00100000:2.0:1788986592.346783:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 968 00000100:00100000:2.0:1788986592.346794:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:52946:x1875885971364864:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:2.0:1788986592.346842:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986592.346878:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549601 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1409 expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.346907:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5495de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1402 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.346917:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:2.0:1788986592.346928:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986592.346948:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54960f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.346961:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54960f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.346971:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54960f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.346984:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549616 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.346991:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.346998:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.347136:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54961d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.347155:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54961d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.347161:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54961d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986592.348204:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].31, 64 off10176 00000004:00080000:2.0:1788986592.348215:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2376251125144ns, next at 2377251122954ns, rc = 0 00010000:00010000:2.0:1788986592.348269:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549624 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.348281:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.348289:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549624 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.348296:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549624 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.348302:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549624 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.348307:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549624 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.348321:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986592.348337:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54961d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.348589:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54961d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.348596:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54961d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.348601:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986592.349209:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54961d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.349221:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54961d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.349232:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:2.0:1788986592.349240:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986592.349245:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54961d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.349252:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54961d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.349272:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54960f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.349279:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54960f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.349284:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54960f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.349289:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986592.349291:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54960f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.349298:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54960f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.349305:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:2.0:1788986592.349308:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986592.349311:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54960f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986592.349317:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54960f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986592.349327:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000be39310c reply state 00000000ecc5b358 transno 4294967665 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986592.349335:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986592.349501:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986592.349509:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549624 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.349516:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986592.349519:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549624 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.349526:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549624 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.349536:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4f:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:1.0:1788986592.349539:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788986592.349542:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549624 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.349547:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549624 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.349564:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986592.349566:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986592.349567:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986592.349842:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:52946:x1875885971364864:12345-192.168.206.21@tcp:36:rm.0 Request processed in 2984us (3210us total) trans 4294967665 rc 0/0 00000100:00100000:2.0:1788986592.349852:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 968 00010000:00010000:1.0:1788986592.352154:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549616 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.352169:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549616 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.352177:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549616 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.352184:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986592.352188:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549616 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.352196:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549616 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.352210:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a45aca300) 00010000:00010000:1.0:1788986592.352213:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986592.352217:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549616 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986592.352222:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549616 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986593.222376:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986593.396512:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986593.396541:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986593.396567:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986593.396595:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971364992 00000100:00100000:3.0:1788986593.396605:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971364992 00000100:00100000:3.0:1788986593.399294:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1320 00000100:00100000:3.0:1788986593.399316:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971364992:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986593.399393:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971364992:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 87us (2888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986593.399401:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1320 00000100:00100000:3.0:1788986593.399442:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971365248 00000100:00100000:3.0:1788986593.399449:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971365248 00000100:00100000:3.0:1788986593.399487:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1251 00000100:00100000:3.0:1788986593.399497:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971365248:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986593.399525:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971365248:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (2983us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986593.399530:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1251 00000100:00100000:3.0:1788986593.399548:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971365120 00000100:00100000:3.0:1788986593.399552:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971365120 00000100:00100000:3.0:1788986593.399579:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1687 00000100:00100000:3.0:1788986593.399585:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:2349:x1875885971365120:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986593.399617:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:2349:x1875885971365120:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (3049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986593.399622:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1687 00000001:00080000:0.0:1788986593.898367:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967664 is committed 00000001:00080000:0.0:1788986593.898387:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967665 is committed 00000004:00080000:0.0:1788986593.898392:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 83 committed 00000100:00100000:3.0:1788986593.898814:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986593.898832:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993570944:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788986593.898892:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986593.898951:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993570944 00000100:00100000:3.0:1788986593.898958:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993570944 00000100:00100000:0.0:1788986593.903829:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1788986593.903845:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993570944:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788986593.903875:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:31 count 1 00010000:00010000:0.0:1788986593.903898:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986593.903924:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000756763aa/0xc20d828fcf549608 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1410 expref: 5 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986593.903933:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788986593.903937:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986593.903942:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986593.903974:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000756763aa/0xc20d828fcf549608 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1410 expref: 5 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986593.903989:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000756763aa/0xc20d828fcf549608 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1410 expref: 5 pid: 8478 timeout: 2477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986593.904001:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875885993571072:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986593.904080:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7feff900 going to sleep for 11 seconds 00000100:00080000:3.0:1788986593.908144:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986593.913948:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875885993571072:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788986593.913975:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986593.919357:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986593.919758:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971365376 00000100:00100000:3.0:1788986593.919768:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971365376 00010000:00010000:3.0:1788986593.919807:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000756763aa/0xc20d828fcf549608 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1410 expref: 6 pid: 8478 timeout: 2477 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986593.919851:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 416 00000100:00100000:3.0:1788986593.919861:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971365376:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986593.919876:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986593.919882:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000756763aa/0xc20d828fcf549608 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1410 expref: 6 pid: 8478 timeout: 2477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986593.919894:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000756763aa/0xc20d828fcf549608 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1410 expref: 6 pid: 8478 timeout: 2477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986593.919918:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000756763aa/0xc20d828fcf549608 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1410 expref: 6 pid: 8478 timeout: 2477 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986593.919935:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986593.919939:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986593.919945:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986593.919959:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986593.919985:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986593.920045:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971365376:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 185us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986593.920053:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 416 00010000:00010000:3.0:1788986593.921467:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986593.921481:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986593.921492:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986593.921499:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986593.921555:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788986593.922212:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993570944:12345-0@lo:6:osp-syn-0-0.0 Request processed in 18370us (23316us total) trans 4294967359 rc 0/0 00000100:00100000:3.0:1788986593.922221:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000004:00080000:0.0:1788986593.922371:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b09425f3480/2, rc 0, transno 4294967359 00000100:00100000:0.0:1788986593.922379:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993570944:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788986593.925595:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986593.925607:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986593.925619:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986593.925624:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986593.925635:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986593.925655:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986593.925663:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54962b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986593.925693:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986593.925695:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986593.925697:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986594.240444:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986594.310774:0:89882:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffebf816800 20000000:00000080:3.0:1788986594.310804:0:89882:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7601b000 uarg=0000000000000000 00010000:00010000:3.0:1788986594.311310:0:89882:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788986594.311342:0:89882:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:3.0:1788986594.311347:0:89882:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986594.311356:0:89882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf5495ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d13f4 expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986594.311376:0:89882:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1788986594.311391:0:89882:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986594.311404:0:89882:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986594.311416:0:89882:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549591 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54958a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986594.311423:0:89882:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986594.311460:0:89882:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549591 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54958a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986594.311474:0:89882:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549591 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54958a expref: 18 pid: 5849 timeout: 2478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986594.311487:0:89882:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89882:1875885993571200:0@lo:104: 00000100:00100000:3.0:1788986594.311544:0:89882:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986594.311582:0:89882:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5ab38540 going to sleep for 11 seconds 00000100:00100000:2.0:1788986594.311661:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993571200 00000100:00100000:2.0:1788986594.311668:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993571200 00000100:00100000:2.0:1788986594.311719:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:2.0:1788986594.311728:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:89882:x1875885993571200:12345-0@lo:104: 00010000:00010000:2.0:1788986594.311741:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549591 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.311796:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986594.311802:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:89882:x1875885993571200:12345-0@lo:104: Request processed in 76us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986594.311809:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00010000:00010000:2.0:1788986594.311830:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986594.311835:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549591 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.311842:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986594.311846:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549591 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.311855:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549591 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986594.311861:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549591 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986594.311867:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986594.311894:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549591 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.311901:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986594.311919:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549591 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.311926:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54958a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549591 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.311940:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986594.311941:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986594.311942:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986594.311958:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993571328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986594.311988:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986594.312021:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993571328 00000100:00100000:2.0:1788986594.312025:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993571328 00010000:00010000:2.0:1788986594.312041:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549591 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54958a expref: 19 pid: 5849 timeout: 2478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986594.312061:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1788986594.312067:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a5abf1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993571328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986594.312077:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986594.312082:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549591 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54958a expref: 19 pid: 5849 timeout: 2478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.312118:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549591 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54958a expref: 19 pid: 5849 timeout: 2478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.312140:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.312147:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.312158:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.312165:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.312172:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.312179:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.312184:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986594.312187:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.312194:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.312205:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986594.312212:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986594.312241:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a5abf1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993571328:12345-0@lo:103:ldlm_bl.0 Request processed in 174us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986594.312247:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1788986594.312309:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993571328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986594.312759:0:89882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549591 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54958a expref: 18 pid: 5849 timeout: 2478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986594.312772:0:89882:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:89882:1875885993571200:0@lo:104: 00010000:00010000:3.0:1788986594.312800:0:89882:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986594.312809:0:89882:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986594.312816:0:89882:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986594.312822:0:89882:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549632 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 89882 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986595.264988:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986595.341269:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993571456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986595.341346:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986595.341517:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993571456 00000100:00100000:1.0:1788986595.341526:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993571456 00000100:00100000:1.0:1788986595.341588:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1788986595.341598:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993571456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986595.341630:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986595.341686:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993571456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986595.341692:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:1.0:1788986595.341742:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993571456:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986595.341901:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986596.288269:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788986596.289391:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986596.289397:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986596.289401:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986596.289441:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986596.289452:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986596.289462:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986596.289486:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993571584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986596.289549:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986596.289656:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09429d0780 going to sleep for 11 seconds 00000100:00100000:3.0:1788986596.295200:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993571584 00000100:00100000:3.0:1788986596.295213:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993571584 00000100:00100000:3.0:1788986596.295265:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1788986596.295276:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993571584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986596.295292:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986596.295650:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549640 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549639 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986596.295679:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549640 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549639 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986596.295689:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549640 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549639 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986596.295697:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986596.295802:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993571584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 528us (6253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986596.295809:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:2.0:1788986596.303723:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993571584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986596.303751:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549640 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986596.303764:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549640 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986596.303950:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986596.303957:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549640 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986596.303965:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549640 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986596.352461:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993571840:0@lo:400:kworker.0 00000100:00100000:2.0:1788986596.352523:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986596.352560:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986596.352565:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993571968:0@lo:400:kworker.0 00000100:00100000:1.0:1788986596.352669:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993572096:0@lo:400:kworker.0 00000100:00100000:1.0:1788986596.352695:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986596.352721:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788986596.352725:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993571712:0@lo:400:kworker.0 00000100:00100000:1.0:1788986596.352744:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986596.352760:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993572224:0@lo:400:kworker.0 00000100:00100000:1.0:1788986596.352784:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993571840 00000100:00100000:1.0:1788986596.352790:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993571840 00000100:00100000:1.0:1788986596.352837:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993572096 00000100:00100000:1.0:1788986596.352839:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993572096 00000100:00100000:1.0:1788986596.352859:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993571712 00000100:00100000:1.0:1788986596.352861:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993571712 00000100:00100000:1.0:1788986596.352876:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1688 00000100:00100000:1.0:1788986596.352884:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993571840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986596.352930:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993571840:12345-0@lo:400:kworker.0 Request processed in 47us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986596.352938:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1688 00000100:00100000:1.0:1788986596.352954:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1689 00000100:00100000:1.0:1788986596.352959:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993572096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986596.353002:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993572096:12345-0@lo:400:kworker.0 Request processed in 42us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986596.353008:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1689 00000100:00100000:1.0:1788986596.353022:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1690 00000100:00100000:1.0:1788986596.353028:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993571712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986596.353056:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993571712:12345-0@lo:400:kworker.0 Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986596.353062:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1690 00000100:00080000:1.0:1788986596.353081:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986596.353294:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986596.353422:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993571840:0@lo:400:kworker.0 00000100:00100000:1.0:1788986596.353672:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993571968 00000100:00100000:1.0:1788986596.353677:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993571968 00000100:00100000:1.0:1788986596.353709:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1788986596.353716:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993571968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986596.353759:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993571968:12345-0@lo:400:kworker.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986596.353765:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1252 00000100:00100000:1.0:1788986596.353783:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986596.353808:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993572096:0@lo:400:kworker.0 00000100:00100000:1.0:1788986596.353826:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993571712:0@lo:400:kworker.0 00000100:00100000:1.0:1788986596.353842:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993572224 00000100:00100000:1.0:1788986596.353844:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993572224 00000100:00100000:1.0:1788986596.353872:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1253 00000100:00100000:1.0:1788986596.353878:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993572224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986596.353913:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993572224:12345-0@lo:400:kworker.0 Request processed in 35us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986596.353919:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1253 00000100:00080000:1.0:1788986596.353935:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986596.353951:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993572224:0@lo:400:kworker.0 00000100:00100000:2.0:1788986596.354269:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993571968:0@lo:400:kworker.0 00000100:00100000:3.0:1788986596.864462:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986596.864484:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993572352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986596.868478:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986596.868620:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993572352 00000100:00100000:3.0:1788986596.868628:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993572352 00000100:00100000:3.0:1788986596.868676:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 857 00000100:00100000:3.0:1788986596.868686:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993572352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986596.868720:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986596.868763:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993572352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986596.868770:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 857 00000100:00100000:2.0:1788986596.868849:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993572352:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986597.315580:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788986597.446268:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967359 is committed 00000100:00100000:1.0:1788986597.622709:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986597.623743:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971365504 00000100:00100000:3.0:1788986597.623753:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971365504 00000100:00100000:3.0:1788986597.623821:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 969 00000100:00100000:3.0:1788986597.623832:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53034:x1875885971365504:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986597.623851:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986597.623872:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549647 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1417 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986597.623929:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54964e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986597.623942:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54964e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986597.623954:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54964e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986597.623986:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:3.0:1788986597.623990:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986597.624007:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54964e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986597.624029:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549647 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1417 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986597.624048:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54964e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1417 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986597.624056:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:3.0:1788986597.624059:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986597.624062:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3200, rc 0) 00000100:00100000:3.0:1788986597.624153:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53034:x1875885971365504:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 323us (1452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986597.624160:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 969 00000100:00080000:1.0:1788986597.624783:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986597.630577:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986597.630673:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971365760 00000100:00100000:1.0:1788986597.630683:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971365760 00000100:00100000:1.0:1788986597.630742:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 970 00000100:00100000:1.0:1788986597.630752:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53034:x1875885971365760:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986597.630800:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986597.630828:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54964e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1417 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986597.630847:0:7899:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf5495ad) 00010000:00010000:1.0:1788986597.630851:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:1.0:1788986597.630860:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986597.630887:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549655 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986597.630899:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986597.630908:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788986597.670477:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967666 is committed 00000004:00010000:1.0:1788986597.670646:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000768c2a35 reply state 0000000043808d6f transno 4294967666 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986597.670660:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986597.670679:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00010000:00080000:1.0:1788986597.670784:0:7899:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788986597.670966:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53034:x1875885971365760:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 40211us (40394us total) trans 4294967666 rc 0/0 00000100:00100000:1.0:1788986597.670975:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 970 00010000:00010000:0.0:1788986597.671427:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549655 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986597.671438:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549655 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986597.671446:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986597.671453:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986597.671458:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549655 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986597.671465:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549655 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986597.671480:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45316000) 00010000:00010000:0.0:1788986597.671482:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788986597.671487:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549655 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986597.671494:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549655 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986598.337808:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788986598.356618:0:90078:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe5c4fad00 20000000:00000080:0.0:1788986598.356635:0:90078:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76001800 uarg=0000000000000000 00010000:00010000:0.0:1788986598.357275:0:90078:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986598.357291:0:90078:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986598.357304:0:90078:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986598.357320:0:90078:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986598.357337:0:90078:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549640 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549639 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986598.357345:0:90078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986598.357379:0:90078:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549640 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549639 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986598.357392:0:90078:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549640 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549639 expref: 18 pid: 5849 timeout: 2482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986598.357406:0:90078:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90078:1875885993572480:0@lo:104: 00000100:00100000:0.0:1788986598.357618:0:90078:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986598.357718:0:90078:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7feff780 going to sleep for 11 seconds 00000100:00100000:2.0:1788986598.357795:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993572480 00000100:00100000:2.0:1788986598.357803:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993572480 00000100:00100000:2.0:1788986598.357851:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788986598.357860:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:90078:x1875885993572480:12345-0@lo:104: 00010000:00010000:2.0:1788986598.357872:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549640 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986598.357982:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986598.357989:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:90078:x1875885993572480:12345-0@lo:104: Request processed in 131us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986598.357996:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00010000:00010000:1.0:1788986598.358017:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986598.358025:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549640 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358034:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986598.358038:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549640 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358047:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549640 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986598.358054:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549640 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986598.358059:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986598.358140:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549640 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358148:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986598.358182:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549640 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358190:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549639 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549640 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986598.358203:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993572608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986598.358209:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986598.358212:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986598.358214:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986598.358236:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986598.358295:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993572608 00000100:00100000:1.0:1788986598.358300:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993572608 00010000:00010000:1.0:1788986598.358323:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549640 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549639 expref: 19 pid: 5849 timeout: 2482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986598.358350:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788986598.358359:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993572608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986598.358370:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986598.358375:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549640 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549639 expref: 19 pid: 5849 timeout: 2482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358385:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549640 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549639 expref: 19 pid: 5849 timeout: 2482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358401:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358409:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358424:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358431:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358438:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358444:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358449:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986598.358453:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358460:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358469:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986598.358478:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986598.358518:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993572608:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986598.358525:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00000100:00100000:2.0:1788986598.358567:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993572608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986598.358722:0:90078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549640 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549639 expref: 18 pid: 5849 timeout: 2482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986598.358733:0:90078:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90078:1875885993572480:0@lo:104: 00010000:00010000:0.0:1788986598.358744:0:90078:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986598.358753:0:90078:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986598.358759:0:90078:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986598.358766:0:90078:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54965c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986598.512590:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986598.512650:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986598.512683:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986598.512712:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971365888 00000100:00100000:3.0:1788986598.512720:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971365888 00000100:00100000:3.0:1788986598.512768:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1322 00000100:00100000:3.0:1788986598.512779:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971365888:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986598.512841:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971365888:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 64us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986598.512849:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1322 00000100:00100000:3.0:1788986598.512887:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971366144 00000100:00100000:3.0:1788986598.512892:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971366144 00000100:00100000:3.0:1788986598.512935:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1254 00000100:00100000:3.0:1788986598.512944:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971366144:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986598.512987:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971366144:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986598.512995:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1254 00000100:00100000:1.0:1788986598.513048:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971366016 00000100:00100000:1.0:1788986598.513055:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971366016 00000100:00080000:3.0:1788986598.513140:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986598.513161:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1691 00000100:00100000:3.0:1788986598.513170:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971366016:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986598.513208:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971366016:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986598.513216:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1691 00010000:00010000:2.0:1788986599.361797:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788986600.384217:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986600.384228:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986600.384234:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986600.384303:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986600.384317:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986600.384331:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986600.384362:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993572736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986600.384451:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986600.384534:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788986600.384821:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993572736 00000100:00100000:3.0:1788986600.384831:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993572736 00000100:00100000:3.0:1788986600.384893:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1323 00000100:00100000:3.0:1788986600.384903:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993572736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986600.384920:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986600.384936:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54966a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549663 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986600.384964:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54966a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549663 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986600.384976:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54966a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549663 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986600.384986:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3c00, rc 0) 00000100:00100000:3.0:1788986600.385043:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993572736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986600.385051:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1323 00010000:00010000:1.0:1788986600.385161:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986600.389194:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993572736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986600.389236:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54966a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986600.389252:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54966a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986600.389283:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986600.389290:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54966a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986600.389371:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54966a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986600.448507:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986600.448549:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993572864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986600.448653:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986600.448699:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993572864 00000100:00100000:2.0:1788986600.448710:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993572864 00000100:00080000:0.0:1788986600.448884:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986600.449116:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:2.0:1788986600.449130:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993572864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986600.449177:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986600.449254:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993572864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986600.449262:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:0.0:1788986600.449586:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:0.0:1788986600.449594:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b09425f3480, transno 4294967359 00000100:00100000:0.0:1788986600.449629:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993572864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986601.066459:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986601.067399:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971366272 00000100:00100000:2.0:1788986601.067409:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971366272 00000100:00100000:2.0:1788986601.067482:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 971 00000100:00100000:2.0:1788986601.067492:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53111:x1875885971366272:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986601.067511:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986601.067532:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549671 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d141e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.067597:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549678 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.067611:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.067623:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.067636:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54967f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.067643:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54967f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.067649:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54967f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788986601.067670:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986601.068249:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549686 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068259:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068267:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986601.068288:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:2.0:1788986601.068291:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986601.068310:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549686 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068322:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549678 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068329:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549678 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068336:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068342:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986601.068346:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549678 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068353:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549678 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068363:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:2.0:1788986601.068366:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986601.068370:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549678 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068377:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549678 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068388:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54967f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068394:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54967f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068400:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54967f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068405:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986601.068408:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54967f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068413:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54967f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068419:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986601.068421:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986601.068423:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54967f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068429:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54967f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068456:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549671 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d141e expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068475:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549686 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d141e expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.068482:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:2.0:1788986601.068484:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986601.068486:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1800, rc 0) 00000100:00100000:2.0:1788986601.068640:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53111:x1875885971366272:12345-192.168.206.21@tcp:101:touch.0 Request processed in 1148us (2187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986601.068648:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 971 00000100:00100000:2.0:1788986601.073414:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986601.073505:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971366528 00000100:00100000:1.0:1788986601.073514:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971366528 00000100:00100000:1.0:1788986601.073567:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 972 00000100:00100000:1.0:1788986601.073577:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53111:x1875885971366528:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986601.073596:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986601.073613:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54968d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1425 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073692:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549694 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073705:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549694 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073716:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549694 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073730:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54969b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073740:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54969b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073746:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54969b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986601.073759:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00010000:00010000:1.0:1788986601.073776:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549694 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073784:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549694 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073790:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549694 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073796:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986601.073800:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549694 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073808:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549694 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073819:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:1.0:1788986601.073822:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986601.073827:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549694 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073833:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549694 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073848:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54969b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073854:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54969b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073860:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54969b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073866:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986601.073868:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54969b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073875:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54969b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073882:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a45316f00) 00010000:00010000:1.0:1788986601.073884:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986601.073886:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54969b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073892:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54969b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073921:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54968d lrc: 1/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1425 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073931:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:1.0:1788986601.073933:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986601.073937:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54968d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1425 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.073945:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788986601.074001:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53111:x1875885971366528:12345-192.168.206.21@tcp:101:touch.0 Request processed in 425us (594us total) trans 0 rc 301/301 00000100:00100000:1.0:1788986601.074008:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 972 00000100:00100000:3.0:1788986601.078931:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986601.080857:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971366656 00000100:00100000:1.0:1788986601.080871:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971366656 00000100:00100000:1.0:1788986601.080934:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 973 00000100:00100000:1.0:1788986601.080943:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53111:x1875885971366656:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986601.080962:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986601.080981:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5496a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d142c expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081043:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5496a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081069:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5496a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081081:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5496a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081133:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5496b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081140:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5496b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081147:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5496b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081165:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5496a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081172:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5496a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081178:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5496a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081184:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986601.081188:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5496a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081196:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5496a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081207:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:1.0:1788986601.081210:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986601.081215:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5496a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081222:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf5496a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081237:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5496b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081243:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5496b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081249:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5496b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081254:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986601.081258:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5496b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081264:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5496b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081271:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a45316c00) 00010000:00010000:1.0:1788986601.081274:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986601.081277:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5496b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081283:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf5496b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081313:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5496a2 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d142c expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081323:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:1.0:1788986601.081325:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986601.081330:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5496a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d142c expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986601.081339:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788986601.081399:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53111:x1875885971366656:12345-192.168.206.21@tcp:101:touch.0 Request processed in 457us (2475us total) trans 0 rc 301/301 00000100:00100000:1.0:1788986601.081406:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 973 00000100:00100000:3.0:1788986601.087940:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986601.088032:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971366784 00000100:00100000:2.0:1788986601.088042:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971366784 00000100:00100000:2.0:1788986601.088136:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 974 00000100:00100000:2.0:1788986601.088147:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53111:x1875885971366784:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986601.088177:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986601.088196:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5496b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1433 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088256:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5496be lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088270:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5496be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088280:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5496be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088299:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5496c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088307:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5496c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088314:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5496c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088332:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5496be lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088340:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5496be lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088347:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5496be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088353:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986601.088357:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5496be lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088365:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5496be lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088375:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:2.0:1788986601.088378:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986601.088383:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5496be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088389:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf5496be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088402:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5496c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088408:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5496c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088413:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5496c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088418:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986601.088421:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5496c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088426:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5496c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088433:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a45acac00) 00010000:00010000:2.0:1788986601.088435:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986601.088438:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5496c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088443:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf5496c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088471:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5496b7 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1433 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088481:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:2.0:1788986601.088483:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986601.088487:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5496b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1433 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986601.088495:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0200, rc 0) 00000100:00100000:2.0:1788986601.088566:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53111:x1875885971366784:12345-192.168.206.21@tcp:101:touch.0 Request processed in 415us (628us total) trans 0 rc 301/301 00000100:00100000:2.0:1788986601.088573:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 974 00010000:00010000:2.0:1788986601.408372:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986601.474630:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993573376:0@lo:400:kworker.0 00000100:00100000:1.0:1788986601.474726:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986601.474815:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788986601.474823:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993572992:0@lo:400:kworker.0 00000100:00100000:1.0:1788986601.474870:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986601.474893:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993573504:0@lo:400:kworker.0 00000100:00100000:1.0:1788986601.474918:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986601.474951:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993573376 00000100:00100000:3.0:1788986601.475077:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993573120:0@lo:400:kworker.0 00000100:00100000:3.0:1788986601.475146:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986601.475166:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993573632:0@lo:400:kworker.0 00000100:00100000:3.0:1788986601.475188:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986601.475204:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986601.475208:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993573248:0@lo:400:kworker.0 00000100:00100000:3.0:1788986601.475228:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986601.475268:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993572992 00000100:00100000:3.0:1788986601.475275:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993572992 00000100:00100000:3.0:1788986601.475325:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:3.0:1788986601.475334:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993572992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986601.475402:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993572992:12345-0@lo:400:kworker.0 Request processed in 68us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986601.475409:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:3.0:1788986601.475445:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993573504 00000100:00100000:3.0:1788986601.475450:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993573504 00000100:00100000:3.0:1788986601.475495:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993573120 00000100:00100000:3.0:1788986601.475498:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993573120 00000100:00100000:3.0:1788986601.475520:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993573248 00000100:00100000:3.0:1788986601.475523:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993573248 00000100:00100000:3.0:1788986601.475544:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1692 00000100:00100000:3.0:1788986601.475549:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993573504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986601.475583:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993573504:12345-0@lo:400:kworker.0 Request processed in 34us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986601.475589:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1692 00000100:00100000:3.0:1788986601.475602:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1693 00000100:00100000:3.0:1788986601.475608:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993573120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986601.475643:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993573120:12345-0@lo:400:kworker.0 Request processed in 34us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986601.475648:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1693 00000100:00100000:3.0:1788986601.475660:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1694 00000100:00100000:3.0:1788986601.475667:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993573248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986601.475700:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993573248:12345-0@lo:400:kworker.0 Request processed in 33us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986601.475705:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1694 00000100:00100000:3.0:1788986601.475727:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993573632 00000100:00100000:3.0:1788986601.475730:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993573632 00000100:00100000:3.0:1788986601.475760:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1255 00000100:00100000:3.0:1788986601.475773:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a76789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993573632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986601.475806:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a76789850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993573632:12345-0@lo:400:kworker.0 Request processed in 34us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986601.475812:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1255 00000100:00080000:3.0:1788986601.475837:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986601.475842:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986601.475888:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993573248:0@lo:400:kworker.0 00000100:00100000:3.0:1788986601.475900:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993573120:0@lo:400:kworker.0 00000100:00100000:3.0:1788986601.475910:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993573632:0@lo:400:kworker.0 00000100:00100000:3.0:1788986601.475942:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993572992:0@lo:400:kworker.0 00000100:00100000:3.0:1788986601.475952:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993573504:0@lo:400:kworker.0 00000100:00100000:1.0:1788986601.476290:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993573376 00000100:00100000:1.0:1788986601.476332:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1256 00000100:00100000:1.0:1788986601.476339:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993573376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986601.476434:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993573376:12345-0@lo:400:kworker.0 Request processed in 96us (1708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986601.476440:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1256 00000100:00100000:3.0:1788986601.476897:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993573376:0@lo:400:kworker.0 00000100:00100000:0.0:1788986601.984415:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986601.984446:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993573760:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986601.984539:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986601.984662:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993573760 00000100:00100000:1.0:1788986601.984673:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993573760 00000100:00100000:1.0:1788986601.984738:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1788986601.984750:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993573760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986601.984800:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986601.984861:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993573760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986601.984870:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1788986601.987345:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993573760:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986602.435806:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986602.941881:0:90323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda81db450 20000000:00000080:3.0:1788986602.941897:0:90323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a60c8ec00 uarg=0000000000000000 00010000:00010000:3.0:1788986602.942251:0:90323:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788986602.942283:0:90323:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:3.0:1788986602.942287:0:90323:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986602.942298:0:90323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549686 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d141e expref: 5 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986602.942321:0:90323:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1788986602.942336:0:90323:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986602.942744:0:90323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986602.942759:0:90323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54966a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549663 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986602.942767:0:90323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986602.942803:0:90323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54966a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549663 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986602.942818:0:90323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54966a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549663 expref: 18 pid: 5848 timeout: 2486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986602.942837:0:90323:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90323:1875885993573888:0@lo:104: 00000100:00100000:3.0:1788986602.942895:0:90323:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986602.943008:0:90323:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0942afe9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986602.954215:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993573888 00000100:00100000:1.0:1788986602.954229:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993573888 00000100:00100000:2.0:1788986602.955280:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788986602.955290:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:90323:x1875885993573888:12345-0@lo:104: 00010000:00010000:2.0:1788986602.955308:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54966a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955404:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986602.955411:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:90323:x1875885993573888:12345-0@lo:104: Request processed in 123us (12516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986602.955417:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00010000:00010000:2.0:1788986602.955438:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986602.955443:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54966a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955450:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986602.955454:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54966a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955462:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54966a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986602.955469:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54966a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986602.955475:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986602.955512:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54966a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955518:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986602.955541:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54966a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955548:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0e00/0xc20d828fcf549663 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54966a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955564:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986602.955565:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986602.955567:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986602.955588:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993574016:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986602.955624:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986602.955684:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993574016 00000100:00100000:2.0:1788986602.955689:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993574016 00010000:00010000:2.0:1788986602.955709:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54966a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549663 expref: 19 pid: 5848 timeout: 2486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986602.955728:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1788986602.955735:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993574016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986602.955745:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986602.955750:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54966a lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549663 expref: 19 pid: 5848 timeout: 2486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955760:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54966a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549663 expref: 19 pid: 5848 timeout: 2486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955777:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955786:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955800:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955806:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955812:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955819:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955825:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986602.955828:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955835:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955843:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986602.955851:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986602.955879:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993574016:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986602.955889:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00000100:00100000:2.0:1788986602.955927:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993574016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986602.956808:0:90323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54966a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549663 expref: 18 pid: 5848 timeout: 2486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986602.956824:0:90323:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90323:1875885993573888:0@lo:104: 00010000:00010000:0.0:1788986602.956842:0:90323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986602.956851:0:90323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986602.956857:0:90323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986602.956863:0:90323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf5496cc lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986603.457211:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986603.635358:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986603.635396:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986603.635424:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986603.635452:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971366912 00000100:00100000:2.0:1788986603.635461:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971366912 00000100:00100000:2.0:1788986603.635504:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1325 00000100:00100000:2.0:1788986603.635513:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971366912:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986603.635571:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971366912:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 59us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986603.635578:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1325 00000100:00100000:2.0:1788986603.635607:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971367168 00000100:00100000:2.0:1788986603.635611:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971367168 00000100:00100000:2.0:1788986603.635647:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1257 00000100:00100000:2.0:1788986603.635655:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971367168:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986603.635682:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971367168:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986603.635688:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1257 00000100:00080000:2.0:1788986603.635810:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986603.636131:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971367040 00000100:00100000:1.0:1788986603.636138:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971367040 00000100:00100000:1.0:1788986603.636193:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1695 00000100:00100000:1.0:1788986603.636201:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971367040:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986603.636240:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971367040:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986603.636246:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1695 00000100:00080000:2.0:1788986603.637269:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1788986604.353291:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986604.353298:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986604.353303:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986604.353342:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986604.353354:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986604.353364:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986604.353387:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993574144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986604.353522:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986604.354816:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0942afe840 going to sleep for 11 seconds 00000100:00100000:3.0:1788986604.354846:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993574144 00000100:00100000:3.0:1788986604.354854:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993574144 00000100:00100000:3.0:1788986604.354908:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1788986604.354917:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993574144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986604.354930:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986604.354945:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5496da lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5496d3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986604.354971:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5496da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5496d3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986604.354985:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5496da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5496d3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986604.354993:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2600, rc 0) 00000100:00100000:3.0:1788986604.355047:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993574144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986604.355053:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1326 00000100:00100000:3.0:1788986604.355131:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993574144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986604.355147:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5496da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986604.355155:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5496da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986604.355174:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986604.355179:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5496da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986604.355186:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5496da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986604.480370:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986605.504259:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986605.571923:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986605.571944:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993574272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986605.572005:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986605.572076:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993574272 00000100:00100000:2.0:1788986605.572083:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993574272 00000100:00100000:2.0:1788986605.572153:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:2.0:1788986605.572162:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993574272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986605.572194:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986605.572240:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993574272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986605.572246:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00080000:2.0:1788986605.572266:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986605.572300:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993574272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986605.827915:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986605.828017:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971367296 00000100:00100000:3.0:1788986605.828026:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971367296 00000100:00100000:3.0:1788986605.828132:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 975 00000100:00100000:3.0:1788986605.828145:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53197:x1875885971367296:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986605.828163:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986605.828185:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5496e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d143a expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986605.828245:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5496e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986605.828258:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5496e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986605.828270:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5496e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986605.828302:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:3.0:1788986605.828306:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986605.828324:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5496e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986605.828349:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf5496e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d143a expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986605.828371:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5496e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d143a expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986605.828379:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:3.0:1788986605.828382:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986605.828387:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3c00, rc 0) 00000100:00100000:3.0:1788986605.828437:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53197:x1875885971367296:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 296us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986605.828443:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 975 00000100:00080000:2.0:1788986605.828595:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986605.849644:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986605.849723:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971367552 00000100:00100000:2.0:1788986605.849733:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971367552 00000100:00100000:2.0:1788986605.849816:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 976 00000100:00100000:2.0:1788986605.849826:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53197:x1875885971367552:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986605.849874:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986605.849899:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5496e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d143a expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986605.849918:0:7899:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf549686) 00010000:00010000:2.0:1788986605.849923:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745d00) 00010000:00010000:2.0:1788986605.849933:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986605.849967:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5496ef lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986605.849979:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5496ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986605.849993:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5496ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986605.850416:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e340337a reply state 00000000a7ddb2ad transno 4294967667 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5496ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986605.850427:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986605.850435:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000100:00100000:2.0:1788986605.850512:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53197:x1875885971367552:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 687us (983us total) trans 4294967667 rc 0/0 00000100:00100000:2.0:1788986605.850519:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 976 00010000:00010000:1.0:1788986605.856289:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5496ef lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986605.856306:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5496ef lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986605.856314:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5496ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986605.856320:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986605.856325:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5496ef lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986605.856332:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5496ef lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986605.856348:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:1.0:1788986605.856351:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986605.856355:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5496ef lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986605.856361:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5496ef lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986606.528288:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986606.596863:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993574400:0@lo:400:kworker.0 00000100:00100000:3.0:1788986606.596948:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986606.597118:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993574400 00000100:00100000:0.0:1788986606.597127:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993574400 00000100:00100000:0.0:1788986606.597177:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1327 00000100:00100000:0.0:1788986606.597186:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993574400:12345-0@lo:400:kworker.0 00000020:00000080:1.0:1788986606.598767:0:90520:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdae492210 20000000:00000080:1.0:1788986606.598790:0:90520:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a49822800 uarg=0000000000000000 00010000:00010000:1.0:1788986606.599712:0:90520:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788986606.599729:0:90520:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788986606.599743:0:90520:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986606.599759:0:90520:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986606.599775:0:90520:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5496da lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5496d3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986606.599783:0:90520:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986606.599817:0:90520:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5496da lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5496d3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986606.599830:0:90520:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5496da lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5496d3 expref: 19 pid: 5846 timeout: 2490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986606.599843:0:90520:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90520:1875885993574656:0@lo:104: 00000100:00100000:1.0:1788986606.599894:0:90520:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986606.599936:0:90520:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7feff180 going to sleep for 11 seconds 00000100:00100000:2.0:1788986606.600319:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993574528:0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.600351:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986606.600378:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993575168:0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.600400:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986606.600423:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986606.600428:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993575040:0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.600448:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986606.600476:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993574656 00000100:00100000:2.0:1788986606.600481:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993574656 00000100:00100000:2.0:1788986606.600516:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788986606.600524:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:90520:x1875885993574656:12345-0@lo:104: 00010000:00010000:2.0:1788986606.600537:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5496da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.600580:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986606.600585:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:90520:x1875885993574656:12345-0@lo:104: Request processed in 62us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986606.600592:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788986606.600613:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993574784:0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.600633:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986606.600654:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986606.600659:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993574912:0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.600679:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986606.600708:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993574528 00000100:00100000:2.0:1788986606.600712:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993574528 00000100:00100000:2.0:1788986606.600734:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993575040 00000100:00100000:2.0:1788986606.600737:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993575040 00000100:00100000:2.0:1788986606.600758:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993574784 00000100:00100000:2.0:1788986606.600761:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993574784 00000100:00100000:2.0:1788986606.600773:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1696 00000100:00100000:2.0:1788986606.600779:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993574528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.600827:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993574528:12345-0@lo:400:kworker.0 Request processed in 48us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986606.600833:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1696 00000100:00100000:2.0:1788986606.600844:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1697 00000100:00100000:2.0:1788986606.600850:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993575040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.600874:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993575040:12345-0@lo:400:kworker.0 Request processed in 25us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986606.600879:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1697 00000100:00100000:2.0:1788986606.600889:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1698 00000100:00100000:2.0:1788986606.600894:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993574784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.600932:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993574784:12345-0@lo:400:kworker.0 Request processed in 26us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986606.600941:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1698 00000100:00100000:2.0:1788986606.600959:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993575168 00000100:00100000:2.0:1788986606.600963:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993575168 00000100:00100000:2.0:1788986606.600987:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993574912 00000100:00100000:2.0:1788986606.600990:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993574912 00000100:00100000:2.0:1788986606.601006:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1788986606.601012:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993575168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.601042:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993575168:12345-0@lo:400:kworker.0 Request processed in 30us (640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986606.601047:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1258 00000100:00100000:2.0:1788986606.601057:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1259 00000100:00100000:2.0:1788986606.601074:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993574912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.601129:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993574912:12345-0@lo:400:kworker.0 Request processed in 66us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986606.601134:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1259 00010000:00010000:2.0:1788986606.601153:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986606.601159:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5496da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601167:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986606.601171:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5496da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601180:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5496da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986606.601187:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5496da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986606.601193:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986606.601218:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5496da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601225:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986606.601235:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5496da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601242:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2c00/0xc20d828fcf5496d3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5496da expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601256:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986606.601257:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986606.601259:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788986606.601273:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986606.601277:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986606.601305:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993575040:0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.601315:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993574528:0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.601324:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993575168:0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.601348:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993575296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986606.601371:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986606.601403:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993574912:0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.601412:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993574784:0@lo:400:kworker.0 00000100:00100000:2.0:1788986606.601444:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993575296 00000100:00100000:2.0:1788986606.601448:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993575296 00010000:00010000:2.0:1788986606.601465:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5496da lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5496d3 expref: 20 pid: 5846 timeout: 2490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986606.601486:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1788986606.601492:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+20:3320:x1875885993575296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986606.601501:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986606.601505:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5496da lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5496d3 expref: 20 pid: 5846 timeout: 2490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601515:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5496da lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5496d3 expref: 20 pid: 5846 timeout: 2490 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601531:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601539:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601553:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601559:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601565:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601570:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601575:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986606.601579:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601586:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601594:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986606.601604:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986606.601631:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+20:3320:x1875885993575296:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986606.601638:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1788986606.601664:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993575296:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986606.601941:0:90520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf5496da lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5496d3 expref: 19 pid: 5846 timeout: 2490 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986606.601954:0:90520:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:90520:1875885993574656:0@lo:104: 00010000:00010000:1.0:1788986606.601969:0:90520:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986606.601983:0:90520:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986606.601988:0:90520:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986606.601994:0:90520:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf5496f6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 90520 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986606.603728:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993574400:12345-0@lo:400:kworker.0 Request processed in 6537us (6775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986606.603740:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1327 00000100:00100000:3.0:1788986606.604632:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993574400:0@lo:400:kworker.0 00000100:00100000:2.0:1788986607.104322:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993575424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986607.104388:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986607.104555:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993575424 00000100:00100000:3.0:1788986607.104564:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993575424 00000100:00100000:3.0:1788986607.104619:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 861 00000100:00100000:3.0:1788986607.104629:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993575424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986607.104661:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986607.104709:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993575424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986607.104716:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 861 00000100:00100000:2.0:1788986607.104802:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993575424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986607.554854:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986608.216129:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967667 is committed 10000000:01000000:0.0:1788986608.320668:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986608.320678:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986608.320685:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986608.320745:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986608.320758:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986608.320773:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986608.320804:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993575552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986608.320895:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986608.321018:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51df2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788986608.322692:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993575552 00000100:00100000:3.0:1788986608.322720:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993575552 00000100:00100000:3.0:1788986608.322803:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:3.0:1788986608.322815:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993575552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986608.322833:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986608.322855:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549704 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5496fd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986608.322892:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549704 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5496fd expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986608.322904:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549704 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5496fd expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986608.322914:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788986608.323047:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993575552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 234us (2153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986608.323067:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1788986608.323369:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993575552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986608.323392:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549704 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986608.323402:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549704 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986608.323444:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986608.323450:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549704 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986608.323471:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549704 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986608.577308:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986608.753859:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986608.754044:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986608.754257:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971367680 00000100:00100000:0.0:1788986608.754271:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971367680 00000100:00100000:0.0:1788986608.754338:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1329 00000100:00100000:0.0:1788986608.754351:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971367680:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986608.754452:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971367680:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 102us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986608.754460:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1329 00000100:00100000:2.0:1788986608.755176:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971367808 00000100:00100000:2.0:1788986608.755184:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971367808 00000100:00100000:2.0:1788986608.755260:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1699 00000100:00100000:2.0:1788986608.755270:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971367808:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986608.755337:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971367808:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (1495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986608.755343:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1699 00000100:00080000:0.0:1788986608.755514:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986608.764010:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986608.764242:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971367936 00000100:00100000:2.0:1788986608.764256:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971367936 00000100:00100000:2.0:1788986608.764356:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1260 00000100:00100000:2.0:1788986608.764368:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971367936:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986608.764470:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971367936:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 103us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986608.764479:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1260 00000100:00080000:0.0:1788986608.765415:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986609.604644:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986609.649874:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986609.649977:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971368064 00000100:00100000:2.0:1788986609.649987:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971368064 00000100:00100000:2.0:1788986609.650058:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 977 00000100:00100000:2.0:1788986609.650069:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53282:x1875885971368064:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986609.650254:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53282:x1875885971368064:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 184us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986609.650267:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 977 00000100:00100000:1.0:1788986609.652376:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986609.652461:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971368192 00000100:00100000:2.0:1788986609.652469:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971368192 00000100:00100000:2.0:1788986609.652529:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 528 00000100:00100000:2.0:1788986609.652540:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53282:x1875885971368192:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986609.653214:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53282:x1875885971368192:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 674us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986609.653224:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 528 00000100:00100000:1.0:1788986609.657741:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986609.657901:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971368320 00000100:00100000:2.0:1788986609.657919:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971368320 00000100:00100000:2.0:1788986609.657967:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 529 00000100:00100000:2.0:1788986609.657975:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875885971368320:12345-192.168.206.21@tcp:8:lfs.0 00010000:00080000:2.0:1788986609.658007:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 2393 last 0 00000020:00000080:2.0:1788986609.658038:0:6697:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf54970b 00002000:00100000:2.0:1788986609.658067:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b094195c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 6815744 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788986609.658131:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788986609.658347:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788986609.658375:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b094195f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788986609.658467:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971368320:12345-192.168.206.21@tcp:8:lfs.0 Request processed in 489us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986609.658475:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 529 00000100:00100000:1.0:1788986609.662633:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986609.663910:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971368448 00000100:00100000:2.0:1788986609.663922:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971368448 00000100:00080000:0.0:1788986609.664069:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986609.664192:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 530 00000100:00100000:2.0:1788986609.664203:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53282:x1875885971368448:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986609.664543:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53282:x1875885971368448:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 340us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986609.664551:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 530 00000100:00100000:1.0:1788986609.669886:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986609.670289:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971368576 00000100:00100000:2.0:1788986609.670299:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971368576 00000100:00100000:2.0:1788986609.670357:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 978 00000100:00100000:2.0:1788986609.670366:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53282:x1875885971368576:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986609.670806:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53282:x1875885971368576:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 440us (928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986609.670814:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 978 00000100:00100000:3.0:1788986609.674375:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986609.674477:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971368704 00000100:00100000:2.0:1788986609.674486:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971368704 00000100:00100000:2.0:1788986609.674540:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 979 00000100:00100000:2.0:1788986609.674550:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53282:x1875885971368704:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986609.674647:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53282:x1875885971368704:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 97us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986609.674654:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 979 00000100:00100000:1.0:1788986609.679905:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986609.680123:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971368832 00000100:00100000:3.0:1788986609.680134:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971368832 00000100:00100000:2.0:1788986609.680259:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 531 00000100:00100000:2.0:1788986609.680271:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53282:x1875885971368832:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986609.680651:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53282:x1875885971368832:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 382us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986609.680658:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 531 00000100:00100000:1.0:1788986609.684293:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986609.684666:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971368960 00000100:00100000:2.0:1788986609.684674:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971368960 00000100:00100000:2.0:1788986609.685354:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 532 00000100:00100000:2.0:1788986609.685365:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53282:x1875885971368960:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986609.686364:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53282:x1875885971368960:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 998us (2076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986609.686374:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 532 00000100:00100000:3.0:1788986609.689167:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986609.690150:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971369088 00000100:00100000:0.0:1788986609.690161:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971369088 00000100:00100000:0.0:1788986609.690259:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 980 00000100:00100000:0.0:1788986609.690274:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53282:x1875885971369088:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986609.690681:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53282:x1875885971369088:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 413us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986609.690689:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 980 00000100:00100000:1.0:1788986609.749693:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986609.749789:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971369216 00000100:00100000:2.0:1788986609.749798:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971369216 00000100:00100000:2.0:1788986609.749854:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 981 00000100:00100000:2.0:1788986609.749864:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53286:x1875885971369216:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788986609.749883:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986609.749905:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549712 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1441 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.749967:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549719 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.749980:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549719 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.749993:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549719 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.750008:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549720 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.750014:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549720 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.750020:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549720 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.750337:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549727 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.750346:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.750357:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986609.750378:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:2.0:1788986609.750381:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986609.750398:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549727 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.750410:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549719 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.750416:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549719 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.750423:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549719 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752803:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986609.752817:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549719 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752830:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549719 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752845:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:2.0:1788986609.752848:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986609.752853:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549719 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752860:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549719 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752882:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549720 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752889:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549720 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752896:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549720 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752901:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986609.752904:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549720 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752909:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549720 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752917:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986609.752920:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986609.752923:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549720 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752929:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf549720 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752973:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549712 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1441 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.752991:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549727 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1441 expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.753003:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986609.753005:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986609.753008:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788986609.753105:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53286:x1875885971369216:12345-192.168.206.21@tcp:101:dd.0 Request processed in 3227us (3404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986609.753114:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 981 00000100:00100000:1.0:1788986609.756392:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986609.756536:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971369472 00000100:00100000:3.0:1788986609.756545:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971369472 00000100:00100000:3.0:1788986609.756596:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 982 00000100:00100000:3.0:1788986609.756604:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53286:x1875885971369472:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:3.0:1788986609.756621:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986609.756638:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54972e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1448 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.756887:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549735 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.756901:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.756911:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.756941:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54973c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.756948:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54973c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.756955:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54973c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788986609.758033:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x1f:0x0], index 1: 0 00010000:00010000:3.0:1788986609.758802:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549743 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.758818:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.758827:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549743 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.758860:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549735 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.758868:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549735 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.758877:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.758883:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986609.758888:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549735 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.758896:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549735 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.758906:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:3.0:1788986609.758909:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986609.759171:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549735 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986609.759179:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549735 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986609.759193:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001600faf2 reply state 00000000cb25c782 transno 4294967668 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54973c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986609.759201:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986609.762698:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54972e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1448 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.762723:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549743 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1448 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.762731:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:2.0:1788986609.762733:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986609.762736:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3800, rc 0) 00000100:00100000:2.0:1788986609.762857:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:53286:x1875885971369472:12345-192.168.206.21@tcp:101:dd.0 Request processed in 6252us (6472us total) trans 4294967668 rc 0/0 00000100:00100000:2.0:1788986609.762866:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 982 00010000:00010000:0.0:1788986609.766727:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54973c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986609.766745:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54973c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986609.766753:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54973c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986609.766759:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986609.766850:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54973c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986609.766860:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54973c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986609.766876:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a55745700) 00010000:00010000:0.0:1788986609.766879:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986609.766884:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54973c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986609.766895:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54973c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986609.774870:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986609.774942:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971369600 00000100:00100000:2.0:1788986609.774951:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971369600 00000100:00100000:2.0:1788986609.775007:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 533 00000100:00100000:2.0:1788986609.775017:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53286:x1875885971369600:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788986609.775033:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986609.775062:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf549751 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d144f expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788986609.775121:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788986609.775142:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=2393s v=(0 0) 00010000:00010000:2.0:1788986609.775146:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986609.775157:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf549751 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d144f expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.775175:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf549751 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d144f expref: 7 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986609.775188:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788986609.775245:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53286:x1875885971369600:12345-192.168.206.21@tcp:101:dd.0 Request processed in 229us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986609.775252:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 533 00000100:00100000:3.0:1788986609.808848:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986609.809069:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971369728 00000100:00100000:2.0:1788986609.809079:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971369728 00002000:00100000:2.0:1788986609.809161:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1f:0x0] (0->1048575) req@ffff9b094247ed80 x1875885971369728/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:530/0 lens 488/0 e 0 to 0 dl 1788986620 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788986609.809171:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b094247ed80 with x1875885971369728 ext(0->1048575) 00002000:00010000:2.0:1788986609.809176:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b094247ed80 00000100:00100000:2.0:1788986609.809199:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:2.0:1788986609.809208:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971369728:12345-192.168.206.21@tcp:4:dd.0 00000001:00100000:0.0:1788986609.898120:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:2.0:1788986609.901890:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971369728:12345-192.168.206.21@tcp:4:dd.0 Request processed in 92673us (93040us total) trans 4294967358 rc 0/0 00000100:00100000:2.0:1788986609.901904:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00002000:00100000:2.0:1788986609.901919:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1f:0x0] (0->1048575) req@ffff9b094247ed80 x1875885971369728/t4294967358(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:530/0 lens 488/448 e 0 to 0 dl 1788986620 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788986609.901929:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b094247ed80 with x1875885971369728 ext(0->1048575) 00002000:00010000:2.0:1788986609.901936:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b094247ed80 00000100:00100000:1.0:1788986609.911020:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986609.911124:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971369856 00000100:00100000:0.0:1788986609.911133:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971369856 00000100:00100000:0.0:1788986609.911190:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 983 00000100:00100000:0.0:1788986609.911201:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:53286:x1875885971369856:12345-192.168.206.21@tcp:44:dd.0 00000001:00080000:0.0:1788986610.008746:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967668 is committed 00000100:00100000:1.0:1788986610.009124:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53286:x1875885971369856:12345-192.168.206.21@tcp:44:dd.0 Request processed in 97917us (98105us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986610.009138:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 983 00000100:00100000:1.0:1788986610.017214:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986610.017412:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971369984 00000100:00100000:2.0:1788986610.017426:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971369984 00000100:00100000:2.0:1788986610.017492:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 534 00000100:00100000:2.0:1788986610.017504:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971369984:12345-192.168.206.21@tcp:16:dd.0 00000001:00080000:2.0:1788986610.108039:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967358 is committed 00000100:00100000:1.0:1788986610.108399:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971369984:12345-192.168.206.21@tcp:16:dd.0 Request processed in 90892us (91195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986610.108410:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 534 00000100:00100000:2.0:1788986610.114607:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986610.114722:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971370240 00000100:00100000:1.0:1788986610.114731:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971370240 00000100:00100000:1.0:1788986610.114798:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 97 00000100:00100000:1.0:1788986610.114809:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53286:x1875885971370240:12345-192.168.206.21@tcp:35:dd.0 00000100:00100000:1.0:1788986610.115463:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:53286:x1875885971370240:12345-192.168.206.21@tcp:35:dd.0 Request processed in 653us (862us total) trans 4294967669 rc 0/0 00000100:00100000:1.0:1788986610.115471:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 97 00000100:00080000:0.0:1788986610.115603:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986610.626336:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986610.690414:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986610.690436:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993575680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986610.690501:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986610.690564:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993575680 00000100:00100000:1.0:1788986610.690572:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993575680 00000100:00100000:1.0:1788986610.690629:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:1.0:1788986610.690638:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993575680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986610.690669:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986610.690711:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993575680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986610.690719:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:1.0:1788986610.690764:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993575680:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986610.690794:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1788986611.435784:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967669 is committed 00010000:00010000:3.0:1788986611.649468:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986611.712574:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993576064:0@lo:400:kworker.0 00000100:00100000:1.0:1788986611.712665:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986611.712743:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788986611.712750:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993575936:0@lo:400:kworker.0 00000100:00100000:1.0:1788986611.712773:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986611.712792:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993576448:0@lo:400:kworker.0 00000100:00100000:1.0:1788986611.712816:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986611.712850:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993576064 00000100:00100000:1.0:1788986611.712858:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993576064 00000100:00100000:1.0:1788986611.712930:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993575936 00000100:00100000:1.0:1788986611.712934:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993575936 00000100:00100000:1.0:1788986611.712961:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1700 00000100:00100000:1.0:1788986611.712971:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993576064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986611.713028:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993576064:12345-0@lo:400:kworker.0 Request processed in 58us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986611.713047:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1700 00000100:00100000:1.0:1788986611.713067:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1701 00000100:00100000:1.0:1788986611.713073:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993575936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986611.713152:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993575936:12345-0@lo:400:kworker.0 Request processed in 79us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986611.713158:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1701 00000100:00100000:1.0:1788986611.713181:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993576448 00000100:00100000:1.0:1788986611.713185:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993576448 00000100:00100000:1.0:1788986611.713219:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1261 00000100:00100000:1.0:1788986611.713225:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993576448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986611.713256:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993576448:12345-0@lo:400:kworker.0 Request processed in 31us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986611.713262:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1261 00000100:00080000:1.0:1788986611.713279:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986611.713284:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986611.713305:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993576192:0@lo:400:kworker.0 00000100:00100000:1.0:1788986611.713326:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993575936:0@lo:400:kworker.0 00000100:00100000:1.0:1788986611.713337:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993576448:0@lo:400:kworker.0 00000100:00100000:3.0:1788986611.713339:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986611.713348:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993576064:0@lo:400:kworker.0 00000100:00100000:3.0:1788986611.713366:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788986611.713372:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993575808:0@lo:400:kworker.0 00000100:00100000:3.0:1788986611.713403:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986611.713432:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993576320:0@lo:400:kworker.0 00000100:00100000:3.0:1788986611.713456:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986611.713495:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993576192 00000100:00100000:3.0:1788986611.713499:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993576192 00000100:00100000:3.0:1788986611.713528:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1788986611.713534:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993576192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986611.713570:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993576192:12345-0@lo:400:kworker.0 Request processed in 36us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986611.713576:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1262 00000100:00100000:3.0:1788986611.713609:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993576192:0@lo:400:kworker.0 00000100:00100000:1.0:1788986611.714193:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993575808 00000100:00100000:1.0:1788986611.714199:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993575808 00000100:00100000:1.0:1788986611.714277:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1330 00000100:00100000:1.0:1788986611.714285:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993575808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986611.714340:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993575808:12345-0@lo:400:kworker.0 Request processed in 56us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986611.714347:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1330 00000100:00100000:3.0:1788986611.714393:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993575808:0@lo:400:kworker.0 00000100:00100000:2.0:1788986611.722783:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993576320 00000100:00100000:2.0:1788986611.722806:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993576320 00000100:00100000:2.0:1788986611.722936:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1702 00000100:00100000:2.0:1788986611.722949:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993576320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986611.723127:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993576320:12345-0@lo:400:kworker.0 Request processed in 182us (9670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986611.723134:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1702 00000100:00100000:2.0:1788986611.723197:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993576320:0@lo:400:kworker.0 00000100:00080000:3.0:1788986611.723253:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986612.227652:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993576576:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986612.227741:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986612.227856:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993576576 00000100:00100000:1.0:1788986612.227866:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993576576 00000100:00100000:1.0:1788986612.227932:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:1.0:1788986612.227943:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993576576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986612.227986:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788986612.228054:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993576576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986612.228062:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:1.0:1788986612.228134:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993576576:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788986612.511900:0:90766:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2396414806312ns, next at 2377251122954ns, rc = 0 00000004:00080000:1.0:1788986612.512132:0:90766:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2396415042167ns, next at 2304968076411ns, rc = 0 00000004:00080000:2.0:1788986612.515527:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 84 committed 00000004:00080000:2.0:1788986612.515559:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 84 committed 00010000:00010000:2.0:1788986612.673291:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986613.696231:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986613.754608:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986613.754812:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971370368 00000100:00100000:3.0:1788986613.754823:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971370368 00000100:00100000:3.0:1788986613.754921:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 984 00000100:00100000:3.0:1788986613.754934:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53478:x1875885971370368:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986613.755069:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53478:x1875885971370368:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 137us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986613.755078:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 984 00000100:00080000:1.0:1788986613.755355:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986613.757920:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986613.762648:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971370496 00000100:00100000:1.0:1788986613.762667:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971370496 00000100:00100000:1.0:1788986613.763259:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 535 00000100:00100000:1.0:1788986613.763272:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53478:x1875885971370496:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986613.763749:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53478:x1875885971370496:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 478us (5837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986613.763758:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 535 00000100:00100000:1.0:1788986613.769208:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986613.769259:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971370624 00000100:00100000:1.0:1788986613.769271:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971370624 00000100:00100000:1.0:1788986613.769341:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 536 00000100:00100000:1.0:1788986613.769353:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53478:x1875885971370624:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986613.769879:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53478:x1875885971370624:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 527us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986613.769888:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 536 00000100:00100000:1.0:1788986613.775420:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986613.775478:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971370752 00000100:00100000:1.0:1788986613.775489:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971370752 00000100:00100000:1.0:1788986613.775552:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 985 00000100:00100000:1.0:1788986613.775563:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53478:x1875885971370752:12345-192.168.206.21@tcp:48:lfs.0 00000100:00080000:0.0:1788986613.776206:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986613.776214:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986613.777847:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53478:x1875885971370752:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 2261us (2416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986613.777862:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 985 00000100:00100000:1.0:1788986613.787606:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986613.787697:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971370880 00000100:00100000:3.0:1788986613.787788:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971370880 00000100:00100000:3.0:1788986613.789371:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 986 00000100:00100000:3.0:1788986613.789391:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53478:x1875885971370880:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986613.789522:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53478:x1875885971370880:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 138us (1930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986613.789530:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 986 00000100:00100000:1.0:1788986613.795233:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986613.795309:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971371008 00000100:00100000:0.0:1788986613.795321:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971371008 00000100:00100000:0.0:1788986613.795386:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 537 00000100:00100000:0.0:1788986613.795397:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53478:x1875885971371008:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986613.795843:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53478:x1875885971371008:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 446us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986613.795852:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 537 00000100:00100000:2.0:1788986613.800386:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986613.800489:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971371136 00000100:00100000:1.0:1788986613.800502:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971371136 00000100:00100000:1.0:1788986613.800572:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 538 00000100:00100000:1.0:1788986613.800583:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53478:x1875885971371136:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986613.801082:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53478:x1875885971371136:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 499us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986613.801114:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 538 00000100:00100000:3.0:1788986613.803405:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986613.803655:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971371264 00000100:00100000:0.0:1788986613.803665:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971371264 00000100:00100000:0.0:1788986613.803995:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 987 00000100:00100000:0.0:1788986613.804010:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53478:x1875885971371264:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986613.804707:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53478:x1875885971371264:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 698us (1309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986613.804721:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 987 00000100:00100000:3.0:1788986613.862513:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986613.862772:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971371520 00000100:00100000:1.0:1788986613.862785:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971371520 00000100:00100000:1.0:1788986613.862892:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 988 00000100:00100000:1.0:1788986613.862905:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:53482:x1875885971371520:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788986613.862972:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986613.863008:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549743 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x51:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1448 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.863047:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:1.0:1788986613.863138:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986613.863168:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549758 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.863186:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549758 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.863197:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549758 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.863213:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54975f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.863236:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54975f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.863244:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54975f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.864073:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549766 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.864358:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.864369:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986613.873335:0:15241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].31, 64 off10176 00000004:00080000:1.0:1788986613.873353:0:15241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2397776263356ns, next at 2398776258696ns, rc = 0 00010000:00010000:1.0:1788986613.874072:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54976d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x51:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874119:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54976d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874133:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54976d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874144:0:15241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54976d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874156:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54976d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874162:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54976d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874195:0:15241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986613.874229:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549766 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874237:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549766 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874249:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549766 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874255:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986613.874260:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549766 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874269:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549766 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874284:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9b0a45316500) 00010000:00010000:1.0:1788986613.874287:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986613.874293:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549766 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874299:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549766 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x51:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874324:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549758 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874330:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549758 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874336:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549758 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874341:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986613.874344:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549758 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874349:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549758 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874356:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:1.0:1788986613.874359:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986613.874362:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549758 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.874366:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549758 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986613.874378:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000128ead03 reply state 000000000fcaa0fb transno 4294967670 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54975f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986613.874387:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788986613.874390:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986613.874400:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54976d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986613.874408:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986613.874411:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54976d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986613.874419:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54976d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x51:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986613.874441:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x51:0x0].0x0 (ffff9b0a45316500) 00010000:00010000:3.0:1788986613.874444:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986613.874447:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54976d lrc: 1/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986613.874454:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54976d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x51:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986613.874486:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986613.874489:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986613.874491:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986613.874726:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:53482:x1875885971371520:12345-192.168.206.21@tcp:36:rm.0 Request processed in 11818us (12222us total) trans 4294967670 rc 0/0 00000100:00100000:1.0:1788986613.874737:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 988 00000100:00100000:2.0:1788986613.876417:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986613.881814:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971371648 00000100:00100000:3.0:1788986613.881834:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971371648 00000100:00100000:3.0:1788986613.882052:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1331 00000100:00100000:3.0:1788986613.882067:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971371648:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986613.882190:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971371648:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 126us (5782us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986613.882200:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1331 00010000:00010000:1.0:1788986613.882238:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54975f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.882253:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54975f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.882263:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54975f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.882270:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986613.882277:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54975f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.882287:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54975f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.882307:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a45316700) 00010000:00010000:1.0:1788986613.882311:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986613.882317:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54975f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986613.882324:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54975f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986614.721036:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986615.744580:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986615.809225:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993576704:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986615.809408:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986615.810382:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993576704 00000100:00100000:3.0:1788986615.810393:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993576704 00000100:00100000:3.0:1788986615.810539:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1788986615.810550:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993576704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986615.810583:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986615.810646:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993576704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986615.810653:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1788986615.810703:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993576704:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986615.812239:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:1.0:1788986615.871678:0:90911:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2399774585874ns, next at 2377251122954ns, rc = 0 00000004:00080000:1.0:1788986615.871771:0:90911:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2399774680919ns, next at 2398776258696ns, rc = 0 00000004:00080000:2.0:1788986615.907937:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 86 committed 00000004:00080000:2.0:1788986615.907967:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 85 committed 00000001:00080000:2.0:1788986615.907985:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967670 is committed 00000004:00080000:2.0:1788986615.907991:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 85 committed 00000100:00100000:2.0:1788986615.908375:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986615.908398:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993576832:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788986615.908491:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986615.908576:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993576832 00000100:00100000:2.0:1788986615.908585:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993576832 00000100:00100000:2.0:1788986615.908651:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1788986615.908662:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993576832:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788986615.908696:0:86533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:31 count 1 00010000:00010000:2.0:1788986615.908728:0:86533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986615.908754:0:86533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf549751 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d144f expref: 5 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986615.908763:0:86533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f:0x0].0x0 since=6s v=(0 0) 00010000:00010000:2.0:1788986615.908768:0:86533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788986615.908773:0:86533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986615.908805:0:86533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf549751 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d144f expref: 5 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986615.908821:0:86533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf549751 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d144f expref: 5 pid: 6698 timeout: 2499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986615.908833:0:86533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:86533:1875885993576960:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986615.908899:0:86533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a45b97e40 going to sleep for 11 seconds 00000100:00080000:2.0:1788986615.908912:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986615.916695:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986615.917025:0:86533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:86533:1875885993576960:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788986615.917062:0:86533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986615.918681:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971371776 00000100:00100000:3.0:1788986615.918698:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971371776 00010000:00010000:3.0:1788986615.918835:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf549751 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d144f expref: 6 pid: 6698 timeout: 2499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986615.918888:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 421 00000100:00100000:3.0:1788986615.918899:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971371776:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986615.918918:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986615.918924:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf549751 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d144f expref: 6 pid: 6698 timeout: 2499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986615.918939:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf549751 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d144f expref: 6 pid: 6698 timeout: 2499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986615.918970:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd88eeea/0xc20d828fcf549751 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d144f expref: 6 pid: 6698 timeout: 2499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986615.918990:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986615.918996:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986615.919003:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986615.919030:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986615.919075:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986615.919812:0:86533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986615.919827:0:86533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986615.919838:0:86533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986615.919846:0:86533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986615.919876:0:86533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788986615.920688:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993576832:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12023us (12192us total) trans 4294967359 rc 0/0 00000100:00100000:1.0:1788986615.920699:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1788986615.921259:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971371776:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 2356us (4572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986615.921270:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 421 00010000:00010000:3.0:1788986615.921409:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986615.921418:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986615.921431:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986615.921435:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986615.921448:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986615.921473:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986615.921938:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549774 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986615.921967:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986615.921970:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986615.921972:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986615.922336:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a761c2680/2, rc 0, transno 4294967359 00000100:00100000:3.0:1788986615.922360:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993576832:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1788986615.923806:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788986616.770235:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986616.834020:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993577216:0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834106:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986616.834148:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993577728:0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834170:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986616.834191:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788986616.834196:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993577088:0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834218:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986616.834236:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993577600:0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834253:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986616.834274:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993577344:0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834291:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986616.834305:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986616.834309:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993577472:0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834327:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986616.834352:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993577216 00000100:00100000:0.0:1788986616.834358:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993577216 00000100:00100000:0.0:1788986616.834392:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993577600 00000100:00100000:0.0:1788986616.834394:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993577600 00000100:00100000:0.0:1788986616.834415:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993577344 00000100:00100000:0.0:1788986616.834417:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993577344 00000100:00100000:0.0:1788986616.834430:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1703 00000100:00100000:0.0:1788986616.834437:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993577216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834494:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993577216:12345-0@lo:400:kworker.0 Request processed in 57us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986616.834501:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1703 00000100:00100000:0.0:1788986616.834516:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1704 00000100:00100000:0.0:1788986616.834522:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993577600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834548:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993577600:12345-0@lo:400:kworker.0 Request processed in 27us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986616.834554:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1704 00000100:00100000:0.0:1788986616.834566:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1705 00000100:00100000:0.0:1788986616.834572:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993577344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834600:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993577344:12345-0@lo:400:kworker.0 Request processed in 28us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986616.834605:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1705 00000100:00100000:0.0:1788986616.834623:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993577728 00000100:00100000:0.0:1788986616.834626:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993577728 00000100:00100000:0.0:1788986616.834649:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993577472 00000100:00100000:0.0:1788986616.834651:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993577472 00000100:00100000:0.0:1788986616.834669:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1788986616.834675:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993577728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834703:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993577728:12345-0@lo:400:kworker.0 Request processed in 29us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986616.834708:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1263 00000100:00100000:0.0:1788986616.834718:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1788986616.834723:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993577472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834744:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993577472:12345-0@lo:400:kworker.0 Request processed in 22us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986616.834749:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1264 00000100:00100000:0.0:1788986616.834766:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993577088 00000100:00100000:0.0:1788986616.834769:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993577088 00000100:00100000:0.0:1788986616.834790:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:0.0:1788986616.834795:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993577088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834822:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993577088:12345-0@lo:400:kworker.0 Request processed in 27us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986616.834828:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00080000:0.0:1788986616.834862:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986616.834900:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993577472:0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834911:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993577344:0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834938:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993577088:0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834947:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993577600:0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834954:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993577216:0@lo:400:kworker.0 00000100:00100000:0.0:1788986616.834962:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993577728:0@lo:400:kworker.0 00000100:00100000:2.0:1788986617.344507:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986617.344529:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993577856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986617.344660:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986617.344781:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993577856 00000100:00100000:3.0:1788986617.344789:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993577856 00000100:00100000:3.0:1788986617.344854:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 865 00000100:00100000:3.0:1788986617.344865:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993577856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986617.344895:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788986617.344941:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993577856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986617.344948:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 865 00000100:00080000:2.0:1788986617.345000:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986617.345046:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993577856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986617.792241:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986618.817168:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986618.906686:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967359 is committed 00000100:00100000:0.0:1788986618.993984:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986618.994035:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986618.994071:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986618.994112:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986618.994135:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971371904 00000100:00100000:0.0:1788986618.994143:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971371904 00000100:00100000:0.0:1788986618.994186:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1333 00000100:00100000:0.0:1788986618.994195:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971371904:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986618.994255:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971371904:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 61us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986618.994262:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1333 00000100:00100000:0.0:1788986618.994289:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971372288 00000100:00100000:0.0:1788986618.994293:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971372288 00000100:00100000:0.0:1788986618.994324:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971372160 00000100:00100000:0.0:1788986618.994327:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971372160 00000100:00100000:0.0:1788986618.994346:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1265 00000100:00100000:0.0:1788986618.994352:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971372288:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986618.994376:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971372288:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986618.994382:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1265 00000100:00100000:0.0:1788986618.994392:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1266 00000100:00100000:0.0:1788986618.994398:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971372160:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986618.994419:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971372160:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 21us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986618.994425:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1266 00000100:00080000:0.0:1788986618.994551:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986618.994555:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986618.994973:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971372032 00000100:00100000:3.0:1788986618.994979:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971372032 00000100:00100000:3.0:1788986618.995034:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1706 00000100:00100000:3.0:1788986618.995042:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971372032:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986618.995081:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971372032:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 41us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986618.995115:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1706 00000100:00080000:0.0:1788986618.995211:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986619.840234:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986620.868784:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986620.935781:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986620.935804:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993577984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986620.935867:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986620.935980:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993577984 00000100:00100000:0.0:1788986620.935997:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993577984 00000100:00100000:0.0:1788986620.936050:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:0.0:1788986620.936059:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993577984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986620.936107:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986620.936150:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993577984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986620.936156:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00080000:1.0:1788986620.936214:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986620.936261:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993577984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986621.888224:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986621.952680:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993578496:0@lo:400:kworker.0 00000100:00100000:2.0:1788986621.952742:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986621.952988:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993578368:0@lo:400:kworker.0 00000100:00100000:0.0:1788986621.953046:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993578112:0@lo:400:kworker.0 00000100:00100000:1.0:1788986621.953132:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993578240:0@lo:400:kworker.0 00000100:00100000:3.0:1788986621.960785:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986621.960913:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993578496 00000100:00100000:3.0:1788986621.960924:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993578496 00000100:00100000:3.0:1788986621.960992:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1267 00000100:00100000:3.0:1788986621.961002:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993578496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986621.961059:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993578496:12345-0@lo:400:kworker.0 Request processed in 59us (8316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986621.961065:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1267 00000100:00100000:3.0:1788986621.961112:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993578368 00000100:00100000:3.0:1788986621.961116:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993578368 00000100:00100000:3.0:1788986621.961153:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1707 00000100:00100000:3.0:1788986621.961160:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993578368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986621.961196:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993578368:12345-0@lo:400:kworker.0 Request processed in 36us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986621.961202:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1707 00000100:00100000:3.0:1788986621.961235:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993578368:0@lo:400:kworker.0 00000100:00080000:3.0:1788986621.961277:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986621.966322:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986621.966378:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993578112 00000100:00100000:0.0:1788986621.966388:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993578112 00000100:00100000:0.0:1788986621.966455:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:0.0:1788986621.966466:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993578112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986621.966518:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993578112:12345-0@lo:400:kworker.0 Request processed in 54us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986621.966524:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:0.0:1788986621.966589:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993578112:0@lo:400:kworker.0 00000100:00100000:0.0:1788986621.966601:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993578624:0@lo:400:kworker.0 00000100:00100000:0.0:1788986621.966631:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986621.966652:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993578624 00000100:00100000:0.0:1788986621.966655:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993578624 00000100:00100000:0.0:1788986621.966692:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1708 00000100:00100000:0.0:1788986621.966699:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993578624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986621.966728:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993578624:12345-0@lo:400:kworker.0 Request processed in 29us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986621.966733:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1708 00000100:00080000:0.0:1788986621.966750:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986621.966766:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993578624:0@lo:400:kworker.0 00000100:00100000:1.0:1788986621.970384:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986621.970443:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993578752:0@lo:400:kworker.0 00000100:00100000:1.0:1788986621.972018:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986621.972053:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993578752 00000100:00100000:2.0:1788986621.972060:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993578752 00000100:00100000:3.0:1788986621.972069:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993578496:0@lo:400:kworker.0 00000100:00080000:1.0:1788986621.972105:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986621.972135:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1268 00000100:00100000:2.0:1788986621.972206:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993578752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986621.972318:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993578752:12345-0@lo:400:kworker.0 Request processed in 174us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986621.972326:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1268 00000100:00100000:0.0:1788986621.972339:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993578240 00000100:00100000:0.0:1788986621.972344:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993578240 00000100:00100000:0.0:1788986621.972376:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1709 00000100:00100000:0.0:1788986621.972384:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993578240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986621.972419:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993578240:12345-0@lo:400:kworker.0 Request processed in 36us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986621.972425:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1709 00000100:00100000:3.0:1788986621.972502:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967359 gen 2 00000004:00080000:3.0:1788986621.972508:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a761c2680, transno 4294967359 00000100:00100000:3.0:1788986621.972523:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993578752:0@lo:400:kworker.0 00000100:00100000:3.0:1788986621.972544:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993578240:0@lo:400:kworker.0 00000100:00100000:3.0:1788986622.464385:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993578880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986622.464453:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986622.464607:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993578880 00000100:00100000:0.0:1788986622.464614:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993578880 00000100:00100000:0.0:1788986622.464677:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:0.0:1788986622.464686:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993578880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986622.464729:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986622.467081:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993578880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2388us (2619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986622.467108:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:3.0:1788986622.467392:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993578880:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986622.912353:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986623.938582:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986624.112452:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986624.112541:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986624.112573:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986624.112603:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986624.112638:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971372672 00000100:00100000:3.0:1788986624.112641:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971372544 00000100:00100000:3.0:1788986624.112646:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971372544 00000100:00100000:0.0:1788986624.112646:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971372672 00000100:00100000:0.0:1788986624.112698:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971372800 00000100:00100000:0.0:1788986624.112701:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971372800 00000100:00100000:3.0:1788986624.112703:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1710 00000100:00100000:3.0:1788986624.112711:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971372544:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986624.112721:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1269 00000100:00100000:0.0:1788986624.112727:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971372672:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986624.112804:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1270 00000100:00100000:1.0:1788986624.112814:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971372800:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986624.112863:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971372672:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 135us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986624.112871:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1269 00000100:00080000:0.0:1788986624.112894:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986624.112898:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986624.112900:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986624.113015:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971372416 00000100:00100000:2.0:1788986624.113020:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971372416 00000100:00100000:2.0:1788986624.113049:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1335 00000100:00100000:2.0:1788986624.113056:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971372416:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986624.116920:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971372544:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 4199us (4335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986624.116934:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1710 00000100:00100000:1.0:1788986624.120718:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971372800:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 7894us (8101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986624.120733:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1270 00000100:00100000:2.0:1788986624.121429:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971372416:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 8368us (8982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986624.121439:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1335 00010000:00010000:3.0:1788986624.960242:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986625.985832:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986626.048435:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986626.048456:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993579008:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986626.048621:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986626.049469:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993579008 00000100:00100000:1.0:1788986626.049479:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993579008 00000100:00100000:1.0:1788986626.049646:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1788986626.049658:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993579008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986626.049701:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986626.049777:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993579008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986626.049787:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:2.0:1788986626.049895:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993579008:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986626.049971:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986627.008393:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986627.074650:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993579392:0@lo:400:kworker.0 00000100:00100000:1.0:1788986627.074716:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986627.074767:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986627.074773:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993579520:0@lo:400:kworker.0 00000100:00100000:1.0:1788986627.074799:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986627.074833:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993579520 00000100:00100000:1.0:1788986627.074841:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993579520 00000100:00100000:1.0:1788986627.074881:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1788986627.074889:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993579520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986627.074936:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993579520:12345-0@lo:400:kworker.0 Request processed in 48us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986627.074942:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1271 00000100:00100000:1.0:1788986627.074994:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993579520:0@lo:400:kworker.0 00000100:00100000:3.0:1788986627.075102:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993579264:0@lo:400:kworker.0 00000100:00100000:3.0:1788986627.075135:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986627.075166:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788986627.075172:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993579136:0@lo:400:kworker.0 00000100:00100000:3.0:1788986627.075200:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986627.075220:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993579648:0@lo:400:kworker.0 00000100:00100000:3.0:1788986627.075241:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986627.075308:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993579392 00000100:00100000:1.0:1788986627.075313:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993579392 00000100:00100000:1.0:1788986627.075355:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993579264 00000100:00100000:1.0:1788986627.075359:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993579264 00000100:00100000:1.0:1788986627.075376:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993579648 00000100:00100000:1.0:1788986627.075379:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993579648 00000100:00100000:1.0:1788986627.075395:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1711 00000100:00100000:1.0:1788986627.075401:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993579392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986627.075454:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993579392:12345-0@lo:400:kworker.0 Request processed in 53us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986627.075462:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1711 00000100:00100000:1.0:1788986627.075476:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1712 00000100:00100000:1.0:1788986627.075482:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993579264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986627.075516:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993579264:12345-0@lo:400:kworker.0 Request processed in 34us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986627.075780:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1712 00000100:00100000:1.0:1788986627.075798:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1713 00000100:00100000:1.0:1788986627.075805:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993579648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986627.075838:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993579648:12345-0@lo:400:kworker.0 Request processed in 35us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986627.075843:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1713 00000100:00100000:1.0:1788986627.075877:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993579648:0@lo:400:kworker.0 00000100:00100000:1.0:1788986627.075886:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993579264:0@lo:400:kworker.0 00000100:00100000:1.0:1788986627.075911:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993579392:0@lo:400:kworker.0 00000100:00100000:0.0:1788986627.076062:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986627.076076:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993579776:0@lo:400:kworker.0 00000100:00100000:0.0:1788986627.076135:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986627.076166:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993579136 00000100:00100000:0.0:1788986627.076170:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993579136 00000100:00100000:0.0:1788986627.076198:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1788986627.076205:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993579136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986627.076234:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993579136:12345-0@lo:400:kworker.0 Request processed in 30us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986627.076240:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1336 00000100:00100000:0.0:1788986627.076278:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993579776 00000100:00100000:0.0:1788986627.076281:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993579776 00000100:00100000:0.0:1788986627.076307:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1788986627.076313:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993579776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986627.076345:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993579776:12345-0@lo:400:kworker.0 Request processed in 32us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986627.076351:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1272 00000100:00100000:0.0:1788986627.076379:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993579776:0@lo:400:kworker.0 00000100:00080000:3.0:1788986627.076733:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986627.076738:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986627.077124:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993579136:0@lo:400:kworker.0 00000100:00100000:3.0:1788986627.585034:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986627.585055:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993579904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986627.585135:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986627.590136:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993579904 00000100:00100000:0.0:1788986627.590253:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993579904 00000100:00100000:0.0:1788986627.590393:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 869 00000100:00100000:0.0:1788986627.590505:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993579904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986627.590540:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986627.591225:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993579904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 721us (6087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986627.591234:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 869 00000100:00100000:1.0:1788986627.597247:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993579904:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986628.032329:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986629.057789:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986629.232403:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986629.232451:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986629.232483:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986629.232519:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986629.232638:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971372928 00000100:00100000:2.0:1788986629.232646:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971372928 00000100:00100000:2.0:1788986629.232698:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1337 00000100:00100000:2.0:1788986629.232709:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971372928:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986629.232777:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971372928:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986629.232784:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1337 00000100:00100000:1.0:1788986629.233169:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971373184 00000100:00100000:1.0:1788986629.233174:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971373184 00000100:00100000:1.0:1788986629.233230:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971373312 00000100:00100000:1.0:1788986629.233234:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971373312 00000100:00100000:1.0:1788986629.233256:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1273 00000100:00100000:1.0:1788986629.233262:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971373184:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986629.233301:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971373184:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 39us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986629.233308:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1273 00000100:00100000:1.0:1788986629.233327:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1274 00000100:00100000:1.0:1788986629.233334:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971373312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986629.233358:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971373312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (838us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986629.233364:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1274 00000100:00100000:3.0:1788986629.233844:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971373056 00000100:00100000:3.0:1788986629.233850:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971373056 00000100:00100000:3.0:1788986629.233892:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1714 00000100:00100000:3.0:1788986629.233900:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971373056:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986629.233950:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971373056:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (1456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986629.233957:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1714 00000100:00080000:2.0:1788986629.234152:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986629.234157:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986629.234159:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986630.081309:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986631.104203:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986631.168557:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993580032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986631.168636:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986631.168768:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993580032 00000100:00100000:3.0:1788986631.168775:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993580032 00000100:00100000:3.0:1788986631.168846:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:3.0:1788986631.168856:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993580032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986631.168889:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986631.168948:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993580032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986631.168956:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:3.0:1788986631.169001:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993580032:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986631.169457:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986632.129829:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986632.193931:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993580544:0@lo:400:kworker.0 00000100:00100000:3.0:1788986632.194004:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986632.194080:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986632.194086:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993580416:0@lo:400:kworker.0 00000100:00100000:3.0:1788986632.194129:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986632.194213:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993580544 00000100:00100000:2.0:1788986632.194221:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993580544 00000100:00100000:2.0:1788986632.194274:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1788986632.194283:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993580544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986632.194343:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993580544:12345-0@lo:400:kworker.0 Request processed in 61us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986632.194349:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1275 00000100:00100000:2.0:1788986632.194401:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993580544:0@lo:400:kworker.0 00000100:00100000:1.0:1788986632.194525:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993580288:0@lo:400:kworker.0 00000100:00100000:1.0:1788986632.194555:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986632.194582:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993580800:0@lo:400:kworker.0 00000100:00100000:1.0:1788986632.194603:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986632.194621:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788986632.194627:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993580160:0@lo:400:kworker.0 00000100:00100000:1.0:1788986632.194653:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986632.194672:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993580672:0@lo:400:kworker.0 00000100:00100000:1.0:1788986632.194691:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986632.194714:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993580800 00000100:00100000:1.0:1788986632.194718:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993580800 00000100:00100000:1.0:1788986632.194758:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1788986632.194765:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993580800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986632.194800:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993580800:12345-0@lo:400:kworker.0 Request processed in 36us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986632.194806:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1276 00000100:00100000:1.0:1788986632.194834:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993580800:0@lo:400:kworker.0 00000100:00100000:2.0:1788986632.194950:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993580416 00000100:00100000:2.0:1788986632.194955:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993580416 00000100:00100000:2.0:1788986632.194988:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993580288 00000100:00100000:2.0:1788986632.194992:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993580288 00000100:00100000:2.0:1788986632.195009:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993580672 00000100:00100000:2.0:1788986632.195012:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993580672 00000100:00100000:2.0:1788986632.195026:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1715 00000100:00100000:3.0:1788986632.195032:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1716 00000100:00100000:2.0:1788986632.195033:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993580416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986632.195072:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993580416:12345-0@lo:400:kworker.0 Request processed in 40us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986632.195078:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1715 00000100:00100000:2.0:1788986632.195110:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1717 00000100:00100000:2.0:1788986632.195117:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993580672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986632.195150:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993580672:12345-0@lo:400:kworker.0 Request processed in 34us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986632.195156:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1717 00000100:00100000:2.0:1788986632.195182:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993580672:0@lo:400:kworker.0 00000100:00100000:2.0:1788986632.195205:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993580416:0@lo:400:kworker.0 00000100:00100000:3.0:1788986632.195254:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993580288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986632.195300:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993580288:12345-0@lo:400:kworker.0 Request processed in 261us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986632.195306:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1716 00000100:00100000:0.0:1788986632.195387:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993580160 00000100:00100000:0.0:1788986632.195392:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993580160 00000100:00100000:0.0:1788986632.195429:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:0.0:1788986632.195436:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993580160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986632.195467:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993580160:12345-0@lo:400:kworker.0 Request processed in 32us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986632.195473:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:2.0:1788986632.195488:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993580160:0@lo:400:kworker.0 00000100:00080000:0.0:1788986632.195499:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986632.195503:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986632.195594:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993580288:0@lo:400:kworker.0 00000100:00100000:2.0:1788986632.704881:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993580928:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986632.704963:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986632.705334:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993580928 00000100:00100000:3.0:1788986632.705343:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993580928 00000100:00100000:3.0:1788986632.705387:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:3.0:1788986632.705396:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993580928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986632.705429:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986632.705483:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993580928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986632.705490:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1788986632.706259:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993580928:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986633.113407:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986633.113570:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971373440 00000100:00100000:0.0:1788986633.113580:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971373440 00000100:00100000:0.0:1788986633.113659:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 989 00000100:00100000:0.0:1788986633.113669:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53740:x1875885971373440:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986633.113764:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53740:x1875885971373440:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 96us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986633.113771:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 989 00000100:00080000:1.0:1788986633.114085:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986633.134994:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986633.135196:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971373568 00000100:00100000:1.0:1788986633.135211:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971373568 00000100:00100000:1.0:1788986633.135297:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 540 00000100:00100000:1.0:1788986633.135307:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53740:x1875885971373568:12345-192.168.206.21@tcp:19:lfs.0 00000100:00080000:0.0:1788986633.135820:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986633.136395:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53740:x1875885971373568:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 1085us (1411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986633.136405:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 540 00010000:00010000:3.0:1788986633.153756:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986633.160655:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986633.160816:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971373696 00000100:00100000:1.0:1788986633.160826:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971373696 00000100:00100000:1.0:1788986633.160892:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 541 00000100:00100000:1.0:1788986633.160901:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53740:x1875885971373696:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986633.161287:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53740:x1875885971373696:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 386us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986633.161294:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 541 00000100:00080000:0.0:1788986633.161649:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986633.167872:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986633.169551:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971373824 00000100:00100000:1.0:1788986633.169565:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971373824 00000100:00100000:1.0:1788986633.169643:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 990 00000100:00100000:1.0:1788986633.169656:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53740:x1875885971373824:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986633.170141:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53740:x1875885971373824:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 486us (2277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986633.170149:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 990 00000100:00100000:3.0:1788986633.181073:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986633.181205:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971373952 00000100:00100000:0.0:1788986633.181215:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971373952 00000100:00100000:0.0:1788986633.181277:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 991 00000100:00100000:0.0:1788986633.181290:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53740:x1875885971373952:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986633.181405:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53740:x1875885971373952:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 118us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986633.181422:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 991 00000100:00100000:2.0:1788986633.187044:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986633.187131:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971374080 00000100:00100000:3.0:1788986633.187140:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971374080 00000100:00100000:3.0:1788986633.187191:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 542 00000100:00100000:3.0:1788986633.187201:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53740:x1875885971374080:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986633.187741:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53740:x1875885971374080:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 539us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986633.187750:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 542 00000100:00100000:3.0:1788986633.195914:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986633.196082:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971374208 00000100:00100000:1.0:1788986633.196127:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971374208 00000100:00100000:1.0:1788986633.196185:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 543 00000100:00100000:1.0:1788986633.196195:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53740:x1875885971374208:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986633.196723:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53740:x1875885971374208:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 348us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986633.196731:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 543 00000100:00100000:0.0:1788986633.214642:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986633.214901:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971374336 00000100:00100000:3.0:1788986633.214910:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971374336 00000100:00100000:3.0:1788986633.214971:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 992 00000100:00100000:3.0:1788986633.214980:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53740:x1875885971374336:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986633.215366:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53740:x1875885971374336:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 386us (743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986633.215373:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 992 00010000:00010000:3.0:1788986634.177233:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986634.352348:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986634.352393:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986634.352444:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986634.352473:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986634.352499:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971374464 00000100:00100000:2.0:1788986634.352509:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971374464 00000100:00100000:2.0:1788986634.352564:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1339 00000100:00100000:2.0:1788986634.352574:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971374464:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986634.352638:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971374464:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986634.352645:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1339 00000100:00100000:3.0:1788986634.352980:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971374848 00000100:00100000:3.0:1788986634.352986:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971374848 00000100:00100000:3.0:1788986634.353025:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971374720 00000100:00100000:3.0:1788986634.353029:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971374720 00000100:00100000:3.0:1788986634.353049:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1277 00000100:00100000:3.0:1788986634.353056:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971374848:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986634.353112:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971374848:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 56us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986634.353119:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1277 00000100:00100000:3.0:1788986634.353134:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1278 00000100:00100000:3.0:1788986634.353140:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971374720:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986634.353164:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971374720:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986634.353169:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1278 00000100:00100000:1.0:1788986634.353304:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971374592 00000100:00100000:1.0:1788986634.353309:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971374592 00000100:00100000:1.0:1788986634.353351:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1718 00000100:00100000:1.0:1788986634.353359:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971374592:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986634.353396:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971374592:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986634.353403:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1718 00010000:00010000:3.0:1788986635.200215:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788986636.023874:0:91225:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff38b2e550 20000000:00000080:1.0:1788986636.023891:0:91225:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7663b800 uarg=0000000000000000 00010000:00010000:1.0:1788986636.025832:0:91225:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788986636.025869:0:91225:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:1.0:1788986636.025873:0:91225:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986636.025883:0:91225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549727 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1441 expref: 5 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986636.025919:0:91225:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1788986636.025937:0:91225:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986636.025952:0:91225:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986636.025964:0:91225:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549704 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5496fd expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986636.025977:0:91225:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986636.026484:0:91225:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549704 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5496fd expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986636.026499:0:91225:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549704 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5496fd expref: 18 pid: 5848 timeout: 2519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986636.026514:0:91225:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91225:1875885993581056:0@lo:104: 00000100:00100000:1.0:1788986636.026647:0:91225:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986636.027086:0:91225:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a43fb2b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788986636.027183:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993581056 00000100:00100000:2.0:1788986636.027191:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993581056 00000100:00100000:2.0:1788986636.027246:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:2.0:1788986636.027255:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:91225:x1875885993581056:12345-0@lo:104: 00010000:00010000:2.0:1788986636.027270:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549704 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986636.027342:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986636.027348:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:91225:x1875885993581056:12345-0@lo:104: Request processed in 95us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986636.027355:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788986636.027428:0:91225:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91225:1875885993581056:0@lo:104: 00010000:00010000:1.0:1788986636.027447:0:91225:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.027757:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986636.027765:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549704 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.027774:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986636.027779:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549704 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.027789:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549704 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986636.027797:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549704 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986636.027804:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986636.027842:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549704 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.027850:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986636.027880:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549704 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.027888:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf5496fd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549704 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.027914:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986636.027916:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986636.027918:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986636.027959:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993581184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986636.028000:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986636.028083:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993581184 00000100:00100000:3.0:1788986636.028118:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993581184 00010000:00010000:3.0:1788986636.028146:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549704 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5496fd expref: 19 pid: 5848 timeout: 2519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986636.028172:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1788986636.028180:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993581184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986636.028191:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986636.028196:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549704 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5496fd expref: 19 pid: 5848 timeout: 2519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.028207:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549704 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5496fd expref: 19 pid: 5848 timeout: 2519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.028219:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549704 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5496fd expref: 19 pid: 5848 timeout: 2519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.028234:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.028242:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.028255:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.028262:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.028268:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.028275:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.028281:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986636.028285:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.028292:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.028312:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986636.028323:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986636.028346:0:91225:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986636.028355:0:91225:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986636.028363:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993581184:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (360us total) trans 0 rc 0/0 00010000:00010000:1.0:1788986636.028365:0:91225:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54977b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986636.028379:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1788986636.028417:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993581184:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986636.226680:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986636.294285:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993581312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986636.294352:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986636.294444:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993581312 00000100:00100000:2.0:1788986636.294451:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993581312 00000100:00100000:2.0:1788986636.294504:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1788986636.294514:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993581312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986636.294546:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986636.294592:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993581312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986636.294599:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00080000:2.0:1788986636.294619:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986636.294653:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993581312:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1788986637.186337:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986637.186344:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986637.186349:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986637.186395:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986637.186407:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986637.186418:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986637.186456:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993581440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986637.186519:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986637.186574:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76582f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788986637.186760:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993581440 00000100:00100000:3.0:1788986637.186778:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993581440 00000100:00100000:3.0:1788986637.186830:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:3.0:1788986637.186840:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993581440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986637.186852:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986637.186865:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549789 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549782 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986637.186888:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549789 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549782 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986637.186908:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549789 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549782 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986637.186916:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788986637.186957:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993581440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986637.186964:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:2.0:1788986637.187926:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993581440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986637.187948:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986637.187958:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986637.187982:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986637.187987:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986637.187995:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986637.260157:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986637.314454:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993581696:0@lo:400:kworker.0 00000100:00100000:2.0:1788986637.314518:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986637.314577:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986637.314583:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993581824:0@lo:400:kworker.0 00000100:00100000:2.0:1788986637.314607:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986637.314639:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993581696 00000100:00100000:2.0:1788986637.314645:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993581696 00000100:00100000:2.0:1788986637.314694:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1719 00000100:00100000:2.0:1788986637.314703:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993581696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986637.314749:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993581696:12345-0@lo:400:kworker.0 Request processed in 47us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986637.314755:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1719 00000100:00100000:2.0:1788986637.314778:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993581824 00000100:00100000:2.0:1788986637.314781:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993581824 00000100:00100000:2.0:1788986637.314806:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1279 00000100:00100000:2.0:1788986637.314812:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993581824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986637.314841:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993581824:12345-0@lo:400:kworker.0 Request processed in 30us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986637.314847:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1279 00000100:00080000:2.0:1788986637.314862:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986637.314914:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993581824:0@lo:400:kworker.0 00000100:00100000:2.0:1788986637.314925:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993581696:0@lo:400:kworker.0 00000100:00100000:3.0:1788986637.314996:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993581568:0@lo:400:kworker.0 00000100:00100000:3.0:1788986637.315025:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986637.315054:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993582080:0@lo:400:kworker.0 00000100:00100000:3.0:1788986637.315075:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986637.315117:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986637.315124:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993581952:0@lo:400:kworker.0 00000100:00100000:3.0:1788986637.315145:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986637.315170:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993582080 00000100:00100000:3.0:1788986637.315174:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993582080 00000100:00100000:3.0:1788986637.315203:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1788986637.315209:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993582080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986637.315239:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993582080:12345-0@lo:400:kworker.0 Request processed in 31us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986637.315244:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1280 00000100:00100000:3.0:1788986637.315261:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993581568 00000100:00100000:3.0:1788986637.315264:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993581568 00000100:00100000:3.0:1788986637.315283:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993581952 00000100:00100000:3.0:1788986637.315285:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993581952 00000100:00100000:3.0:1788986637.315301:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1720 00000100:00100000:3.0:1788986637.315306:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993581568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986637.315334:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993581568:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986637.315339:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1720 00000100:00100000:3.0:1788986637.315349:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1721 00000100:00100000:3.0:1788986637.315354:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993581952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986637.315377:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993581952:12345-0@lo:400:kworker.0 Request processed in 23us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986637.315385:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1721 00000100:00100000:3.0:1788986637.315412:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993581952:0@lo:400:kworker.0 00000100:00100000:3.0:1788986637.315420:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993581568:0@lo:400:kworker.0 00000100:00100000:3.0:1788986637.315427:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993582080:0@lo:400:kworker.0 00000100:00080000:2.0:1788986637.315696:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986637.315700:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986637.826114:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986637.826137:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993582208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986637.826203:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986637.826987:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993582208 00000100:00100000:1.0:1788986637.826997:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993582208 00000100:00100000:1.0:1788986637.827050:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 873 00000100:00100000:1.0:1788986637.827059:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993582208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986637.827130:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986637.827192:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993582208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986637.827199:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 873 00000100:00100000:0.0:1788986637.827308:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993582208:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986638.272262:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986639.296224:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986639.472489:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986639.472523:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986639.472570:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986639.472591:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986639.472657:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971375360 00000100:00100000:3.0:1788986639.472667:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971375360 00000100:00100000:3.0:1788986639.472723:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971375232 00000100:00100000:3.0:1788986639.472727:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971375232 00000100:00100000:3.0:1788986639.472752:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1281 00000100:00100000:3.0:1788986639.472774:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971375360:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986639.472844:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971375360:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986639.472852:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1281 00000100:00100000:3.0:1788986639.472869:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1282 00000100:00100000:3.0:1788986639.472876:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971375232:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986639.472916:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971375232:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986639.472922:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1282 00000100:00100000:2.0:1788986639.473104:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971375104 00000100:00100000:2.0:1788986639.473110:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971375104 00000100:00100000:2.0:1788986639.473148:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1722 00000100:00100000:2.0:1788986639.473155:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971375104:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986639.473186:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971375104:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (705us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986639.473192:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1722 00000100:00100000:2.0:1788986639.473212:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971374976 00000100:00100000:2.0:1788986639.473215:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971374976 00000100:00100000:2.0:1788986639.473241:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1341 00000100:00100000:2.0:1788986639.473247:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971374976:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986639.473273:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971374976:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986639.473280:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1341 00000100:00080000:1.0:1788986639.473472:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986639.473477:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986639.473479:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986639.753324:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986639.753391:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971375488 00000100:00100000:3.0:1788986639.753400:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971375488 00000100:00100000:3.0:1788986639.753465:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 993 00000100:00100000:3.0:1788986639.753475:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53827:x1875885971375488:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986639.753495:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986639.753518:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549790 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1456 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986639.753750:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549797 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986639.753769:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986639.753782:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986639.753817:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:3.0:1788986639.753820:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986639.753839:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549797 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986639.753864:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549790 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1456 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986639.753898:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549797 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1456 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986639.753906:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:3.0:1788986639.753909:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986639.753912:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788986639.753974:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53827:x1875885971375488:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 500us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986639.753980:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 993 00000100:00100000:0.0:1788986639.762381:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986639.762456:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971375744 00000100:00100000:3.0:1788986639.762466:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971375744 00000100:00100000:3.0:1788986639.762519:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 994 00000100:00100000:3.0:1788986639.762528:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53827:x1875885971375744:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986639.762574:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986639.762599:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549797 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1456 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986639.762614:0:5855:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf549727) 00010000:00010000:3.0:1788986639.762617:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:3.0:1788986639.762627:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986639.762648:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54979e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986639.762660:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54979e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986639.762668:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54979e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788986639.832664:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967671 is committed 00000004:00010000:3.0:1788986639.832733:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007f70b7ce reply state 0000000056138829 transno 4294967671 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54979e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986639.832747:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986639.832762:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00010000:00080000:3.0:1788986639.832974:0:5855:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788986639.833001:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53827:x1875885971375744:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 70469us (70623us total) trans 4294967671 rc 0/0 00010000:00010000:0.0:1788986639.833007:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54979e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986639.833014:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 994 00010000:00010000:0.0:1788986639.833025:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54979e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986639.833035:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54979e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986639.833043:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986639.833049:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54979e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986639.833059:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54979e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986639.833077:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:0.0:1788986639.833081:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788986639.833112:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54979e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986639.833120:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54979e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986640.321154:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986640.735967:0:91420:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcbb281890 20000000:00000080:2.0:1788986640.735984:0:91420:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094295c000 uarg=0000000000000000 00010000:00010000:2.0:1788986640.739417:0:91420:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986640.739442:0:91420:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986640.739459:0:91420:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986640.739476:0:91420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986640.739493:0:91420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549789 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549782 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986640.739501:0:91420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986640.739543:0:91420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549789 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549782 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986640.739558:0:91420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549789 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549782 expref: 18 pid: 5849 timeout: 2524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986640.739573:0:91420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79797480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91420:1875885993582336:0@lo:104: 00000100:00100000:2.0:1788986640.739631:0:91420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986640.739719:0:91420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788986640.740071:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788986640.740084:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993582336 00000100:00100000:3.0:1788986640.740283:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993582336 00000100:00100000:3.0:1788986640.740361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788986640.740371:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:91420:x1875885993582336:12345-0@lo:104: 00010000:00010000:3.0:1788986640.740386:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986640.740457:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986640.740463:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fbb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:91420:x1875885993582336:12345-0@lo:104: Request processed in 95us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986640.740471:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00010000:00010000:1.0:1788986640.740537:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986640.740544:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740551:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986640.740555:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740563:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986640.740571:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986640.740577:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986640.740610:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740622:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986640.740642:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740650:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0000/0xc20d828fcf549782 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549789 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740670:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986640.740672:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986640.740673:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986640.740691:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993582464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986640.740721:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986640.740764:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993582464 00000100:00100000:1.0:1788986640.740780:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993582464 00010000:00010000:1.0:1788986640.740802:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549789 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549782 expref: 19 pid: 5849 timeout: 2524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986640.740824:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1788986640.740831:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993582464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986640.740840:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986640.740845:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549789 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549782 expref: 19 pid: 5849 timeout: 2524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740854:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549789 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549782 expref: 19 pid: 5849 timeout: 2524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740869:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740893:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740907:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740915:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740923:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740930:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740936:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986640.740940:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740948:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740956:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986640.740966:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986640.740994:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993582464:12345-0@lo:103:ldlm_bl.0 Request processed in 163us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986640.741001:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00000100:00100000:1.0:1788986640.741034:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993582464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986640.741385:0:91420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf549789 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549782 expref: 18 pid: 5849 timeout: 2524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986640.741397:0:91420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79797480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91420:1875885993582336:0@lo:104: 00010000:00010000:2.0:1788986640.741410:0:91420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986640.741418:0:91420:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986640.741425:0:91420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986640.741431:0:91420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497a5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986641.345957:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986641.414230:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993582592:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986641.414292:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986641.414358:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993582592 00000100:00100000:3.0:1788986641.414365:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993582592 00000100:00100000:3.0:1788986641.414416:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 874 00000100:00100000:3.0:1788986641.414426:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993582592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986641.414457:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986641.414495:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993582592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986641.414502:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 874 00000100:00080000:3.0:1788986641.414520:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986641.414548:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993582592:0@lo:13:osp-pre-0-0.0 10000000:01000000:1.0:1788986641.792266:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986641.792273:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986641.792278:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986641.792318:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986641.792330:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986641.792341:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986641.792365:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993582720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986641.792425:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986641.792477:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a59f526c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986641.792540:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993582720 00000100:00100000:2.0:1788986641.792548:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993582720 00000100:00100000:2.0:1788986641.792600:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1342 00000100:00100000:2.0:1788986641.792609:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993582720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986641.792622:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986641.792635:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497b3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5497ac expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986641.792656:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5497ac expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986641.792666:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5497ac expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986641.792675:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0600, rc 0) 00000100:00100000:2.0:1788986641.792725:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993582720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986641.792732:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1342 00000100:00100000:1.0:1788986641.792914:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993582720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986641.792928:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5497b3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986641.792937:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5497b3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986641.792954:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986641.792958:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5497b3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986641.792966:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5497b3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986642.368238:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986642.432387:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993583104:0@lo:400:kworker.0 00000100:00100000:1.0:1788986642.432448:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986642.432511:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788986642.432518:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993582976:0@lo:400:kworker.0 00000100:00100000:1.0:1788986642.432540:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986642.432555:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993583488:0@lo:400:kworker.0 00000100:00100000:1.0:1788986642.432575:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986642.432604:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993583488 00000100:00100000:1.0:1788986642.432611:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993583488 00000100:00100000:1.0:1788986642.432664:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1283 00000100:00100000:1.0:1788986642.432673:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993583488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986642.432719:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993583488:12345-0@lo:400:kworker.0 Request processed in 46us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986642.432726:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1283 00000100:00080000:1.0:1788986642.432744:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986642.432774:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993583488:0@lo:400:kworker.0 00000100:00100000:2.0:1788986642.432926:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993583232:0@lo:400:kworker.0 00000100:00100000:2.0:1788986642.432954:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986642.432985:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788986642.432991:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993582848:0@lo:400:kworker.0 00000100:00100000:2.0:1788986642.433015:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986642.433037:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993583360:0@lo:400:kworker.0 00000100:00100000:2.0:1788986642.433057:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986642.433084:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993583104 00000100:00100000:2.0:1788986642.433106:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993583104 00000100:00100000:2.0:1788986642.433140:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993582976 00000100:00100000:2.0:1788986642.433143:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993582976 00000100:00100000:2.0:1788986642.433158:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993583360 00000100:00100000:2.0:1788986642.433160:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993583360 00000100:00100000:2.0:1788986642.433175:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1723 00000100:00100000:2.0:1788986642.433181:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993583104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986642.433218:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993583104:12345-0@lo:400:kworker.0 Request processed in 38us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986642.433224:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1723 00000100:00100000:2.0:1788986642.433237:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1724 00000100:00100000:2.0:1788986642.433243:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993582976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986642.433269:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993582976:12345-0@lo:400:kworker.0 Request processed in 27us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986642.433274:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1724 00000100:00100000:2.0:1788986642.433286:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1725 00000100:00100000:2.0:1788986642.433291:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993583360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986642.433322:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993583360:12345-0@lo:400:kworker.0 Request processed in 31us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986642.433327:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1725 00000100:00100000:2.0:1788986642.433359:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993582848 00000100:00100000:2.0:1788986642.433363:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993582848 00000100:00100000:2.0:1788986642.433385:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:2.0:1788986642.433390:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993582848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986642.433420:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993582848:12345-0@lo:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986642.433426:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00080000:2.0:1788986642.433455:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986642.433471:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993582848:0@lo:400:kworker.0 00000100:00100000:2.0:1788986642.433481:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993583360:0@lo:400:kworker.0 00000100:00100000:2.0:1788986642.433505:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993582976:0@lo:400:kworker.0 00000100:00100000:2.0:1788986642.433514:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993583104:0@lo:400:kworker.0 00000100:00100000:1.0:1788986642.433777:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993583232 00000100:00100000:1.0:1788986642.433782:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993583232 00000100:00100000:1.0:1788986642.433822:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1284 00000100:00100000:1.0:1788986642.433829:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993583232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986642.433897:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993583232:12345-0@lo:400:kworker.0 Request processed in 61us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986642.433904:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1284 00000100:00100000:3.0:1788986642.434171:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993583232:0@lo:400:kworker.0 00000100:00100000:1.0:1788986642.962293:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993583616:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986642.962361:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986642.962434:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993583616 00000100:00100000:1.0:1788986642.962442:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993583616 00000100:00100000:1.0:1788986642.962488:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1788986642.962498:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993583616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986642.962528:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986642.962576:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993583616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986642.962583:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 875 00000100:00100000:1.0:1788986642.962629:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993583616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986643.393837:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986644.029743:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986644.029917:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971375872 00000100:00100000:2.0:1788986644.029926:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971375872 00000100:00100000:2.0:1788986644.029999:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 995 00000100:00100000:2.0:1788986644.030009:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53904:x1875885971375872:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986644.030032:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986644.030053:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5497ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d145d expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030139:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5497c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030154:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5497c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030166:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5497c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030178:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5497c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030184:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5497c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030190:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5497c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030467:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5497cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030480:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5497cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030488:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5497cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986644.030510:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:2.0:1788986644.030514:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986644.030534:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5497cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030545:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5497c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030551:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5497c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030558:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5497c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030564:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986644.030567:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5497c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030575:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5497c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030586:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:2.0:1788986644.030589:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986644.030594:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5497c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030605:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf5497c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030615:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5497c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030621:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5497c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030627:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5497c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030632:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986644.030635:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5497c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030641:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5497c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030649:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986644.030652:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986644.030655:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5497c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030660:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf5497c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030688:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf5497ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d145d expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030703:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5497cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d145d expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.030711:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:2.0:1788986644.030713:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986644.030716:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1600, rc 0) 00000100:00100000:2.0:1788986644.030764:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53904:x1875885971375872:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 756us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986644.030771:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 995 00000100:00080000:1.0:1788986644.030935:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986644.033653:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986644.036575:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971376128 00000100:00100000:1.0:1788986644.036589:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971376128 00000100:00100000:1.0:1788986644.036639:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 996 00000100:00100000:1.0:1788986644.036649:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53904:x1875885971376128:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:1.0:1788986644.036669:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986644.036686:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5497d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1464 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986644.036956:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5497dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986644.036971:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5497dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986644.036982:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5497dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986644.036999:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5497e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986644.037006:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5497e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986644.037013:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5497e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986644.040301:0:15241:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x20:0x0], index 0: 0 00010000:00010000:0.0:1788986644.040596:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5497eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.040612:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5497eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.040623:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5497eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.040657:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5497dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.040665:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5497dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.040671:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5497dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.040677:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986644.040681:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5497dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.040693:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5497dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.040703:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:0.0:1788986644.040706:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986644.040711:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5497dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.040716:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf5497dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986644.040742:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000120ef44 reply state 000000005b1ddaca transno 4294967672 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5497e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986644.040751:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788986644.040785:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5497d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1464 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.040800:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5497eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1464 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.040808:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9b0a4823bd00) 00010000:00010000:0.0:1788986644.040810:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986644.040812:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eee00, rc 0) 00000100:00100000:0.0:1788986644.040888:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:53904:x1875885971376128:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 4239us (7242us total) trans 4294967672 rc 0/0 00000100:00100000:0.0:1788986644.040896:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 996 00000100:00100000:3.0:1788986644.055412:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:3.0:1788986644.055443:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5497e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.055459:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5497e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.055466:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5497e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.055473:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986644.055477:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5497e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.055484:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5497e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.055499:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a45316600) 00010000:00010000:3.0:1788986644.055502:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986644.055506:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5497e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.055512:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf5497e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986644.055548:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971376384 00000100:00100000:3.0:1788986644.055557:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971376384 00000100:00100000:3.0:1788986644.055600:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 997 00000100:00100000:3.0:1788986644.055608:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:53904:x1875885971376384:12345-192.168.206.21@tcp:36:touch.60003 00010000:00010000:3.0:1788986644.055660:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986644.055677:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf5497eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1464 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.055693:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9b0a4823bd00) 00010000:00010000:3.0:1788986644.055700:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986644.055739:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5497f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.055751:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5497f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.055761:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5497f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986644.055948:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002cd0fe79 reply state 0000000086e41915 transno 4294967673 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5497f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986644.055956:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986644.056041:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:53904:x1875885971376384:12345-192.168.206.21@tcp:36:touch.60003 Request processed in 433us (637us total) trans 4294967673 rc 0/0 00000100:00100000:3.0:1788986644.056047:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 997 00000100:00100000:3.0:1788986644.062838:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:3.0:1788986644.062888:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5497f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.062901:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5497f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.062909:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5497f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.062916:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986644.062921:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5497f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.062929:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5497f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.062944:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986644.062947:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986644.062952:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5497f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.062958:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf5497f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986644.063113:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971376512 00000100:00100000:0.0:1788986644.063123:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971376512 00000100:00100000:0.0:1788986644.063168:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 998 00000100:00100000:0.0:1788986644.063178:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:53904:x1875885971376512:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788986644.063198:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986644.063215:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549800 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d146b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.063265:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549800 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d146b expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.063278:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549800 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d146b expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.063295:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:0.0:1788986644.063298:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788986644.063300:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788986644.063362:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:53904:x1875885971376512:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 184us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986644.063369:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 998 00000100:00100000:3.0:1788986644.068048:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986644.068082:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971376640 00000100:00100000:3.0:1788986644.070222:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971376640 00000100:00100000:3.0:1788986644.070823:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 544 00000100:00100000:3.0:1788986644.070836:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971376640:12345-192.168.206.21@tcp:2:touch.60003 00000100:00100000:3.0:1788986644.071150:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971376640:12345-192.168.206.21@tcp:2:touch.60003 Request processed in 316us (3109us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788986644.071159:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 544 00000100:00080000:3.0:1788986644.079429:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986644.086590:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986644.086769:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971376896 00000100:00100000:1.0:1788986644.086778:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971376896 00000100:00100000:1.0:1788986644.086830:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 98 00000100:00100000:1.0:1788986644.086840:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:53904:x1875885971376896:12345-192.168.206.21@tcp:35:touch.60003 00000100:00100000:0.0:1788986644.087325:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:53904:x1875885971376896:12345-192.168.206.21@tcp:35:touch.60003 Request processed in 485us (742us total) trans 4294967674 rc 0/0 00000100:00100000:0.0:1788986644.087335:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 98 00000100:00100000:3.0:1788986644.142166:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986644.142338:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971377024 00000100:00100000:0.0:1788986644.142348:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971377024 00000100:00100000:0.0:1788986644.142418:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 999 00000100:00100000:0.0:1788986644.142428:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:53908:x1875885971377024:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:0.0:1788986644.142454:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986644.142473:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549807 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1472 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142531:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54980e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142545:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54980e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142557:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54980e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142573:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549815 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142579:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142587:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142666:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54981c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142674:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54981c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142681:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54981c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986644.142710:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x52:0x0]: returning size 0 00000004:00200000:0.0:1788986644.142714:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986644.142732:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54981c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142744:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54981c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142753:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54980e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142759:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54980e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142767:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54980e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142773:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986644.142777:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54980e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142785:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54980e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142796:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:0.0:1788986644.142799:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986644.142804:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54980e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142811:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54980e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142824:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549815 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142835:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549815 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142841:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142846:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986644.142850:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549815 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142867:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549815 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142876:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a4823b800) 00010000:00010000:0.0:1788986644.142879:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986644.142882:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549815 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142889:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549815 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142916:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549807 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1472 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142927:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54981c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1472 expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986644.142935:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:0.0:1788986644.142937:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986644.142940:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986644.142998:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:53908:x1875885971377024:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 571us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986644.143005:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 999 00000100:00100000:3.0:1788986644.147542:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986644.147619:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971377152 00000100:00100000:1.0:1788986644.147630:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971377152 00000100:00100000:1.0:1788986644.147685:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 545 00000100:00100000:1.0:1788986644.147696:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971377152:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:1.0:1788986644.147713:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986644.147734:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002a7404e9/0xc20d828fcf549823 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1479 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788986644.147761:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x6aa1c513, atime: 0x6aa1c513, ctime: 0x6aa1c513, blocks: 0x1 00010000:00010000:1.0:1788986644.147780:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=2428s v=(0 0) 00010000:00010000:1.0:1788986644.147785:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986644.147793:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002a7404e9/0xc20d828fcf549823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1479 expref: 7 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986644.147817:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002a7404e9/0xc20d828fcf549823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1479 expref: 7 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986644.147829:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986644.147935:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971377152:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 241us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986644.147941:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 545 00000100:00100000:3.0:1788986644.153945:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986644.154066:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971377408 00000100:00100000:2.0:1788986644.154076:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971377408 00000100:00100000:2.0:1788986644.154170:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1000 00000100:00100000:2.0:1788986644.154180:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:53908:x1875885971377408:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:2.0:1788986644.154228:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986644.154375:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54981c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x52:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1472 expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.154397:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549800 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x52:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d146b expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.154406:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:2.0:1788986644.154415:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986644.154435:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54982a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.154448:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54982a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.154457:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54982a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.154470:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549831 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.154478:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.154485:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.154578:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549838 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.154587:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549838 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.154594:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549838 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986644.162079:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].32, 64 off10240 00000004:00080000:2.0:1788986644.162126:0:7899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2428065036393ns, next at 2429065032244ns, rc = 0 00010000:00010000:2.0:1788986644.162225:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54983f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163398:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54983f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163417:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54983f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163426:0:7899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54983f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163677:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54983f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163685:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54983f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163758:0:7899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986644.163785:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549838 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163791:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549838 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163798:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549838 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163804:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986644.163808:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549838 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163816:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549838 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163828:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986644.163832:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986644.163836:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549838 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163843:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549838 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x52:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163876:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54982a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163884:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54982a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163890:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54982a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163896:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986644.163899:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54982a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163904:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54982a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163912:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:2.0:1788986644.163914:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986644.163917:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54982a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986644.163923:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54982a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986644.163933:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000009cb19459 reply state 00000000053bd82e transno 4294967675 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986644.163942:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986644.164036:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:53908:x1875885971377408:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 9853us (10095us total) trans 4294967675 rc 0/0 00000100:00100000:2.0:1788986644.164045:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1000 00010000:00010000:3.0:1788986644.166725:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986644.166739:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54983f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.166753:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986644.166756:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54983f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.166765:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54983f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.166781:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x52:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:3.0:1788986644.166784:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986644.166789:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54983f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.166795:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54983f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x52:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.166818:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986644.166820:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986644.166822:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986644.167183:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549831 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.167194:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549831 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.167201:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.167207:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986644.167211:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549831 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.167223:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549831 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.167232:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a45acac00) 00010000:00010000:3.0:1788986644.167235:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986644.167239:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549831 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986644.167317:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549831 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986644.419670:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788986644.569546:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967360 is committed 00000100:00100000:3.0:1788986644.592439:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986644.592482:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986644.592539:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971377664 00000100:00100000:0.0:1788986644.592549:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971377664 00000100:00100000:2.0:1788986644.592560:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971377536 00000100:00100000:2.0:1788986644.592567:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971377536 00000100:00100000:2.0:1788986644.592613:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1344 00000100:00100000:0.0:1788986644.592626:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1285 00000100:00100000:2.0:1788986644.592627:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971377536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986644.592640:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971377664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986644.592750:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971377664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 110us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986644.592755:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971377536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 123us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986644.592761:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1285 00000100:00100000:2.0:1788986644.592769:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1344 00000100:00080000:3.0:1788986644.593489:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788986645.028477:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967672 is committed 00000001:00080000:1.0:1788986645.028493:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967674 is committed 00000001:00080000:1.0:1788986645.028500:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967675 is committed 00000004:00080000:1.0:1788986645.028504:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 86 committed 00000100:00100000:3.0:1788986645.028833:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993583744:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788986645.028922:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986645.028950:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993583744 00000100:00100000:2.0:1788986645.028956:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993583744 00000100:00080000:0.0:1788986645.029003:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986645.029022:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1788986645.029031:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993583744:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788986645.029055:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:32 count 1 00010000:00010000:2.0:1788986645.029079:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986645.029125:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002a7404e9/0xc20d828fcf549823 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1479 expref: 5 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986645.029135:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986645.029140:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986645.029145:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986645.029170:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002a7404e9/0xc20d828fcf549823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1479 expref: 5 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986645.029197:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002a7404e9/0xc20d828fcf549823 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1479 expref: 5 pid: 8478 timeout: 2528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986645.029214:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875885993583872:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986645.029279:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b66c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788986645.034700:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986645.034965:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875885993583872:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788986645.034990:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986645.035065:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971377792 00000100:00100000:0.0:1788986645.035072:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971377792 00010000:00010000:0.0:1788986645.035221:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002a7404e9/0xc20d828fcf549823 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1479 expref: 6 pid: 8478 timeout: 2528 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986645.035254:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 424 00000100:00100000:0.0:1788986645.035264:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a5abf2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971377792:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986645.035278:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986645.035284:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002a7404e9/0xc20d828fcf549823 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1479 expref: 6 pid: 8478 timeout: 2528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986645.035297:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002a7404e9/0xc20d828fcf549823 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1479 expref: 6 pid: 8478 timeout: 2528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986645.035384:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002a7404e9/0xc20d828fcf549823 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1479 expref: 6 pid: 8478 timeout: 2528 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986645.035404:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986645.035409:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986645.035414:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986645.035424:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986645.035447:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986645.035492:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a5abf2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971377792:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 230us (801us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986645.035500:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 424 00010000:00010000:2.0:1788986645.035586:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986645.035595:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986645.035605:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986645.035613:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986645.035634:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788986645.036130:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986645.036138:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986645.036148:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986645.036152:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986645.036163:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986645.036183:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986645.036191:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000824ca14/0xc20d828fcf549846 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986645.036255:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986645.036259:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986645.036260:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986645.036788:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993583744:12345-0@lo:6:osp-syn-0-0.0 Request processed in 7756us (7863us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1788986645.036797:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000004:00080000:3.0:1788986645.036869:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a79795c00/2, rc 0, transno 4294967361 00000100:00100000:3.0:1788986645.036876:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993583744:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788986645.440415:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788986646.163899:0:91669:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb423eb40 20000000:00000080:1.0:1788986646.163916:0:91669:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76061000 uarg=0000000000000000 00010000:00010000:1.0:1788986646.164990:0:91669:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788986646.165026:0:91669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:1.0:1788986646.165030:0:91669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986646.165040:0:91669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf5497cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d145d expref: 5 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.165060:0:91669:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1788986646.165075:0:91669:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986646.165106:0:91669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.165119:0:91669:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497b3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5497ac expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.165127:0:91669:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.165162:0:91669:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5497ac expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.165176:0:91669:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497b3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5497ac expref: 18 pid: 5848 timeout: 2530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986646.165189:0:91669:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91669:1875885993584000:0@lo:104: 00000100:00100000:1.0:1788986646.165244:0:91669:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986646.165342:0:91669:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a6b2f9000 going to sleep for 11 seconds 00000100:00100000:2.0:1788986646.167666:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993584000 00000100:00100000:2.0:1788986646.167677:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993584000 00000100:00100000:2.0:1788986646.167733:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:2.0:1788986646.167890:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:91669:x1875885993584000:12345-0@lo:104: 00010000:00010000:2.0:1788986646.167905:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5497b3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986646.168041:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986646.168048:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:91669:x1875885993584000:12345-0@lo:104: Request processed in 162us (2804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986646.168055:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788986646.168300:0:91669:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91669:1875885993584000:0@lo:104: 00010000:00010000:1.0:1788986646.168322:0:91669:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986646.169318:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986646.169326:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5497b3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986646.169335:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986646.169339:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5497b3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986646.169349:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5497b3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986646.169357:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5497b3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986646.169362:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986646.169405:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5497b3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986646.169411:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986646.169444:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5497b3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986646.169452:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5497ac lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5497b3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986646.169468:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986646.169470:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986646.169471:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986646.169537:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993584128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986646.169585:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986646.169727:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993584128 00000100:00100000:1.0:1788986646.169733:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993584128 00010000:00010000:1.0:1788986646.169822:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497b3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5497ac expref: 19 pid: 5848 timeout: 2530 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986646.169864:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1788986646.169872:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993584128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986646.169885:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986646.169890:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497b3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5497ac expref: 19 pid: 5848 timeout: 2530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.169900:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5497ac expref: 19 pid: 5848 timeout: 2530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.169913:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf5497b3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5497ac expref: 19 pid: 5848 timeout: 2530 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.169926:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.169934:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.169948:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.169955:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.169963:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.169969:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.169974:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986646.169978:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.169990:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.170009:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.170017:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986646.170057:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993584128:12345-0@lo:103:ldlm_bl.0 Request processed in 186us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986646.170064:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00000100:00100000:0.0:1788986646.170162:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993584128:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986646.170249:0:91669:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986646.170258:0:91669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986646.170264:0:91669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54984d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986646.467912:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986646.529196:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986646.529220:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993584256:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986646.529292:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986646.529359:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993584256 00000100:00100000:3.0:1788986646.529366:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993584256 00000100:00100000:3.0:1788986646.529413:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 876 00000100:00100000:3.0:1788986646.529433:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993584256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986646.529468:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986646.529515:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993584256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986646.529522:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 876 00000100:00100000:3.0:1788986646.529571:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993584256:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986647.488228:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986647.552578:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8099a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993584640:0@lo:400:kworker.0 00000100:00100000:0.0:1788986647.552635:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986647.552690:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788986647.552696:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993584512:0@lo:400:kworker.0 00000100:00100000:0.0:1788986647.552716:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986647.552732:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993585024:0@lo:400:kworker.0 00000100:00100000:0.0:1788986647.552755:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986647.552762:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993584384:0@lo:400:kworker.0 00000100:00100000:0.0:1788986647.552784:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993584640 00000100:00100000:0.0:1788986647.552791:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993584640 00000100:00100000:3.0:1788986647.552804:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986647.552850:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993584896:0@lo:400:kworker.0 00000100:00100000:0.0:1788986647.552856:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993584512 00000100:00100000:0.0:1788986647.552860:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993584512 00000100:00100000:3.0:1788986647.552880:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986647.552887:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1726 00000100:00100000:0.0:1788986647.552897:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993584640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986647.552903:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986647.552911:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993584768:0@lo:400:kworker.0 00000100:00100000:3.0:1788986647.552943:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986647.552954:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993584640:12345-0@lo:400:kworker.0 Request processed in 57us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986647.552965:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1726 00000100:00100000:3.0:1788986647.552977:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993584384 00000100:00100000:0.0:1788986647.552982:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993584896 00000100:00100000:3.0:1788986647.552983:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993584384 00000100:00100000:0.0:1788986647.552988:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993584896 00000100:00100000:0.0:1788986647.553011:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1727 00000100:00100000:0.0:1788986647.553019:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993584512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986647.553023:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:3.0:1788986647.553034:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993584384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986647.553049:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993584512:12345-0@lo:400:kworker.0 Request processed in 31us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986647.553055:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1727 00000100:00100000:0.0:1788986647.553068:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1728 00000100:00100000:0.0:1788986647.553074:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993584896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986647.553158:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993585024 00000100:00100000:1.0:1788986647.553162:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993585024 00000100:00100000:1.0:1788986647.553186:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993584768 00000100:00100000:1.0:1788986647.553189:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993584768 00000100:00100000:0.0:1788986647.557172:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993584896:12345-0@lo:400:kworker.0 Request processed in 4090us (4284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986647.557185:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1728 00000100:00080000:0.0:1788986647.557226:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986647.557230:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986647.557234:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986647.557273:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993584512:0@lo:400:kworker.0 00000100:00100000:0.0:1788986647.557284:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8099a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993584640:0@lo:400:kworker.0 00000100:00100000:1.0:1788986647.557564:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1788986647.557580:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993585024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986647.557642:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993585024:12345-0@lo:400:kworker.0 Request processed in 70us (4886us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986647.557648:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1286 00000100:00100000:1.0:1788986647.557661:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1287 00000100:00100000:1.0:1788986647.557666:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993584768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986647.557691:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993584768:12345-0@lo:400:kworker.0 Request processed in 25us (4748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986647.557696:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1287 00000100:00100000:0.0:1788986647.557976:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993585024:0@lo:400:kworker.0 00000100:00100000:0.0:1788986647.558011:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993584768:0@lo:400:kworker.0 00000100:00100000:3.0:1788986647.562698:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993584384:12345-0@lo:400:kworker.0 Request processed in 9657us (9885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986647.562713:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1788986647.565815:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993584384:0@lo:400:kworker.0 00000100:00100000:0.0:1788986647.565836:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993584896:0@lo:400:kworker.0 10000000:01000000:2.0:1788986647.616273:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986647.616280:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986647.616284:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986647.616332:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986647.616344:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986647.616355:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986647.616379:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993585152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986647.616438:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986647.616482:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a43fb2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788986647.616534:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993585152 00000100:00100000:1.0:1788986647.616540:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993585152 00000100:00100000:1.0:1788986647.616588:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:1.0:1788986647.616596:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993585152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986647.616609:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986647.616622:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54985b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549854 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986647.616643:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54985b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549854 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986647.616653:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54985b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549854 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986647.616662:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788986647.616709:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993585152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986647.616715:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:3.0:1788986647.616807:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993585152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986647.616819:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54985b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986647.616829:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54985b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986647.616855:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986647.616860:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54985b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986647.616868:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54985b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986648.068567:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986648.068588:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993585280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986648.068648:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986648.068749:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993585280 00000100:00100000:3.0:1788986648.068757:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993585280 00000100:00100000:3.0:1788986648.068807:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 877 00000100:00100000:3.0:1788986648.068816:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993585280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986648.068858:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986648.068906:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993585280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986648.068914:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 877 00000100:00100000:3.0:1788986648.069028:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993585280:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986648.521340:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986649.538901:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788986649.679722:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967361 is committed 00000100:00100000:1.0:1788986649.720475:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986649.720524:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986649.720553:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986649.720579:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986649.720609:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971378176 00000100:00100000:1.0:1788986649.720618:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971378176 00000100:00100000:2.0:1788986649.720685:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971378304 00000100:00100000:2.0:1788986649.720689:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971378304 00000100:00100000:3.0:1788986649.720729:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971377920 00000100:00100000:3.0:1788986649.720733:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971377920 00000100:00100000:3.0:1788986649.720775:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1347 00000100:00100000:3.0:1788986649.720785:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971377920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986649.720858:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971377920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 74us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986649.720870:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1347 00000100:00100000:3.0:1788986649.725150:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971378048 00000100:00100000:3.0:1788986649.725161:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971378048 00000100:00100000:1.0:1788986649.726974:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1288 00000100:00100000:1.0:1788986649.726987:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971378176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986649.727061:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971378176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 76us (6535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986649.727067:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1288 00000100:00100000:2.0:1788986649.734597:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1289 00000100:00100000:2.0:1788986649.734613:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971378304:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986649.734689:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971378304:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 81us (14109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986649.734696:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1289 00000100:00100000:3.0:1788986649.742252:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1729 00000100:00100000:3.0:1788986649.742268:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971378048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986649.742348:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971378048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (21794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986649.742356:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1729 00000100:00080000:1.0:1788986649.746183:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986649.746259:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986649.746263:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986649.832610:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986649.832675:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971378432 00000100:00100000:0.0:1788986649.832684:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971378432 00000100:00100000:0.0:1788986649.832742:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1001 00000100:00100000:0.0:1788986649.832752:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:53996:x1875885971378432:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986649.832770:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986649.832790:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf549862 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1480 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986649.832864:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549869 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986649.832877:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986649.832890:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986649.832921:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:0.0:1788986649.832924:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986649.832941:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549869 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986649.832965:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf549862 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1480 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986649.832984:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549869 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1480 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986649.832998:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986649.833001:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986649.833004:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efe00, rc 0) 00000100:00100000:0.0:1788986649.833057:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53996:x1875885971378432:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 306us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986649.833065:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1001 00000100:00100000:0.0:1788986649.836361:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986649.836547:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971378688 00000100:00100000:1.0:1788986649.836555:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971378688 00000100:00100000:1.0:1788986649.836636:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1002 00000100:00100000:1.0:1788986649.836646:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53996:x1875885971378688:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986649.836689:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986649.836723:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549869 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1480 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986649.836738:0:5856:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf5497cf) 00010000:00010000:1.0:1788986649.836742:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:1.0:1788986649.836751:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986649.836773:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549870 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986649.836786:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986649.836795:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788986649.884953:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967676 is committed 00000004:00010000:2.0:1788986649.885010:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e8816d37 reply state 000000007433f1d7 transno 4294967676 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986649.885022:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986649.885035:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00010000:00080000:2.0:1788986649.885239:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788986649.885259:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:53996:x1875885971378688:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 48610us (48958us total) trans 4294967676 rc 0/0 00000100:00100000:2.0:1788986649.885268:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1002 00010000:00010000:3.0:1788986649.885337:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549870 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986649.885345:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549870 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986649.885352:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549870 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986649.885359:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986649.885363:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549870 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986649.885370:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549870 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986649.885384:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:3.0:1788986649.885387:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986649.885391:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549870 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986649.885402:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549870 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.560274:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788986650.765740:0:91867:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda94f05a0 20000000:00000080:1.0:1788986650.765757:0:91867:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7663a400 uarg=0000000000000000 00010000:00010000:1.0:1788986650.766327:0:91867:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788986650.766344:0:91867:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788986650.766356:0:91867:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986650.766373:0:91867:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986650.766405:0:91867:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54985b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549854 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986650.766413:0:91867:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986650.766449:0:91867:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54985b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549854 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986650.766462:0:91867:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54985b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549854 expref: 18 pid: 5849 timeout: 2534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986650.766475:0:91867:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91867:1875885993585408:0@lo:104: 00000100:00100000:1.0:1788986650.766531:0:91867:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986650.766597:0:91867:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788986650.766886:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993585408 00000100:00100000:3.0:1788986650.766894:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993585408 00000100:00100000:3.0:1788986650.766946:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:3.0:1788986650.766955:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:91867:x1875885993585408:12345-0@lo:104: 00010000:00010000:3.0:1788986650.766968:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54985b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986650.767031:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986650.767038:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:91867:x1875885993585408:12345-0@lo:104: Request processed in 84us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986650.767044:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00010000:00010000:2.0:1788986650.767083:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986650.767112:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54985b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767120:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986650.767124:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54985b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767132:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54985b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986650.767140:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54985b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986650.767151:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986650.767183:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54985b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767190:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986650.767217:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54985b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767225:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1e00/0xc20d828fcf549854 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54985b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767251:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986650.767253:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986650.767256:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986650.767273:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986650.767285:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993585536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986650.767329:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986650.767529:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993585536 00000100:00100000:2.0:1788986650.767534:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993585536 00010000:00010000:2.0:1788986650.767555:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54985b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549854 expref: 19 pid: 5849 timeout: 2534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986650.767584:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:2.0:1788986650.767592:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993585536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986650.767603:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986650.767608:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54985b lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549854 expref: 19 pid: 5849 timeout: 2534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767619:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54985b lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549854 expref: 19 pid: 5849 timeout: 2534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767634:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767642:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767656:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767663:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767671:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767678:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767684:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986650.767688:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767696:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767705:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986650.767715:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986650.767762:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993585536:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986650.767769:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1788986650.767897:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993585536:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986650.768082:0:91867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54985b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549854 expref: 18 pid: 5849 timeout: 2534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986650.768120:0:91867:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:91867:1875885993585408:0@lo:104: 00010000:00010000:1.0:1788986650.768136:0:91867:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986650.768145:0:91867:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986650.768152:0:91867:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986650.768158:0:91867:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549877 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 91867 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986651.587511:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986651.649374:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986651.649404:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993585664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986651.649489:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986651.649567:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993585664 00000100:00100000:3.0:1788986651.649576:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993585664 00000100:00100000:3.0:1788986651.649652:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 878 00000100:00100000:3.0:1788986651.649662:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993585664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986651.649721:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986651.649776:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993585664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986651.649784:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 878 00000100:00100000:3.0:1788986651.649845:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967361 gen 2 00000004:00080000:3.0:1788986651.649852:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a79795c00, transno 4294967361 00000100:00100000:3.0:1788986651.649876:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993585664:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986651.652408:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:3.0:1788986652.119893:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986652.119903:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986652.119910:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986652.119972:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986652.119987:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986652.120001:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986652.120034:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993585792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986652.120149:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986652.120441:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a44db36c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788986652.120469:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993585792 00000100:00100000:3.0:1788986652.120478:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993585792 00000100:00100000:3.0:1788986652.120536:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1788986652.120546:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993585792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986652.120563:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986652.120578:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549885 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54987e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986652.120606:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549885 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54987e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986652.120618:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549885 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54987e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986652.120633:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788986652.120676:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993585792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986652.120683:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1348 00000100:00100000:3.0:1788986652.120738:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993585792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986652.120754:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986652.120763:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986652.120785:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986652.120790:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986652.120798:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986652.610930:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986652.674441:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993585920:0@lo:400:kworker.0 00000100:00100000:2.0:1788986652.674590:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986652.674937:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993586048:0@lo:400:kworker.0 00000100:00100000:1.0:1788986652.674967:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986652.674992:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986652.674997:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993586432:0@lo:400:kworker.0 00000100:00100000:1.0:1788986652.675021:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986652.675043:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993586176:0@lo:400:kworker.0 00000100:00100000:1.0:1788986652.675064:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986652.675080:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986652.675084:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993586304:0@lo:400:kworker.0 00000100:00100000:1.0:1788986652.675120:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986652.675151:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993585920 00000100:00100000:1.0:1788986652.675159:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993585920 00000100:00100000:1.0:1788986652.675205:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993586048 00000100:00100000:1.0:1788986652.675208:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993586048 00000100:00100000:3.0:1788986652.675589:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993586304 00000100:00100000:3.0:1788986652.675594:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993586304 00000100:00100000:1.0:1788986652.675652:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1730 00000100:00100000:1.0:1788986652.675661:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993585920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986652.675717:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993585920:12345-0@lo:400:kworker.0 Request processed in 57us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986652.675724:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1730 00000100:00100000:1.0:1788986652.675741:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1731 00000100:00100000:1.0:1788986652.675746:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993586048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986652.676447:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993586048:12345-0@lo:400:kworker.0 Request processed in 700us (1478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986652.676454:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1731 00000100:00100000:1.0:1788986652.676550:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993586432 00000100:00100000:1.0:1788986652.676556:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993586432 00000100:00100000:2.0:1788986652.676657:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993585920:0@lo:400:kworker.0 00000100:00100000:3.0:1788986652.686105:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1732 00000100:00100000:3.0:1788986652.686119:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993586304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986652.686207:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993586304:12345-0@lo:400:kworker.0 Request processed in 91us (11085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986652.686214:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1732 00000100:00080000:3.0:1788986652.686242:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986652.686315:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993586304:0@lo:400:kworker.0 00000100:00100000:1.0:1788986652.691044:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993586176 00000100:00100000:1.0:1788986652.691057:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993586176 00000100:00100000:1.0:1788986652.691105:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1290 00000100:00100000:1.0:1788986652.691117:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993586432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986652.691231:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993586432:12345-0@lo:400:kworker.0 Request processed in 116us (16207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986652.691238:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1290 00000100:00100000:1.0:1788986652.691254:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1291 00000100:00100000:1.0:1788986652.691260:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993586176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986652.691293:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993586176:12345-0@lo:400:kworker.0 Request processed in 34us (16228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986652.691299:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1291 00000100:00100000:1.0:1788986652.691398:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993586176:0@lo:400:kworker.0 00000100:00100000:1.0:1788986652.691436:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993586432:0@lo:400:kworker.0 00000100:00100000:1.0:1788986652.691449:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993586048:0@lo:400:kworker.0 00000100:00080000:0.0:1788986652.693576:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986653.184320:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993586560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986653.184386:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986653.184533:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993586560 00000100:00100000:3.0:1788986653.184542:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993586560 00000100:00100000:3.0:1788986653.184591:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 879 00000100:00100000:3.0:1788986653.184602:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993586560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986653.184640:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986653.184698:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993586560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986653.184705:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 879 00000100:00100000:2.0:1788986653.184785:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993586560:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986653.637823:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986654.175338:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986654.175968:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971378816 00000100:00100000:3.0:1788986654.175982:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971378816 00000100:00100000:3.0:1788986654.176072:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1003 00000100:00100000:3.0:1788986654.176084:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54072:x1875885971378816:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:3.0:1788986654.176140:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986654.176170:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54988c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1487 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.176250:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549893 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.176265:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549893 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.176389:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549893 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.176405:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54989a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.176418:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54989a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.176424:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54989a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177030:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5498a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177042:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5498a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177051:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5498a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986654.177080:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:3.0:1788986654.177084:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000100:00080000:0.0:1788986654.177208:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:3.0:1788986654.177357:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5498a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177374:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549893 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177382:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549893 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177389:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549893 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177397:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986654.177402:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549893 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177411:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549893 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177425:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:3.0:1788986654.177429:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986654.177505:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549893 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177514:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549893 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177533:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54989a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177539:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54989a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177546:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54989a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177552:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986654.177555:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54989a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177561:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54989a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177569:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a55745700) 00010000:00010000:3.0:1788986654.177572:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986654.177575:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54989a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177586:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54989a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177630:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54988c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1487 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177650:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5498a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1487 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986654.177793:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745b00) 00010000:00010000:3.0:1788986654.177797:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986654.177801:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2a00, rc 0) 00000100:00100000:3.0:1788986654.177949:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54072:x1875885971378816:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 1866us (2624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986654.177959:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1003 00010000:00010000:3.0:1788986654.658959:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986654.835187:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986654.835236:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986654.835327:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971379072 00000100:00100000:1.0:1788986654.835334:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986654.835345:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971379072 00000100:00100000:3.0:1788986654.835409:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1733 00000100:00100000:3.0:1788986654.835420:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971379072:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986654.835520:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971379072:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 101us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986654.835540:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1733 00000100:00100000:0.0:1788986654.835569:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971379328 00000100:00100000:0.0:1788986654.835580:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971379328 00000100:00100000:3.0:1788986654.835581:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971378944 00000100:00100000:3.0:1788986654.835590:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971378944 00000100:00100000:3.0:1788986654.835623:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1349 00000100:00100000:3.0:1788986654.835632:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971378944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986654.835655:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 547 00000100:00100000:3.0:1788986654.835679:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971378944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 46us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986654.835682:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971379328:12345-192.168.206.21@tcp:9:kworker.0 00000100:00100000:3.0:1788986654.835692:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1349 00000020:00000080:0.0:1788986654.835724:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54970b 00000100:00080000:0.0:1788986654.835739:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9b094195f800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788986654.836225:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788986654.836289:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967359 00000100:00100000:0.0:1788986654.836664:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971379328:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 997us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986654.836680:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 547 00000100:00080000:0.0:1788986654.836705:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986654.846692:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986654.847028:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971379200 00000100:00100000:0.0:1788986654.847041:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971379200 00000100:00080000:3.0:1788986654.847133:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986654.847175:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1292 00000100:00100000:0.0:1788986654.847189:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971379200:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986654.847275:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971379200:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 90us (605us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986654.847283:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1292 00010000:00010000:3.0:1788986655.681455:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788986656.070041:0:92113:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec2df2a00 20000000:00000080:0.0:1788986656.070059:0:92113:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a79740000 uarg=0000000000000000 00010000:00010000:0.0:1788986656.070528:0:92113:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788986656.070560:0:92113:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745b00) 00010000:00010000:0.0:1788986656.070564:0:92113:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986656.070574:0:92113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf5498a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1487 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986656.070595:0:92113:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1788986656.070609:0:92113:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986656.070623:0:92113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986656.070635:0:92113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549885 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54987e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986656.070644:0:92113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986656.070678:0:92113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549885 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54987e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986656.070697:0:92113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549885 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54987e expref: 18 pid: 5846 timeout: 2539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986656.070710:0:92113:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92113:1875885993586688:0@lo:104: 00000100:00100000:0.0:1788986656.070766:0:92113:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986656.070831:0:92113:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a52ecaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788986656.071023:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993586688 00000100:00100000:3.0:1788986656.071030:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993586688 00000100:00100000:3.0:1788986656.071078:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:3.0:1788986656.071107:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:92113:x1875885993586688:12345-0@lo:104: 00010000:00010000:3.0:1788986656.071121:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071177:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986656.071183:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:92113:x1875885993586688:12345-0@lo:104: Request processed in 99us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986656.071191:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00010000:00010000:3.0:1788986656.071210:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986656.071215:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071222:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986656.071226:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071234:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986656.071244:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986656.071250:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986656.071287:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071294:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986656.071314:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071320:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf54987e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549885 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071332:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986656.071334:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986656.071336:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986656.071355:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993586816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986656.071382:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986656.071415:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993586816 00000100:00100000:3.0:1788986656.071418:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993586816 00010000:00010000:3.0:1788986656.071435:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549885 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54987e expref: 19 pid: 5846 timeout: 2539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986656.071456:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1788986656.071463:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993586816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986656.071472:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986656.071476:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549885 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54987e expref: 19 pid: 5846 timeout: 2539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071486:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549885 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54987e expref: 19 pid: 5846 timeout: 2539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071500:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071507:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071519:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071526:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071532:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071538:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071543:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986656.071547:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071553:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071561:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.071572:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986656.071600:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993586816:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986656.071605:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00000100:00100000:3.0:1788986656.071638:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993586816:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986656.071883:0:92113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549885 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54987e expref: 18 pid: 5846 timeout: 2539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986656.071893:0:92113:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92113:1875885993586688:0@lo:104: 00010000:00010000:0.0:1788986656.071906:0:92113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986656.071914:0:92113:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986656.071921:0:92113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986656.071927:0:92113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf5498a8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986656.728369:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986656.770206:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986656.770229:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993586944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986656.770298:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986656.770538:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993586944 00000100:00100000:2.0:1788986656.770546:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993586944 00000100:00100000:2.0:1788986656.770623:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 880 00000100:00100000:2.0:1788986656.770633:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993586944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986656.770678:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986656.770731:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993586944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986656.770738:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 880 00000100:00080000:0.0:1788986656.773723:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986656.773800:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993586944:0@lo:13:osp-pre-0-0.0 10000000:01000000:3.0:1788986657.664342:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986657.664352:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986657.664357:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986657.664417:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986657.664429:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986657.664441:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986657.664472:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993587072:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986657.664559:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986657.665910:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76058f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788986657.669343:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993587072 00000100:00100000:0.0:1788986657.669363:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993587072 00000100:00100000:0.0:1788986657.669430:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:0.0:1788986657.669441:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993587072:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986657.669461:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986657.669484:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf5498b6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5498af expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986657.669518:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf5498b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5498af expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986657.669530:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf5498b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5498af expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986657.669540:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788986657.669633:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993587072:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (5073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986657.669642:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1788986657.669839:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993587072:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986657.669862:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5498b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986657.669873:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5498b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986657.669903:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986657.669910:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5498b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986657.669917:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5498b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986657.793232:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993587200:0@lo:400:kworker.0 00000100:00100000:0.0:1788986657.793320:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986657.793429:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993587328:0@lo:400:kworker.0 00000100:00100000:0.0:1788986657.793456:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986657.793491:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993587200 00000100:00100000:1.0:1788986657.793672:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993587328 00000100:00100000:1.0:1788986657.793682:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993587328 00000100:00100000:1.0:1788986657.793746:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1734 00000100:00100000:1.0:1788986657.793756:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993587328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986657.793827:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993587328:12345-0@lo:400:kworker.0 Request processed in 73us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986657.793834:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1734 00000100:00080000:1.0:1788986657.793855:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986657.793887:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993587328:0@lo:400:kworker.0 00000100:00100000:1.0:1788986657.793977:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986657.793987:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993587456:0@lo:400:kworker.0 00000100:00100000:1.0:1788986657.794022:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986657.794055:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993587456 00000100:00100000:1.0:1788986657.794059:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993587456 00000100:00100000:1.0:1788986657.794115:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1293 00000100:00100000:1.0:1788986657.794122:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993587456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986657.794157:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993587456:12345-0@lo:400:kworker.0 Request processed in 37us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986657.794163:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1293 00000100:00100000:1.0:1788986657.794193:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993587456:0@lo:400:kworker.0 00000100:00100000:1.0:1788986657.794223:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993587584:0@lo:400:kworker.0 00000100:00100000:1.0:1788986657.794247:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986657.794288:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993587584 00000100:00100000:1.0:1788986657.794292:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993587584 00000100:00100000:1.0:1788986657.794319:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1735 00000100:00100000:1.0:1788986657.794325:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993587584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986657.794359:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993587584:12345-0@lo:400:kworker.0 Request processed in 34us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986657.794368:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1735 00000100:00080000:1.0:1788986657.794381:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986657.794396:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993587584:0@lo:400:kworker.0 00000100:00100000:1.0:1788986657.794424:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986657.794429:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993587712:0@lo:400:kworker.0 00000100:00100000:1.0:1788986657.794451:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986657.797382:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993587200 00000100:00100000:0.0:1788986657.797482:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1736 00000100:00100000:0.0:1788986657.797492:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993587200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986657.797609:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993587200:12345-0@lo:400:kworker.0 Request processed in 118us (4289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986657.797616:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1736 00000100:00100000:0.0:1788986657.798380:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993587712 00000100:00100000:0.0:1788986657.798388:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993587712 00000100:00100000:0.0:1788986657.798438:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1788986657.798446:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993587712:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788986657.798590:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986657.798641:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993587712:12345-0@lo:400:kworker.0 Request processed in 196us (4188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986657.798649:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1294 00000100:00100000:0.0:1788986657.798779:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993587712:0@lo:400:kworker.0 00000100:00100000:0.0:1788986657.798835:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993587200:0@lo:400:kworker.0 00010000:00010000:0.0:1788986657.802326:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986658.304801:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993587840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986658.304944:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986658.305044:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993587840 00000100:00100000:2.0:1788986658.305054:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993587840 00000100:00100000:2.0:1788986658.305756:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1788986658.305770:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993587840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986658.306395:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986658.306481:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993587840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 715us (1536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986658.306490:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 881 00000100:00100000:2.0:1788986658.306561:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993587840:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986658.828192:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986659.780877:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986659.782724:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971379456 00000100:00100000:2.0:1788986659.782737:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971379456 00000100:00100000:2.0:1788986659.782822:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1004 00000100:00100000:2.0:1788986659.782832:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54159:x1875885971379456:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:2.0:1788986659.782849:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986659.782868:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5498bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d148e expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986659.782923:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5498c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986659.782941:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5498c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986659.782954:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5498c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986659.782996:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:2.0:1788986659.782999:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986659.783016:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5498c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986659.783038:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf5498bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d148e expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986659.783060:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5498c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d148e expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986659.783068:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:2.0:1788986659.783071:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986659.783075:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1a00, rc 0) 00000100:00100000:2.0:1788986659.783173:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54159:x1875885971379456:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 342us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986659.783180:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1004 00000100:00080000:1.0:1788986659.783382:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986659.789613:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986659.789690:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971379712 00000100:00100000:0.0:1788986659.789698:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971379712 00000100:00100000:0.0:1788986659.789747:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1005 00000100:00100000:0.0:1788986659.789756:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54159:x1875885971379712:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788986659.789807:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986659.789829:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf5498c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d148e expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986659.789845:0:5856:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf5498a1) 00010000:00010000:0.0:1788986659.789849:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:0.0:1788986659.789868:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986659.789890:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5498cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986659.789902:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5498cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986659.789912:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5498cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986659.790431:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000062a812f8 reply state 000000006d9d088c transno 4294967677 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5498cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986659.790441:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788986659.790448:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000100:00100000:0.0:1788986659.790509:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54159:x1875885971379712:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 754us (905us total) trans 4294967677 rc 0/0 00000100:00100000:0.0:1788986659.790517:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1005 00010000:00010000:3.0:1788986659.792458:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5498cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986659.792471:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5498cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986659.792478:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5498cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986659.792485:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986659.792489:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5498cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986659.792496:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5498cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986659.792509:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:3.0:1788986659.792512:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986659.792516:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5498cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986659.792523:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf5498cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986659.843826:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788986659.935328:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788986659.935336:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b094195c000/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788986659.935358:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff9b094195c000/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0001 00000020:00000080:1.0:1788986659.935394:0:489:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b094195f800 for lustre-OST0001 00000100:00100000:1.0:1788986659.956032:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986659.956076:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986659.956171:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971379840 00000100:00100000:0.0:1788986659.956180:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971379840 00000100:00100000:0.0:1788986659.956232:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1351 00000100:00100000:0.0:1788986659.956242:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971379840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986659.956308:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971379840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986659.956316:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1351 00000100:00100000:0.0:1788986659.956352:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971379968 00000100:00100000:0.0:1788986659.956356:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971379968 00000100:00100000:0.0:1788986659.956416:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1295 00000100:00100000:0.0:1788986659.956425:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971379968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986659.956454:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971379968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986659.956460:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1295 00000100:00080000:1.0:1788986659.956798:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788986660.394853:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967677 is committed 00000020:00000080:3.0:1788986660.543032:0:92313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffceb26c850 20000000:00000080:3.0:1788986660.543048:0:92313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511e3400 uarg=0000000000000000 00010000:00010000:3.0:1788986660.543684:0:92313:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986660.543698:0:92313:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986660.543712:0:92313:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986660.543728:0:92313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986660.543745:0:92313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf5498b6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5498af expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986660.543753:0:92313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986660.543800:0:92313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf5498b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5498af expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986660.543813:0:92313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf5498b6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5498af expref: 18 pid: 5848 timeout: 2544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986660.543825:0:92313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92313:1875885993587968:0@lo:104: 00000100:00100000:3.0:1788986660.543882:0:92313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986660.543974:0:92313:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788986660.544016:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993587968 00000100:00100000:0.0:1788986660.544022:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993587968 00000100:00100000:0.0:1788986660.544122:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 367 00000100:00100000:0.0:1788986660.544132:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:92313:x1875885993587968:12345-0@lo:104: 00010000:00010000:0.0:1788986660.544144:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5498b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986660.544429:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986660.544437:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:92313:x1875885993587968:12345-0@lo:104: Request processed in 306us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986660.544444:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 367 00010000:00010000:0.0:1788986660.544484:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986660.544491:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5498b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544499:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986660.544503:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5498b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544511:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5498b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986660.544517:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5498b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986660.544523:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986660.544561:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5498b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544567:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986660.544587:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5498b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544595:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf5498af lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5498b6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544611:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986660.544612:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986660.544614:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986660.544626:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993588096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986660.544653:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986660.544687:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993588096 00000100:00100000:0.0:1788986660.544691:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993588096 00010000:00010000:0.0:1788986660.544707:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf5498b6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5498af expref: 19 pid: 5848 timeout: 2544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986660.544729:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1788986660.544736:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993588096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986660.544745:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986660.544749:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf5498b6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5498af expref: 19 pid: 5848 timeout: 2544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544758:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf5498b6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5498af expref: 19 pid: 5848 timeout: 2544 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544782:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544790:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544804:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544811:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544817:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544829:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544835:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986660.544838:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544845:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544854:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986660.544862:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986660.544890:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993588096:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986660.544897:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00000100:00100000:0.0:1788986660.544931:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993588096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986660.545186:0:92313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf5498b6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5498af expref: 18 pid: 5848 timeout: 2544 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986660.545196:0:92313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:92313:1875885993587968:0@lo:104: 00010000:00010000:3.0:1788986660.545211:0:92313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986660.545223:0:92313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986660.545230:0:92313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986660.545236:0:92313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf5498d2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 92313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986660.864743:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986661.892117:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993588224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986661.892194:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986661.892911:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993588224 00000100:00100000:2.0:1788986661.892920:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993588224 00000100:00100000:2.0:1788986661.893242:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 882 00000100:00100000:2.0:1788986661.893252:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993588224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986661.893284:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986661.893344:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993588224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986661.893351:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 882 00000100:00100000:2.0:1788986661.893417:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993588224:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986661.894457:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986661.908079:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788986662.144201:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986662.144209:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986662.144214:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986662.144271:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986662.144283:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986662.144295:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986662.144321:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993588352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986662.144385:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986662.144440:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eac600 going to sleep for 11 seconds 00000100:00100000:0.0:1788986662.144528:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993588352 00000100:00100000:0.0:1788986662.144535:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993588352 00000100:00100000:0.0:1788986662.144586:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1352 00000100:00100000:0.0:1788986662.144596:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993588352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986662.144609:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986662.144623:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5498e0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf5498d9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986662.144659:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5498e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf5498d9 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986662.144675:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5498e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5498d9 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986662.144684:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef800, rc 0) 00000100:00100000:0.0:1788986662.144725:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993588352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986662.144732:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1352 00000100:00100000:0.0:1788986662.144786:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe83100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993588352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986662.144799:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5498e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986662.144809:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf5498e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986662.144826:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986662.144831:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5498e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986662.144838:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf5498e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986662.912239:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986662.914449:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986662.914468:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993588480:0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.914536:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986662.914598:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993588480 00000100:00100000:1.0:1788986662.914605:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993588480 00000100:00100000:1.0:1788986662.914651:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1737 00000100:00100000:1.0:1788986662.914659:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993588480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.914707:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993588480:12345-0@lo:400:kworker.0 Request processed in 49us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986662.914714:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1737 00000100:00100000:1.0:1788986662.914766:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993588480:0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.914803:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993588608:0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.914826:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986662.914873:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986662.914891:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993588736:0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.914931:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986662.914958:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993588736 00000100:00100000:1.0:1788986662.914962:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993588736 00000100:00100000:1.0:1788986662.914989:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1788986662.914996:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993588736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.915028:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993588736:12345-0@lo:400:kworker.0 Request processed in 33us (97us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986662.915034:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1296 00000100:00100000:1.0:1788986662.915057:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993588736:0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.915085:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993588864:0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.915131:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986662.915157:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993588608 00000100:00100000:1.0:1788986662.915160:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993588608 00000100:00100000:1.0:1788986662.915193:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993588864 00000100:00100000:1.0:1788986662.915196:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993588864 00000100:00100000:1.0:1788986662.915214:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1738 00000100:00100000:1.0:1788986662.915220:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993588608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.915265:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993588608:12345-0@lo:400:kworker.0 Request processed in 45us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986662.915270:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1738 00000100:00100000:1.0:1788986662.915281:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1739 00000100:00100000:1.0:1788986662.915286:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993588864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.915315:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993588864:12345-0@lo:400:kworker.0 Request processed in 28us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986662.915320:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1739 00000100:00080000:1.0:1788986662.915336:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986662.915355:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993588864:0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.915376:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993588608:0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.915405:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986662.915411:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993588992:0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.915432:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986662.915456:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993588992 00000100:00100000:1.0:1788986662.915460:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993588992 00000100:00100000:1.0:1788986662.915488:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1297 00000100:00100000:1.0:1788986662.915494:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993588992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986662.915525:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993588992:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986662.915530:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1297 00000100:00080000:1.0:1788986662.915544:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986662.915559:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993588992:0@lo:400:kworker.0 00000100:00100000:3.0:1788986663.426842:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986663.426861:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993589120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986663.426918:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986663.426970:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993589120 00000100:00100000:3.0:1788986663.426977:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993589120 00000100:00100000:3.0:1788986663.427019:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 883 00000100:00100000:3.0:1788986663.427028:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993589120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986663.427058:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986663.427112:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993589120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986663.427119:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 883 00000100:00100000:3.0:1788986663.427158:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993589120:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986663.936192:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986664.141378:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986664.141505:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971380096 00000100:00100000:1.0:1788986664.141514:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971380096 00000100:00100000:1.0:1788986664.141585:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1006 00000100:00100000:1.0:1788986664.141596:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54244:x1875885971380096:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986664.141685:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54244:x1875885971380096:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 90us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986664.141691:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1006 00000100:00080000:2.0:1788986664.141939:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986664.144033:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986664.144139:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971380224 00000100:00100000:1.0:1788986664.144146:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971380224 00000100:00100000:1.0:1788986664.144211:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 548 00000100:00100000:1.0:1788986664.144220:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54244:x1875885971380224:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986664.144562:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54244:x1875885971380224:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 342us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986664.144573:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 548 00000100:00080000:2.0:1788986664.144678:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986664.149484:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986664.149568:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971380352 00000100:00100000:1.0:1788986664.149576:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971380352 00000100:00100000:1.0:1788986664.149623:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 549 00000100:00100000:1.0:1788986664.149630:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875885971380352:12345-192.168.206.21@tcp:8:lfs.60003 00010000:00080000:1.0:1788986664.149662:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 2448 last 0 00000020:00000080:1.0:1788986664.149695:0:6697:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf5498e7 00002000:00100000:1.0:1788986664.149706:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b0a7fa08000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788986664.149717:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788986664.149946:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788986664.149974:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b0a7fa0d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788986664.150272:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971380352:12345-192.168.206.21@tcp:8:lfs.60003 Request processed in 639us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986664.150280:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 549 00000100:00100000:0.0:1788986664.162144:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986664.162249:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971380480 00000100:00100000:2.0:1788986664.162264:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971380480 00000100:00100000:2.0:1788986664.162340:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 550 00000100:00100000:2.0:1788986664.162351:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54244:x1875885971380480:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986664.162714:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54244:x1875885971380480:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 364us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986664.162726:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 550 00000100:00080000:1.0:1788986664.165598:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986664.169073:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986664.169242:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971380608 00000100:00100000:1.0:1788986664.169251:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971380608 00000100:00100000:1.0:1788986664.169301:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1007 00000100:00100000:1.0:1788986664.169311:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54244:x1875885971380608:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986664.169941:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54244:x1875885971380608:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 629us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986664.169950:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1007 00000100:00100000:0.0:1788986664.178989:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986664.179141:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971380736 00000100:00100000:1.0:1788986664.179155:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971380736 00000100:00100000:1.0:1788986664.179227:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1008 00000100:00100000:1.0:1788986664.179238:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54244:x1875885971380736:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986664.179416:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54244:x1875885971380736:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 179us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986664.179424:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1008 00000100:00100000:2.0:1788986664.191052:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986664.191422:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971380864 00000100:00100000:3.0:1788986664.191434:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971380864 00000100:00100000:0.0:1788986664.191672:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 551 00000100:00100000:0.0:1788986664.191698:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54244:x1875885971380864:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986664.192060:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54244:x1875885971380864:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 374us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986664.192069:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 551 00000100:00100000:2.0:1788986664.196847:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986664.197279:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971380992 00000100:00100000:1.0:1788986664.197290:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971380992 00000100:00100000:1.0:1788986664.197361:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 552 00000100:00100000:1.0:1788986664.197372:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54244:x1875885971380992:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986664.198510:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54244:x1875885971380992:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 1135us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986664.198520:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 552 00000100:00100000:1.0:1788986664.204790:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986664.204989:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971381120 00000100:00100000:2.0:1788986664.205002:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971381120 00000100:00100000:2.0:1788986664.205133:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1009 00000100:00100000:2.0:1788986664.205146:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54244:x1875885971381120:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986664.205743:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54244:x1875885971381120:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 597us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986664.205763:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1009 00000100:00100000:2.0:1788986664.256071:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986664.256236:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971381248 00000100:00100000:1.0:1788986664.256249:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971381248 00000100:00100000:1.0:1788986664.256315:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1010 00000100:00100000:1.0:1788986664.256328:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54248:x1875885971381248:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:1.0:1788986664.256355:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986664.256386:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5498ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1495 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.256470:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5498f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.256487:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5498f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.256503:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5498f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.256518:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5498fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.256526:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5498fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.256532:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5498fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257271:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549903 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257285:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257294:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986664.257323:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:1.0:1788986664.257328:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986664.257349:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549903 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257363:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5498f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257370:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5498f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257376:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5498f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257387:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986664.257392:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5498f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257401:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5498f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257415:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316600) 00010000:00010000:1.0:1788986664.257418:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986664.257424:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5498f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257430:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf5498f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257447:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5498fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257454:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5498fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257460:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5498fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257466:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986664.257469:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5498fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257475:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5498fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257487:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a45316700) 00010000:00010000:1.0:1788986664.257489:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986664.257492:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5498fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257498:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf5498fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257847:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf5498ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1495 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257983:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549903 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1495 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986664.257991:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45316400) 00010000:00010000:1.0:1788986664.257994:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986664.257996:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986664.258165:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54248:x1875885971381248:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 1838us (2106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986664.258174:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1010 00000100:00100000:2.0:1788986664.263528:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986664.263746:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971381504 00000100:00100000:3.0:1788986664.263827:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971381504 00000100:00100000:3.0:1788986664.264367:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1011 00000100:00100000:3.0:1788986664.264381:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54248:x1875885971381504:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:3.0:1788986664.264409:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986664.264434:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54990a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d149c expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.265078:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549911 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.265292:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549911 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.265307:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549911 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.265325:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549918 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.265333:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549918 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.265340:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549918 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788986664.267476:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x20:0x0], index 1: 0 00010000:00010000:3.0:1788986664.268392:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54991f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.268415:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54991f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.268429:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54991f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.268483:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549911 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.268491:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549911 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.268499:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549911 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.268506:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986664.268512:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549911 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.268520:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549911 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.268534:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45316400) 00010000:00010000:3.0:1788986664.268537:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986664.268543:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549911 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.268550:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549911 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986664.268564:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007cc93fd3 reply state 000000007e34cc58 transno 4294967678 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549918 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986664.268574:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788986664.268686:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54990a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d149c expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.268716:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54991f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d149c expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.268724:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:3.0:1788986664.268727:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788986664.268730:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3200, rc 0) 00000100:00100000:3.0:1788986664.269075:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:54248:x1875885971381504:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 4696us (5559us total) trans 4294967678 rc 0/0 00000100:00100000:3.0:1788986664.269115:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1011 00010000:00010000:3.0:1788986664.276346:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549918 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.276369:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549918 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.276377:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549918 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.276384:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986664.276390:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549918 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.276398:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549918 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.276418:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a55745300) 00010000:00010000:3.0:1788986664.276422:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986664.276427:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549918 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986664.276435:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549918 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986664.277708:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986664.278326:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971381632 00000100:00100000:0.0:1788986664.278340:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971381632 00000100:00100000:0.0:1788986664.278423:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 553 00000100:00100000:0.0:1788986664.278435:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54248:x1875885971381632:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:0.0:1788986664.278462:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986664.278490:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8ce8b24/0xc20d828fcf54992d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14a3 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986664.278521:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788986664.278548:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=2448s v=(0 0) 00010000:00010000:0.0:1788986664.278553:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986664.278565:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ce8b24/0xc20d828fcf54992d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14a3 expref: 7 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986664.278586:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d8ce8b24/0xc20d828fcf54992d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14a3 expref: 7 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986664.278601:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eec00, rc 0) 00000100:00100000:0.0:1788986664.278677:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54248:x1875885971381632:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 243us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986664.278685:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 553 00000100:00100000:1.0:1788986664.304977:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986664.305273:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971381760 00000100:00100000:0.0:1788986664.305287:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971381760 00002000:00100000:0.0:1788986664.305353:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x20:0x0] (0->1048575) req@ffff9b0a7fe2e300 x1875885971381760/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:585/0 lens 488/0 e 0 to 0 dl 1788986675 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1788986664.305366:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a7fe2e300 with x1875885971381760 ext(0->1048575) 00002000:00010000:0.0:1788986664.305373:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a7fe2e300 00000100:00100000:0.0:1788986664.305411:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 25 00000100:00100000:0.0:1788986664.305422:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971381760:12345-192.168.206.21@tcp:4:dd.60003 00000001:00100000:2.0:1788986664.392206:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000001:00080000:2.0:1788986664.449022:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967360 is committed 00000100:00100000:3.0:1788986664.449199:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971381760:12345-192.168.206.21@tcp:4:dd.60003 Request processed in 143774us (144336us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788986664.449210:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 25 00002000:00100000:3.0:1788986664.449232:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x20:0x0] (0->1048575) req@ffff9b0a7fe2e300 x1875885971381760/t4294967360(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:585/0 lens 488/448 e 0 to 0 dl 1788986675 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1788986664.449243:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a7fe2e300 with x1875885971381760 ext(0->1048575) 00002000:00010000:3.0:1788986664.449249:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a7fe2e300 00000100:00100000:1.0:1788986664.457202:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986664.457331:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971381888 00000100:00100000:2.0:1788986664.457341:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971381888 00000100:00100000:2.0:1788986664.457392:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1012 00000100:00100000:2.0:1788986664.457400:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:54248:x1875885971381888:12345-192.168.206.21@tcp:44:dd.60003 00000001:00080000:1.0:1788986664.485856:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967678 is committed 00000100:00100000:2.0:1788986664.486051:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54248:x1875885971381888:12345-192.168.206.21@tcp:44:dd.60003 Request processed in 28645us (28852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986664.486061:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1012 00000100:00100000:3.0:1788986664.488790:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986664.488900:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971382016 00000100:00100000:0.0:1788986664.488909:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971382016 00000100:00100000:0.0:1788986664.488963:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 554 00000100:00100000:0.0:1788986664.488973:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971382016:12345-192.168.206.21@tcp:16:dd.60003 00000100:00100000:0.0:1788986664.489133:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971382016:12345-192.168.206.21@tcp:16:dd.60003 Request processed in 161us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986664.489141:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 554 00000100:00100000:0.0:1788986664.491881:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986664.491966:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971382272 00000100:00100000:1.0:1788986664.491975:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971382272 00000100:00100000:1.0:1788986664.492026:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 99 00000100:00100000:1.0:1788986664.492036:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54248:x1875885971382272:12345-192.168.206.21@tcp:35:dd.60003 00000001:00080000:1.0:1788986664.492428:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967679 00000100:00100000:1.0:1788986664.492526:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:54248:x1875885971382272:12345-192.168.206.21@tcp:35:dd.60003 Request processed in 490us (652us total) trans 4294967680 rc 0/0 00000100:00100000:1.0:1788986664.492535:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 99 00000020:00080000:1.0:1788986664.492539:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788986664.960330:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986665.080509:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986665.080580:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971382400 00000100:00100000:3.0:1788986665.080591:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971382400 00000100:00100000:3.0:1788986665.080644:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1353 00000100:00100000:3.0:1788986665.080654:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971382400:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986665.080716:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971382400:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 63us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986665.080723:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1353 00000100:00100000:2.0:1788986665.089937:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986665.089983:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986665.090015:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986665.090185:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971382784 00000100:00100000:0.0:1788986665.090194:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971382784 00000100:00100000:0.0:1788986665.090245:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971382656 00000100:00100000:0.0:1788986665.090249:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971382656 00000100:00100000:0.0:1788986665.090271:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1298 00000100:00100000:0.0:1788986665.090280:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971382784:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986665.090344:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971382784:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986665.090351:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1298 00000100:00100000:0.0:1788986665.090367:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1299 00000100:00100000:0.0:1788986665.090374:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971382656:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986665.090395:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971382656:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 22us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986665.090400:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1299 00000100:00100000:3.0:1788986665.090699:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971382528 00000100:00100000:3.0:1788986665.090704:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971382528 00000100:00100000:3.0:1788986665.090753:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1740 00000100:00100000:3.0:1788986665.090760:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:2346:x1875885971382528:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986665.090797:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:2346:x1875885971382528:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986665.090806:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1740 00000001:00080000:1.0:1788986665.679113:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967680 is committed 00010000:00010000:3.0:1788986665.984859:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986667.008443:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986667.009294:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986667.009312:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993589248:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986667.009369:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986667.009544:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993589248 00000100:00100000:3.0:1788986667.009552:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993589248 00000100:00100000:3.0:1788986667.009598:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 884 00000100:00100000:3.0:1788986667.009607:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993589248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986667.009637:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986667.009683:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993589248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986667.009689:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 884 00000100:00080000:3.0:1788986667.009707:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986667.009754:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993589248:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788986667.050641:0:92557:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2450953549313ns, next at 2429065032244ns, rc = 0 00000004:00080000:3.0:1788986667.050796:0:92557:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2450953705999ns, next at 2398776258696ns, rc = 0 00000004:00080000:1.0:1788986667.052627:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 87 committed 00000004:00080000:1.0:1788986667.052648:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 87 committed 00000100:00100000:0.0:1788986668.032803:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993589504:0@lo:400:kworker.0 00000100:00100000:0.0:1788986668.032862:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986668.032903:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993590016:0@lo:400:kworker.0 00000100:00100000:1.0:1788986668.033045:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993589760:0@lo:400:kworker.0 00000100:00100000:1.0:1788986668.033074:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986668.033123:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788986668.033129:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993589376:0@lo:400:kworker.0 00000100:00100000:1.0:1788986668.033157:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986668.033179:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993589888:0@lo:400:kworker.0 00000100:00100000:1.0:1788986668.033271:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986668.033304:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993589760 00000100:00100000:1.0:1788986668.033311:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993589760 00000100:00100000:1.0:1788986668.033354:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1788986668.033362:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993589760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986668.033408:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993589760:12345-0@lo:400:kworker.0 Request processed in 47us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986668.033415:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1300 00000100:00100000:1.0:1788986668.033435:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993589376 00000100:00100000:1.0:1788986668.033439:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993589376 00000100:00100000:1.0:1788986668.033461:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1788986668.033466:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993589376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986668.033492:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993589376:12345-0@lo:400:kworker.0 Request processed in 27us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986668.033498:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:1.0:1788986668.033535:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993589376:0@lo:400:kworker.0 00000100:00100000:1.0:1788986668.033546:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993589760:0@lo:400:kworker.0 00000100:00100000:1.0:1788986668.033584:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993589504 00000100:00100000:1.0:1788986668.033588:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993589504 00000100:00100000:1.0:1788986668.033613:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993589888 00000100:00100000:1.0:1788986668.033616:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993589888 00000100:00100000:1.0:1788986668.033641:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1741 00000100:00100000:1.0:1788986668.033647:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993589504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986668.033676:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993589504:12345-0@lo:400:kworker.0 Request processed in 30us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986668.033682:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1741 00000100:00100000:1.0:1788986668.033693:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1742 00000100:00100000:1.0:1788986668.033698:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993589888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986668.033741:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993589888:12345-0@lo:400:kworker.0 Request processed in 29us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986668.033746:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1742 00000100:00100000:1.0:1788986668.033765:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993589632:0@lo:400:kworker.0 00000100:00100000:1.0:1788986668.033801:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986668.033829:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993589632 00000100:00100000:1.0:1788986668.033833:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993589632 00000100:00100000:1.0:1788986668.033855:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1743 00000100:00100000:1.0:1788986668.033861:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993589632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986668.033896:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993589632:12345-0@lo:400:kworker.0 Request processed in 35us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986668.033902:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1743 00000100:00100000:0.0:1788986668.034308:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986668.034340:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993589504:0@lo:400:kworker.0 00000100:00100000:0.0:1788986668.034367:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993590016 00000100:00100000:0.0:1788986668.034371:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993590016 00000100:00100000:0.0:1788986668.034396:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1301 00000100:00100000:0.0:1788986668.034403:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993590016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986668.034437:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993590016:12345-0@lo:400:kworker.0 Request processed in 34us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986668.034442:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1301 00000100:00100000:0.0:1788986668.034473:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993590016:0@lo:400:kworker.0 00000100:00100000:3.0:1788986668.038186:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993589888:0@lo:400:kworker.0 00000100:00080000:1.0:1788986668.040288:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986668.040296:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986668.040338:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993589632:0@lo:400:kworker.0 00010000:00010000:2.0:1788986668.040486:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986668.489763:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986668.490024:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971382912 00000100:00100000:1.0:1788986668.490034:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971382912 00000100:00100000:1.0:1788986668.490227:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1013 00000100:00100000:1.0:1788986668.490238:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54440:x1875885971382912:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986668.490347:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54440:x1875885971382912:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 109us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986668.490354:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1013 00000100:00080000:3.0:1788986668.491872:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986668.492405:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986668.492926:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971383040 00000100:00100000:0.0:1788986668.492936:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971383040 00000100:00100000:0.0:1788986668.492986:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 555 00000100:00100000:0.0:1788986668.492996:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54440:x1875885971383040:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986668.493376:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54440:x1875885971383040:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 381us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986668.493387:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 555 00000100:00080000:2.0:1788986668.493621:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986668.497123:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986668.497309:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971383168 00000100:00100000:0.0:1788986668.497319:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971383168 00000100:00100000:0.0:1788986668.497439:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 556 00000100:00100000:0.0:1788986668.497451:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54440:x1875885971383168:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986668.497802:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54440:x1875885971383168:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 352us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986668.497810:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 556 00000100:00080000:2.0:1788986668.500293:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986668.501563:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986668.501759:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971383296 00000100:00100000:2.0:1788986668.501769:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971383296 00000100:00100000:2.0:1788986668.501872:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1014 00000100:00100000:2.0:1788986668.501882:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54440:x1875885971383296:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986668.502264:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54440:x1875885971383296:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 382us (707us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986668.502272:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1014 00000100:00100000:3.0:1788986668.510755:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986668.510934:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971383424 00000100:00100000:1.0:1788986668.510944:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971383424 00000100:00100000:1.0:1788986668.511002:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1015 00000100:00100000:1.0:1788986668.511013:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54440:x1875885971383424:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986668.511307:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54440:x1875885971383424:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 294us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986668.511316:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1015 00000100:00100000:0.0:1788986668.513818:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986668.514164:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971383552 00000100:00100000:3.0:1788986668.514177:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971383552 00000100:00100000:3.0:1788986668.514329:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 557 00000100:00100000:3.0:1788986668.514341:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54440:x1875885971383552:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986668.514759:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54440:x1875885971383552:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 419us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986668.514766:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 557 00000100:00100000:0.0:1788986668.517268:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986668.517357:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971383680 00000100:00100000:3.0:1788986668.517365:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971383680 00000100:00100000:3.0:1788986668.517451:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 558 00000100:00100000:3.0:1788986668.517461:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54440:x1875885971383680:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986668.517829:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54440:x1875885971383680:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 369us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986668.517837:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 558 00000100:00100000:3.0:1788986668.520065:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986668.520174:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971383808 00000100:00100000:0.0:1788986668.520183:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971383808 00000100:00100000:0.0:1788986668.520318:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1016 00000100:00100000:0.0:1788986668.520328:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54440:x1875885971383808:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986668.520807:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54440:x1875885971383808:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 479us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986668.520815:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1016 00000100:00100000:1.0:1788986668.545798:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993590144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986668.545858:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986668.547908:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993590144 00000100:00100000:3.0:1788986668.547920:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993590144 00000100:00100000:3.0:1788986668.548009:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1788986668.548019:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993590144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986668.548053:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788986668.548404:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993590144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 386us (2544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986668.548411:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 885 00000100:00100000:3.0:1788986668.548664:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993590144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986668.587650:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986668.587687:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971384064 00000100:00100000:2.0:1788986668.587695:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971384064 00000100:00100000:2.0:1788986668.587756:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1017 00000100:00100000:2.0:1788986668.587766:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54444:x1875885971384064:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:2.0:1788986668.587811:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986668.587837:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54991f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x53:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d149c expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.587853:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:2.0:1788986668.587863:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986668.587883:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549934 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.587897:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549934 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.587906:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549934 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.587920:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54993b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.587927:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54993b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.587933:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54993b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.588359:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549942 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.588370:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549942 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.588377:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549942 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986668.589386:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].32, 64 off10240 00000004:00080000:2.0:1788986668.589397:0:7899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2452492307185ns, next at 2453492304877ns, rc = 0 00010000:00010000:2.0:1788986668.589497:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549949 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589510:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589523:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549949 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589530:0:7899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549949 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589536:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549949 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589542:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549949 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589557:0:7899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986668.589578:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549942 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589584:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549942 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589589:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549942 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589595:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986668.589599:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549942 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589607:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549942 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589616:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986668.589619:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986668.589623:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549942 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589629:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549942 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x53:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589647:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549934 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589654:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549934 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589660:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549934 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589665:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986668.589667:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549934 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589674:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549934 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589680:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45316400) 00010000:00010000:2.0:1788986668.589683:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986668.589686:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549934 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986668.589691:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549934 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4e:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986668.589700:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e7ec0c52 reply state 000000006381c310 transno 4294967681 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54993b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986668.589712:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986668.589799:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:54444:x1875885971384064:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 2032us (2152us total) trans 4294967681 rc 0/0 00000100:00100000:2.0:1788986668.589807:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1017 00010000:00010000:0.0:1788986668.590004:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986668.590011:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549949 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986668.590017:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986668.590021:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549949 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986668.590032:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549949 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986668.590041:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x53:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:0.0:1788986668.590043:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788986668.590046:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549949 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986668.590052:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549949 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x53:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986668.590066:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986668.590068:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986668.590070:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986668.599537:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54993b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986668.599555:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54993b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986668.599562:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54993b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986668.599567:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986668.599572:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54993b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986668.599581:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54993b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986668.599598:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0xecba81fd (ffff9b0a45acab00) 00010000:00010000:3.0:1788986668.599601:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986668.599606:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54993b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986668.599612:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54993b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4e:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986669.059319:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986670.082980:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986670.194613:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986670.194661:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986670.194700:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986670.194739:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986670.194776:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971384320 00000100:00100000:3.0:1788986670.194788:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971384320 00000100:00100000:3.0:1788986670.194861:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1744 00000100:00100000:3.0:1788986670.194873:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971384320:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986670.194965:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971384320:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 95us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986670.194973:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1744 00000100:00100000:3.0:1788986670.195001:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971384448 00000100:00100000:3.0:1788986670.195005:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971384448 00000100:00100000:3.0:1788986670.195033:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971384576 00000100:00100000:3.0:1788986670.195036:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971384576 00000100:00100000:3.0:1788986670.195058:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1302 00000100:00100000:3.0:1788986670.195065:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971384448:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986670.195131:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971384448:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 66us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986670.195137:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1302 00000100:00100000:3.0:1788986670.195150:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1303 00000100:00100000:3.0:1788986670.195157:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971384576:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986670.195181:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971384576:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986670.195193:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1303 00000100:00080000:3.0:1788986670.195209:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986670.195214:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986670.195216:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986670.195460:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971384192 00000100:00100000:0.0:1788986670.195466:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971384192 00000100:00100000:0.0:1788986670.195506:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1355 00000100:00100000:0.0:1788986670.195514:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971384192:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986670.195550:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971384192:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986670.195557:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1355 00000004:00080000:2.0:1788986671.066650:0:92702:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2454969556998ns, next at 2429065032244ns, rc = 0 00000004:00080000:2.0:1788986671.066805:0:92702:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2454969714561ns, next at 2453492304877ns, rc = 0 00010000:00010000:1.0:1788986671.111126:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788986671.151116:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 89 committed 00000004:00080000:1.0:1788986671.151153:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 88 committed 00000100:00100000:2.0:1788986671.151399:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986671.151424:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993590272:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788986671.151586:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:1.0:1788986671.151723:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967681 is committed 00000004:00080000:1.0:1788986671.151733:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 88 committed 00000100:00100000:3.0:1788986671.151863:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993590272 00000100:00100000:3.0:1788986671.151872:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993590272 00000100:00100000:3.0:1788986671.151938:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1788986671.151950:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993590272:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788986671.151985:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:32 count 1 00010000:00010000:3.0:1788986671.152017:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986671.152043:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8ce8b24/0xc20d828fcf54992d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14a3 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986671.152053:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20:0x0].0x0 since=7s v=(0 0) 00010000:00010000:3.0:1788986671.152059:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986671.152065:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986671.152136:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8ce8b24/0xc20d828fcf54992d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14a3 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986671.152153:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8ce8b24/0xc20d828fcf54992d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14a3 expref: 5 pid: 8478 timeout: 2555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986671.152167:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875885993590400:192.168.206.21@tcp:104: 00000100:00080000:3.0:1788986671.152255:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986671.158120:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a450316c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986671.158373:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986671.158478:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971384704 00000100:00100000:0.0:1788986671.158490:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971384704 00010000:00010000:0.0:1788986671.158539:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8ce8b24/0xc20d828fcf54992d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14a3 expref: 6 pid: 8478 timeout: 2555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986671.158594:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 429 00000100:00100000:0.0:1788986671.158607:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971384704:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986671.158627:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986671.158634:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8ce8b24/0xc20d828fcf54992d lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14a3 expref: 6 pid: 8478 timeout: 2555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986671.158823:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8ce8b24/0xc20d828fcf54992d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14a3 expref: 6 pid: 8478 timeout: 2555 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986671.158856:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986671.158862:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986671.158868:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986671.158879:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986671.158903:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986671.158971:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971384704:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 366us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986671.158979:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 429 00010000:00010000:3.0:1788986671.160035:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8ce8b24/0xc20d828fcf54992d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14a3 expref: 5 pid: 8478 timeout: 2555 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986671.160060:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875885993590400:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788986671.160125:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986671.160138:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986671.160146:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986671.160159:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986671.160173:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986671.160205:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986671.160538:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986671.160548:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986671.160556:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986671.160561:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986671.160570:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986671.160590:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986671.160604:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f34e941/0xc20d828fcf549950 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986671.160631:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986671.160633:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986671.160635:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986671.161253:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993590272:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9302us (9664us total) trans 4294967361 rc 0/0 00000100:00100000:3.0:1788986671.161264:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000004:00080000:2.0:1788986671.161635:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7fb30e00/2, rc 0, transno 4294967361 00000100:00100000:2.0:1788986671.161664:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993590272:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1788986672.128598:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986672.128806:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993590528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986672.128869:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986672.128992:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993590528 00000100:00100000:2.0:1788986672.129001:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993590528 00000100:00100000:2.0:1788986672.129062:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 886 00000100:00100000:2.0:1788986672.129070:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993590528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986672.129129:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986672.129182:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993590528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986672.129189:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 886 00000100:00080000:3.0:1788986672.129308:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986672.129347:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993590528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986673.152722:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993590656:0@lo:400:kworker.0 00000100:00100000:0.0:1788986673.152793:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986673.152848:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993591168:0@lo:400:kworker.0 00010000:00010000:2.0:1788986673.152850:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986673.152875:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986673.152900:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788986673.152905:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993590784:0@lo:400:kworker.0 00000100:00100000:0.0:1788986673.152925:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986673.152941:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993591296:0@lo:400:kworker.0 00000100:00100000:0.0:1788986673.152961:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986673.152971:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993591168 00000100:00100000:2.0:1788986673.152978:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993591168 00000100:00100000:0.0:1788986673.152986:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993590784 00000100:00100000:0.0:1788986673.152989:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993590784 00000100:00100000:2.0:1788986673.153025:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1745 00000100:00100000:2.0:1788986673.153035:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993591168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986673.153053:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993590656 00000100:00100000:1.0:1788986673.153057:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993590656 00000100:00100000:1.0:1788986673.153084:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1788986673.153118:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993591168:12345-0@lo:400:kworker.0 Request processed in 85us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986673.153118:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993590656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986673.153125:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1745 00000100:00100000:2.0:1788986673.153143:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1746 00000100:00100000:2.0:1788986673.153149:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993590784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986673.153150:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993590656:12345-0@lo:400:kworker.0 Request processed in 61us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986673.153156:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1356 00000100:00100000:2.0:1788986673.153185:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993590784:12345-0@lo:400:kworker.0 Request processed in 25us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986673.153192:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1746 00000100:00100000:3.0:1788986673.153228:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993590912:0@lo:400:kworker.0 00000100:00100000:3.0:1788986673.153276:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986673.172864:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986673.172884:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993591040:0@lo:400:kworker.0 00000100:00100000:3.0:1788986673.172951:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986673.180640:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993590912 00000100:00100000:0.0:1788986673.180655:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993590912 00000100:00100000:0.0:1788986673.180738:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1747 00000100:00100000:0.0:1788986673.180748:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993590912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986673.180859:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993590912:12345-0@lo:400:kworker.0 Request processed in 112us (27581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986673.180866:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1747 00000100:00100000:0.0:1788986673.180904:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993591296 00000100:00100000:0.0:1788986673.180908:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993591296 00000100:00100000:0.0:1788986673.180936:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993591040 00000100:00100000:0.0:1788986673.180938:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993591040 00000100:00100000:0.0:1788986673.180956:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1304 00000100:00100000:0.0:1788986673.180962:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993591296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986673.180994:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993591296:12345-0@lo:400:kworker.0 Request processed in 33us (28032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986673.181000:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1304 00000100:00100000:0.0:1788986673.181013:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1305 00000100:00100000:0.0:1788986673.181019:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993591040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986673.181047:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993591040:12345-0@lo:400:kworker.0 Request processed in 28us (8096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986673.181052:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1305 00000100:00080000:1.0:1788986673.181751:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986673.181758:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986673.182485:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993591040:0@lo:400:kworker.0 00000100:00100000:1.0:1788986673.184417:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993590784:0@lo:400:kworker.0 00000100:00100000:1.0:1788986673.184439:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993591296:0@lo:400:kworker.0 00000100:00100000:1.0:1788986673.184451:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993590656:0@lo:400:kworker.0 00000100:00100000:1.0:1788986673.184462:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993591168:0@lo:400:kworker.0 00000100:00100000:0.0:1788986673.186908:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993590912:0@lo:400:kworker.0 00000100:00100000:3.0:1788986673.664272:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986673.664293:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993591424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986673.664355:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986673.664481:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993591424 00000100:00100000:2.0:1788986673.664489:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993591424 00000100:00100000:2.0:1788986673.664540:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1788986673.664548:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993591424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986673.664576:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788986673.664634:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993591424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986673.664641:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 887 00000100:00100000:2.0:1788986673.664684:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993591424:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788986673.733526:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967361 is committed 00010000:00010000:1.0:1788986674.188329:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986675.200988:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986675.312860:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986675.312904:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986675.312940:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986675.312975:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986675.313057:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971384832 00000100:00100000:1.0:1788986675.313067:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971384832 00000100:00100000:1.0:1788986675.313161:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1357 00000100:00100000:2.0:1788986675.313220:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971384960 00000100:00100000:2.0:1788986675.313225:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971384960 00000100:00100000:2.0:1788986675.313268:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1748 00000100:00100000:2.0:1788986675.313277:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971384960:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986675.313346:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971384960:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 70us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986675.313353:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1748 00000100:00100000:1.0:1788986675.313430:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971384832:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986675.313479:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971384832:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 52us (626us total) trans 0 rc 0/0 00000100:00080000:2.0:1788986675.313480:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986675.313490:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1357 00000100:00100000:0.0:1788986675.315623:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971385088 00000100:00100000:0.0:1788986675.315634:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971385088 00000100:00100000:0.0:1788986675.315705:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971385216 00000100:00100000:0.0:1788986675.315709:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971385216 00000100:00100000:0.0:1788986675.315744:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1306 00000100:00100000:0.0:1788986675.315753:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971385088:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986675.315808:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971385088:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 57us (2904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986675.315814:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1306 00000100:00100000:0.0:1788986675.315831:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1307 00000100:00100000:0.0:1788986675.315838:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971385216:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986675.315862:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971385216:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (2886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986675.315868:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1307 00000100:00080000:2.0:1788986675.317515:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986675.317522:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986676.224398:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986677.248496:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986677.248649:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986677.248668:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993591552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986677.248743:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986677.248891:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993591552 00000100:00100000:2.0:1788986677.248900:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993591552 00000100:00100000:2.0:1788986677.248960:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1788986677.248969:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993591552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986677.249010:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986677.249063:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993591552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986677.249070:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 888 00000100:00100000:2.0:1788986677.249147:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993591552:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986677.249270:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986678.274017:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993591936:0@lo:400:kworker.0 00000100:00100000:3.0:1788986678.274147:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986678.274217:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986678.274224:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993592064:0@lo:400:kworker.0 00000100:00100000:3.0:1788986678.274255:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986678.274295:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993591936 00000100:00100000:3.0:1788986678.274304:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993591936 00000100:00100000:3.0:1788986678.274387:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1749 00000100:00100000:3.0:1788986678.274400:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993591936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986678.274462:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993591936:12345-0@lo:400:kworker.0 Request processed in 66us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986678.274470:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1749 00000100:00100000:3.0:1788986678.274500:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993592064 00000100:00100000:3.0:1788986678.274505:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993592064 00000100:00100000:3.0:1788986678.274532:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1788986678.274539:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993592064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986678.274573:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993592064:12345-0@lo:400:kworker.0 Request processed in 35us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986678.274580:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1308 00000100:00100000:3.0:1788986678.274662:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993592064:0@lo:400:kworker.0 00000100:00100000:3.0:1788986678.274688:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993591936:0@lo:400:kworker.0 00000100:00100000:1.0:1788986678.274892:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993591680:0@lo:400:kworker.0 00000100:00100000:1.0:1788986678.274933:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986678.274975:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993592192:0@lo:400:kworker.0 00000100:00100000:1.0:1788986678.275001:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986678.275025:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788986678.275032:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993591808:0@lo:400:kworker.0 00000100:00100000:1.0:1788986678.275055:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986678.275076:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993592320:0@lo:400:kworker.0 00000100:00100000:1.0:1788986678.275123:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788986678.275151:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788986678.275164:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986678.275176:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993592192 00000100:00100000:1.0:1788986678.275179:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993592192 00000100:00100000:1.0:1788986678.275214:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993591808 00000100:00100000:1.0:1788986678.275217:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993591808 00000100:00100000:1.0:1788986678.275237:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1750 00000100:00100000:1.0:1788986678.275244:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993592192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986678.275284:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993592192:12345-0@lo:400:kworker.0 Request processed in 41us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986678.275291:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1750 00000100:00100000:1.0:1788986678.275306:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1751 00000100:00100000:1.0:1788986678.275312:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993591808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986678.275354:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993591808:12345-0@lo:400:kworker.0 Request processed in 42us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986678.275360:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1751 00000100:00100000:1.0:1788986678.275384:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993592320 00000100:00100000:1.0:1788986678.275388:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993592320 00000100:00100000:1.0:1788986678.275417:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1309 00000100:00100000:1.0:1788986678.275424:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993592320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986678.275456:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993592320:12345-0@lo:400:kworker.0 Request processed in 33us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986678.275462:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1309 00000100:00080000:1.0:1788986678.275486:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986678.275490:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986678.275514:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993591808:0@lo:400:kworker.0 00000100:00100000:1.0:1788986678.275525:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967361 gen 2 00000004:00080000:1.0:1788986678.275530:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7fb30e00, transno 4294967361 00000100:00100000:1.0:1788986678.275543:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993592320:0@lo:400:kworker.0 00000100:00100000:1.0:1788986678.275554:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993592192:0@lo:400:kworker.0 00000100:00100000:3.0:1788986678.276876:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993591680 00000100:00100000:3.0:1788986678.276889:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993591680 00000100:00100000:3.0:1788986678.276938:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1788986678.276948:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993591680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986678.277258:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993591680:12345-0@lo:400:kworker.0 Request processed in 311us (2323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986678.277317:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00100000:3.0:1788986678.277401:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993591680:0@lo:400:kworker.0 00000100:00100000:3.0:1788986678.786883:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986678.786939:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993592448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986678.787080:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986678.787276:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993592448 00000100:00100000:3.0:1788986678.787287:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993592448 00000100:00100000:3.0:1788986678.787347:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 889 00000100:00100000:3.0:1788986678.787357:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993592448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986678.787420:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986678.787494:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993592448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986678.787521:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 889 00000100:00100000:3.0:1788986678.787724:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993592448:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986679.297032:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986680.320492:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986680.432589:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986680.432653:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986680.432702:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986680.432736:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986680.432770:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971385344 00000100:00100000:3.0:1788986680.432781:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971385344 00000100:00100000:3.0:1788986680.432844:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1359 00000100:00100000:3.0:1788986680.432855:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971385344:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986680.432945:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971385344:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 90us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986680.432954:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1359 00000100:00100000:0.0:1788986680.433000:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971385728 00000100:00100000:3.0:1788986680.433004:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971385600 00000100:00100000:0.0:1788986680.433018:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971385728 00000100:00100000:3.0:1788986680.433027:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971385600 00000100:00100000:0.0:1788986680.433160:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1310 00000100:00100000:2.0:1788986680.433162:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971385472 00000100:00100000:2.0:1788986680.433170:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971385472 00000100:00100000:0.0:1788986680.433176:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971385728:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986680.433246:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971385728:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 76us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986680.433253:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1310 00000100:00100000:3.0:1788986680.433623:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1311 00000100:00100000:3.0:1788986680.433634:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971385600:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986680.433687:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971385600:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 55us (950us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986680.433694:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1311 00000100:00100000:2.0:1788986680.438690:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1752 00000100:00100000:2.0:1788986680.438713:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971385472:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986680.438829:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971385472:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 124us (6255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986680.438838:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1752 00000100:00080000:1.0:1788986680.439546:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986680.439556:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986680.439560:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788986681.344425:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986682.368908:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993592576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986682.368976:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788986682.370951:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986682.373185:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993592576 00000100:00100000:2.0:1788986682.373208:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993592576 00000100:00100000:2.0:1788986682.373350:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 890 00000100:00100000:2.0:1788986682.373360:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993592576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986682.373395:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986682.373489:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993592576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (4513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986682.373496:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 890 00000100:00100000:0.0:1788986682.373690:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993592576:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986682.376080:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986683.394818:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993592960:0@lo:400:kworker.0 00000100:00100000:3.0:1788986683.394885:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986683.394947:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986683.394953:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993593088:0@lo:400:kworker.0 00000100:00100000:3.0:1788986683.394978:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986683.395010:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993592960 00000100:00100000:3.0:1788986683.395017:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993592960 00000100:00100000:3.0:1788986683.395070:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1753 00000100:00100000:3.0:1788986683.395080:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993592960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986683.395278:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993592960:12345-0@lo:400:kworker.0 Request processed in 200us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986683.395285:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1753 00000100:00100000:3.0:1788986683.395311:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993593088 00000100:00100000:3.0:1788986683.395314:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993593088 00000100:00100000:3.0:1788986683.395339:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1312 00000100:00100000:3.0:1788986683.395345:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993593088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986683.395375:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993593088:12345-0@lo:400:kworker.0 Request processed in 30us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986683.395382:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1312 00000100:00080000:3.0:1788986683.395402:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986683.395429:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993593088:0@lo:400:kworker.0 00000100:00100000:3.0:1788986683.395439:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993592960:0@lo:400:kworker.0 00000100:00100000:2.0:1788986683.395692:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993592704:0@lo:400:kworker.0 00000100:00100000:2.0:1788986683.395741:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986683.395780:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993593216:0@lo:400:kworker.0 00000100:00100000:2.0:1788986683.395813:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986683.395836:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788986683.395843:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993592832:0@lo:400:kworker.0 00000100:00100000:2.0:1788986683.395864:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986683.395884:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993593344:0@lo:400:kworker.0 00000100:00100000:2.0:1788986683.395905:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986683.395935:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993593216 00000100:00100000:2.0:1788986683.395939:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993593216 00000100:00100000:2.0:1788986683.395972:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993592832 00000100:00100000:2.0:1788986683.395975:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993592832 00000100:00100000:2.0:1788986683.395992:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1754 00000100:00100000:2.0:1788986683.395998:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993593216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986683.396035:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993593216:12345-0@lo:400:kworker.0 Request processed in 37us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986683.396042:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1754 00000100:00100000:2.0:1788986683.396055:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1755 00000100:00100000:2.0:1788986683.396061:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993592832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986683.396130:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993592832:12345-0@lo:400:kworker.0 Request processed in 28us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986683.396135:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1755 00000100:00080000:2.0:1788986683.396154:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986683.396176:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993592832:0@lo:400:kworker.0 00000100:00100000:2.0:1788986683.396187:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eead80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993593216:0@lo:400:kworker.0 00010000:00010000:1.0:1788986683.397330:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986683.401502:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993593344 00000100:00100000:0.0:1788986683.401516:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993593344 00000100:00100000:0.0:1788986683.401613:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1788986683.401625:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993593344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986683.401742:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993593344:12345-0@lo:400:kworker.0 Request processed in 106us (5822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986683.401749:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1313 00000100:00100000:0.0:1788986683.401802:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993593344:0@lo:400:kworker.0 00000100:00100000:3.0:1788986683.402978:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993592704 00000100:00100000:3.0:1788986683.402987:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993592704 00000100:00100000:3.0:1788986683.403025:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1360 00000100:00100000:3.0:1788986683.403033:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993592704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986683.403126:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993592704:12345-0@lo:400:kworker.0 Request processed in 94us (7397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986683.403133:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1360 00000100:00080000:2.0:1788986683.403386:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986683.403463:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993592704:0@lo:400:kworker.0 00000100:00100000:0.0:1788986683.911260:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986683.911282:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993593472:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986683.911358:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986683.911473:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993593472 00000100:00100000:1.0:1788986683.911481:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993593472 00000100:00100000:1.0:1788986683.911526:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 891 00000100:00100000:1.0:1788986683.911535:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993593472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986683.911706:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986683.911759:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993593472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 224us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986683.911766:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 891 00000100:00100000:0.0:1788986683.912808:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993593472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986684.416359:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986685.440370:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986685.557523:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986685.557569:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986685.557601:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986685.557644:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986685.557678:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971386112 00000100:00100000:3.0:1788986685.557687:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971386112 00000100:00100000:3.0:1788986685.557737:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971386240 00000100:00100000:3.0:1788986685.557740:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971386240 00000100:00100000:3.0:1788986685.557761:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1314 00000100:00100000:3.0:1788986685.557771:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971386112:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986685.557830:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971386112:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 61us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986685.557850:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1314 00000100:00100000:3.0:1788986685.557866:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1315 00000100:00100000:3.0:1788986685.557873:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971386240:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986685.557898:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971386240:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986685.557904:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1315 00000100:00100000:0.0:1788986685.558121:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971385856 00000100:00100000:0.0:1788986685.558126:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971385856 00000100:00100000:0.0:1788986685.558168:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1361 00000100:00100000:0.0:1788986685.558176:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971385856:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986685.558201:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971385856:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986685.558208:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1361 00000100:00100000:2.0:1788986685.558727:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971385984 00000100:00100000:2.0:1788986685.558732:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971385984 00000100:00100000:2.0:1788986685.558777:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1756 00000100:00100000:2.0:1788986685.558784:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971385984:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986685.558830:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971385984:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 47us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986685.558837:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1756 00000100:00080000:2.0:1788986685.558856:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986685.558860:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986685.558862:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986686.464451:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986687.488987:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986687.489569:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993593600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986687.489643:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986687.489798:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993593600 00000100:00100000:1.0:1788986687.489805:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993593600 00000100:00100000:1.0:1788986687.489861:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 892 00000100:00100000:1.0:1788986687.489871:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993593600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986687.489903:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986687.489963:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993593600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986687.489970:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 892 00000100:00080000:2.0:1788986687.490075:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986687.490431:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993593600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986688.512380:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986688.512552:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993594112:0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.512675:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993593728:0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.512732:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986688.512781:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993594240:0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.512805:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986688.512828:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788986688.512833:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993593856:0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.512852:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986688.512868:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993594368:0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.512887:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986688.512914:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993593728 00000100:00100000:1.0:1788986688.512921:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993593728 00000100:00100000:1.0:1788986688.512973:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:1.0:1788986688.512982:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993593728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.513025:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993593728:12345-0@lo:400:kworker.0 Request processed in 44us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986688.513032:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:1.0:1788986688.513061:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993594240 00000100:00100000:1.0:1788986688.513065:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993594240 00000100:00100000:1.0:1788986688.513127:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993593856 00000100:00100000:1.0:1788986688.513131:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993593856 00000100:00100000:1.0:1788986688.513149:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1757 00000100:00100000:1.0:1788986688.513156:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993594240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.513186:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993594240:12345-0@lo:400:kworker.0 Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986688.513192:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1757 00000100:00100000:1.0:1788986688.513323:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1758 00000100:00100000:1.0:1788986688.513332:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993593856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.513362:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993593856:12345-0@lo:400:kworker.0 Request processed in 33us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986688.513368:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1758 00000100:00100000:1.0:1788986688.513389:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993594368 00000100:00100000:1.0:1788986688.513392:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993594368 00000100:00100000:1.0:1788986688.513416:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1788986688.513423:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993594368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.513453:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993594368:12345-0@lo:400:kworker.0 Request processed in 30us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986688.513458:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1316 00000100:00100000:1.0:1788986688.513495:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993593856:0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.513506:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993594368:0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.513513:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993593728:0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.513520:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993594240:0@lo:400:kworker.0 00000100:00100000:0.0:1788986688.513683:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986688.513712:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986688.513719:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993593984:0@lo:400:kworker.0 00000100:00100000:0.0:1788986688.513743:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986688.513769:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993593984 00000100:00100000:0.0:1788986688.513772:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993593984 00000100:00100000:0.0:1788986688.513800:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1759 00000100:00100000:0.0:1788986688.513807:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993593984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986688.513841:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993593984:12345-0@lo:400:kworker.0 Request processed in 35us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986688.513847:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1759 00000100:00100000:0.0:1788986688.513873:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993593984:0@lo:400:kworker.0 00000100:00080000:2.0:1788986688.514529:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986688.514535:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986688.514671:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993594112 00000100:00100000:1.0:1788986688.514677:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993594112 00000100:00100000:1.0:1788986688.514717:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1317 00000100:00100000:1.0:1788986688.514724:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993594112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986688.514778:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993594112:12345-0@lo:400:kworker.0 Request processed in 53us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986688.514784:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1317 00000100:00100000:2.0:1788986688.514986:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993594112:0@lo:400:kworker.0 00000100:00100000:2.0:1788986689.026070:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986689.026109:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993594496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986689.026173:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986689.026244:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993594496 00000100:00100000:2.0:1788986689.026250:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993594496 00000100:00100000:2.0:1788986689.026290:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1788986689.026297:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993594496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986689.026328:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986689.026384:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993594496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986689.026390:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 893 00000100:00100000:2.0:1788986689.026433:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993594496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986689.334216:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986689.335136:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971386368 00000100:00100000:2.0:1788986689.335146:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971386368 00000100:00100000:2.0:1788986689.335223:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1018 00000100:00100000:2.0:1788986689.335235:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54702:x1875885971386368:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986689.335345:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54702:x1875885971386368:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 113us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986689.335352:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1018 00000100:00080000:0.0:1788986689.335910:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986689.340673:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986689.341229:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971386496 00000100:00100000:2.0:1788986689.341239:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971386496 00000100:00100000:2.0:1788986689.341312:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 560 00000100:00100000:2.0:1788986689.341324:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54702:x1875885971386496:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986689.341725:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54702:x1875885971386496:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 402us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986689.341734:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 560 00000100:00080000:2.0:1788986689.341758:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986689.343250:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986689.344912:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971386624 00000100:00100000:2.0:1788986689.344925:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971386624 00000100:00100000:2.0:1788986689.345007:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 561 00000100:00100000:2.0:1788986689.345019:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54702:x1875885971386624:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986689.345716:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54702:x1875885971386624:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 697us (2470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986689.345724:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 561 00000100:00080000:2.0:1788986689.345754:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986689.348258:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986689.348299:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971386752 00000100:00100000:3.0:1788986689.348308:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971386752 00000100:00100000:3.0:1788986689.348351:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1019 00000100:00100000:3.0:1788986689.348361:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54702:x1875885971386752:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986689.350706:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54702:x1875885971386752:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 2339us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986689.350719:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1019 00000100:00100000:3.0:1788986689.364173:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986689.364206:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971386880 00000100:00100000:3.0:1788986689.364214:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971386880 00000100:00100000:3.0:1788986689.364263:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1020 00000100:00100000:3.0:1788986689.364273:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54702:x1875885971386880:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986689.364361:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54702:x1875885971386880:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 90us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986689.364369:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1020 00000100:00100000:3.0:1788986689.372785:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986689.372882:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971387008 00000100:00100000:3.0:1788986689.372891:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971387008 00000100:00100000:3.0:1788986689.372940:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 562 00000100:00100000:3.0:1788986689.372950:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54702:x1875885971387008:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986689.373297:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54702:x1875885971387008:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 347us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986689.373305:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 562 00000100:00100000:3.0:1788986689.379652:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986689.379696:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971387136 00000100:00100000:3.0:1788986689.379706:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971387136 00000100:00100000:3.0:1788986689.379766:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 563 00000100:00100000:3.0:1788986689.379778:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54702:x1875885971387136:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986689.380155:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54702:x1875885971387136:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 379us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986689.380163:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 563 00000100:00100000:3.0:1788986689.385892:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986689.385925:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971387264 00000100:00100000:3.0:1788986689.386058:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971387264 00000100:00100000:3.0:1788986689.386126:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1021 00000100:00100000:3.0:1788986689.386136:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54702:x1875885971387264:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986689.386861:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54702:x1875885971387264:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 724us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986689.386869:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1021 00000100:00100000:3.0:1788986689.420948:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986689.421044:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971387392 00000100:00100000:0.0:1788986689.421054:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971387392 00000100:00100000:0.0:1788986689.421129:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1022 00000100:00100000:0.0:1788986689.421139:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54703:x1875885971387392:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986689.421157:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986689.421177:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549957 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14aa expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986689.421264:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54995e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986689.421280:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54995e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986689.421293:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54995e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986689.421338:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:0.0:1788986689.421342:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986689.421360:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54995e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986689.421385:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549957 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14aa expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986689.421411:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54995e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14aa expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986689.421420:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45316400) 00010000:00010000:0.0:1788986689.421422:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986689.421426:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef000, rc 0) 00000100:00100000:0.0:1788986689.421483:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54703:x1875885971387392:12345-192.168.206.21@tcp:101:rm.0 Request processed in 345us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986689.421490:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1022 00000100:00100000:0.0:1788986689.426047:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986689.426135:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971387648 00000100:00100000:3.0:1788986689.426144:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971387648 00000100:00100000:3.0:1788986689.426198:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1023 00000100:00100000:3.0:1788986689.426209:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54703:x1875885971387648:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986689.426231:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986689.426252:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549965 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14b1 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986689.426340:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00010000:00010000:3.0:1788986689.426634:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549965 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14b1 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.426648:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:3.0:1788986689.426652:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788986689.426656:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549965 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14b1 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.426673:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986689.426732:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:54703:x1875885971387648:12345-192.168.206.21@tcp:101:rm.0 Request processed in 525us (692us total) trans 4294967682 rc 301/301 00000100:00100000:3.0:1788986689.426739:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1023 00000100:00100000:1.0:1788986689.442077:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986689.442323:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971387776 00000100:00100000:2.0:1788986689.442333:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971387776 00000100:00100000:2.0:1788986689.442396:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 100 00000100:00100000:2.0:1788986689.442409:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:54703:x1875885971387776:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:2.0:1788986689.453966:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:54703:x1875885971387776:12345-192.168.206.21@tcp:37:rm.0 Request processed in 11553us (11890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986689.453980:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 100 00000100:00100000:1.0:1788986689.471258:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986689.471293:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971388032 00000100:00100000:1.0:1788986689.471302:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971388032 00000100:00100000:1.0:1788986689.471349:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 101 00000100:00100000:1.0:1788986689.471358:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:54703:x1875885971388032:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:1.0:1788986689.471669:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:54703:x1875885971388032:12345-192.168.206.21@tcp:35:rm.0 Request processed in 311us (419us total) trans 4294967683 rc 0/0 00000100:00100000:1.0:1788986689.471677:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 101 00000100:00100000:3.0:1788986689.479583:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986689.479630:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971388288 00000100:00100000:3.0:1788986689.479639:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971388288 00000100:00100000:3.0:1788986689.479694:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1024 00000100:00100000:3.0:1788986689.479703:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:54703:x1875885971388288:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788986689.479755:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788986689.479781:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54995e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14aa expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.479800:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549903 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1495 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.479811:0:7899:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf549559) 00010000:00010000:3.0:1788986689.479816:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a45316400) 00010000:00010000:3.0:1788986689.479825:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986689.479847:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549973 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.479871:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549973 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.479881:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549973 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.479893:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54997a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.479899:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54997a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.479905:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54997a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480350:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549981 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480359:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549981 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480367:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549981 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480404:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549981 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480411:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549981 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480418:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549981 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480424:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986689.480428:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549981 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480435:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549981 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480444:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986689.480447:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986689.480451:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549981 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480456:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549981 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480474:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549973 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480479:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549973 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480484:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549973 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480489:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986689.480492:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549973 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480498:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549973 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480506:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:3.0:1788986689.480508:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986689.480511:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549973 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480517:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549973 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480526:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54997a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480531:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54997a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480536:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54997a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480541:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986689.480543:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54997a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480548:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54997a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480554:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a55745b00) 00010000:00010000:3.0:1788986689.480556:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986689.480559:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54997a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986689.480564:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54997a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986689.480649:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54703:x1875885971388288:12345-192.168.206.21@tcp:36:rm.0 Request processed in 945us (1072us total) trans 0 rc -13/-13 00000100:00100000:3.0:1788986689.480657:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1024 00010000:00010000:0.0:1788986689.545649:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986690.560312:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986690.674070:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986690.674130:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986690.674161:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986690.674182:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971388416 00000100:00100000:1.0:1788986690.674186:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986690.674191:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971388416 00000100:00100000:1.0:1788986690.674209:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971388672 00000100:00100000:1.0:1788986690.674212:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971388672 00000100:00100000:1.0:1788986690.674236:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971388800 00000100:00100000:3.0:1788986690.674238:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1363 00000100:00100000:1.0:1788986690.674238:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971388800 00000100:00100000:3.0:1788986690.674246:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971388416:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986690.674254:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1318 00000100:00100000:1.0:1788986690.674259:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971388672:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986690.674308:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971388672:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 48us (177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986690.674315:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1318 00000100:00100000:1.0:1788986690.674332:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1319 00000100:00100000:1.0:1788986690.674338:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971388800:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986690.678767:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971388544 00000100:00100000:2.0:1788986690.678781:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971388544 00000100:00100000:2.0:1788986690.678853:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1760 00000100:00100000:2.0:1788986690.678863:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971388544:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986690.680264:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971388416:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 6009us (6192us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986690.680277:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1363 00000100:00100000:1.0:1788986690.682587:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971388800:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 8239us (8390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986690.682600:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1319 00000100:00100000:2.0:1788986690.682750:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971388544:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 3887us (8586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986690.682759:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1760 00010000:00010000:0.0:1788986691.584766:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788986691.640468:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967683 is committed 00010000:00010000:1.0:1788986692.609954:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986692.615766:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993594624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986692.615825:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986692.615888:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993594624 00000100:00100000:2.0:1788986692.615895:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993594624 00000100:00100000:2.0:1788986692.615967:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 894 00000100:00100000:2.0:1788986692.615975:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993594624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986692.616007:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986692.616052:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993594624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986692.616059:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 894 00000100:00080000:2.0:1788986692.617006:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986692.617053:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993594624:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788986692.959349:0:93068:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdd6611120 20000000:00000080:3.0:1788986692.959365:0:93068:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0941daa800 uarg=0000000000000000 00010000:00010000:3.0:1788986692.964704:0:93068:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986692.964726:0:93068:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986692.964743:0:93068:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986692.964762:0:93068:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986692.964779:0:93068:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5498e0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf5498d9 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986692.964787:0:93068:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986692.964840:0:93068:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5498e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf5498d9 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986692.964855:0:93068:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5498e0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf5498d9 expref: 18 pid: 5849 timeout: 2576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986692.964869:0:93068:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93068:1875885993594752:0@lo:104: 00000100:00100000:3.0:1788986692.966207:0:93068:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986692.966328:0:93068:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7feff240 going to sleep for 11 seconds 00000100:00100000:2.0:1788986692.969188:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993594752 00000100:00100000:2.0:1788986692.969202:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993594752 00000100:00100000:3.0:1788986692.975305:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788986692.975319:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943706300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:93068:x1875885993594752:12345-0@lo:104: 00010000:00010000:3.0:1788986692.975337:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5498e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986692.975427:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986692.975432:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943706300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:93068:x1875885993594752:12345-0@lo:104: Request processed in 118us (9231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986692.975439:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:0.0:1788986692.975511:0:93068:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93068:1875885993594752:0@lo:104: 00010000:00010000:0.0:1788986692.975535:0:93068:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.976897:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986692.976907:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf5498e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.976917:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986692.976920:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf5498e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.976929:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf5498e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986692.976936:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf5498e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986692.976942:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986692.976995:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5498e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977002:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986692.977028:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5498e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977035:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf5498d9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf5498e0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977055:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986692.977057:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986692.977058:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986692.977073:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993594880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986692.977155:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986692.977215:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993594880 00000100:00100000:1.0:1788986692.977221:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993594880 00010000:00010000:1.0:1788986692.977247:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5498e0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5498d9 expref: 19 pid: 5849 timeout: 2576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986692.977272:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1788986692.977280:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993594880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986692.977291:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986692.977297:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5498e0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf5498d9 expref: 19 pid: 5849 timeout: 2576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977306:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5498e0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf5498d9 expref: 19 pid: 5849 timeout: 2576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977320:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf5498e0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf5498d9 expref: 19 pid: 5849 timeout: 2576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977333:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977341:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977356:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977363:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977370:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977376:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977382:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986692.977387:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977398:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977409:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986692.977418:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986692.977448:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993594880:12345-0@lo:103:ldlm_bl.0 Request processed in 170us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986692.977455:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00000100:00100000:1.0:1788986692.977488:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993594880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986692.977585:0:93068:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986692.977604:0:93068:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986692.977610:0:93068:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549988 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93068 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986693.634981:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993595008:0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.635051:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986693.635128:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993595520:0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.635204:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986693.635228:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986693.635234:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993595392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.635259:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986693.635288:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993595136:0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.635311:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986693.635326:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993595648:0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.635343:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986693.635359:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986693.635363:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993595264:0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.635381:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986693.635409:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993595392 00000100:00100000:3.0:1788986693.635416:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993595392 00000100:00100000:3.0:1788986693.635463:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993595648 00000100:00100000:3.0:1788986693.635465:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993595648 00000100:00100000:3.0:1788986693.635493:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1788986693.635502:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993595392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.635545:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993595392:12345-0@lo:400:kworker.0 Request processed in 45us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986693.635550:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1320 00000100:00100000:3.0:1788986693.635565:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1788986693.635571:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993595648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.635612:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993595648:12345-0@lo:400:kworker.0 Request processed in 42us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986693.635618:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1321 00000100:00100000:3.0:1788986693.635646:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993595520 00000100:00100000:3.0:1788986693.635650:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993595520 00000100:00100000:3.0:1788986693.635673:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993595136 00000100:00100000:3.0:1788986693.635676:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993595136 00000100:00100000:3.0:1788986693.635699:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993595264 00000100:00100000:3.0:1788986693.635702:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993595264 00000100:00100000:0.0:1788986693.635954:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1761 00000100:00100000:0.0:1788986693.635963:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993595520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986693.635998:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993595520:12345-0@lo:400:kworker.0 Request processed in 38us (794us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986693.636004:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1761 00000100:00100000:0.0:1788986693.636019:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1762 00000100:00100000:0.0:1788986693.636025:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993595136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986693.636052:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993595136:12345-0@lo:400:kworker.0 Request processed in 28us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986693.636058:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1762 00000100:00100000:0.0:1788986693.636069:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1763 00000100:00100000:0.0:1788986693.636075:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993595264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986693.636119:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993595264:12345-0@lo:400:kworker.0 Request processed in 44us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986693.636125:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1763 00010000:00010000:1.0:1788986693.636234:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986693.636245:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993595008 00000100:00100000:1.0:1788986693.636249:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993595008 00000100:00100000:1.0:1788986693.636287:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1364 00000100:00100000:1.0:1788986693.636294:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993595008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986693.636331:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993595008:12345-0@lo:400:kworker.0 Request processed in 38us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986693.636337:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1364 00000100:00080000:3.0:1788986693.636467:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986693.636471:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986693.636511:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943706d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993595264:0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.636525:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993595136:0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.636535:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993595648:0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.636573:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993595392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.636582:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993595008:0@lo:400:kworker.0 00000100:00100000:3.0:1788986693.636603:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993595520:0@lo:400:kworker.0 00000020:00000080:1.0:1788986693.900680:0:93116:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff2adba510 20000000:00000080:1.0:1788986693.900696:0:93116:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a44c53c00 uarg=0000000000000000 10000000:01000000:1.0:1788986693.900740:0:93116:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986693.900759:0:93116:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54998f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986693.900773:0:93116:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54998f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986693.900788:0:93116:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54998f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986693.900794:0:93116:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54998f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986693.900801:0:93116:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54998f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986693.900808:0:93116:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54998f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986693.900814:0:93116:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986693.900818:0:93116:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54998f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986693.900826:0:93116:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54998f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986693.900838:0:93116:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54998f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986693.900846:0:93116:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54998f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986693.900852:0:93116:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54998f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93116 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986694.149901:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986694.149923:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993595776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986694.149988:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986694.150159:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993595776 00000100:00100000:0.0:1788986694.150167:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993595776 00000100:00100000:0.0:1788986694.150220:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 895 00000100:00100000:0.0:1788986694.150229:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993595776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986694.150261:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986694.150315:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993595776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986694.150326:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 895 00000100:00100000:3.0:1788986694.150410:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993595776:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788986694.400376:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986694.400382:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986694.400386:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986694.400429:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986694.400440:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986694.400451:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986694.400474:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993595904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986694.400534:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986694.400597:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788986694.400690:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993595904 00000100:00100000:0.0:1788986694.400698:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993595904 00000100:00100000:0.0:1788986694.400761:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:0.0:1788986694.400770:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993595904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986694.400783:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986694.400796:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54999d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549996 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986694.400816:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54999d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549996 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986694.400826:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54999d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549996 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986694.400834:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee400, rc 0) 00000100:00100000:0.0:1788986694.400871:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993595904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986694.400877:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:1.0:1788986694.400957:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993595904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986694.400970:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54999d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986694.400979:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54999d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986694.400995:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986694.401000:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54999d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986694.401007:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54999d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986694.658240:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986695.680681:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986695.800421:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986695.800540:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986695.800585:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986695.800612:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986695.800641:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971389312 00000100:00100000:1.0:1788986695.800649:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971389312 00000100:00100000:1.0:1788986695.800699:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971389184 00000100:00100000:1.0:1788986695.800702:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971389184 00000100:00100000:1.0:1788986695.800725:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1322 00000100:00100000:1.0:1788986695.800735:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971389312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986695.800800:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971389312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 66us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986695.800807:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1322 00000100:00100000:1.0:1788986695.800823:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1323 00000100:00100000:1.0:1788986695.800829:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971389184:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986695.800849:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971389184:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 20us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986695.800855:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1323 00000100:00080000:1.0:1788986695.800872:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986695.800875:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986695.801083:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971389056 00000100:00100000:3.0:1788986695.801685:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971389056 00000100:00100000:3.0:1788986695.801734:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1764 00000100:00100000:3.0:1788986695.801752:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971389056:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986695.801791:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971389056:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 50us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986695.801798:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1764 00000100:00080000:1.0:1788986695.802751:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986695.803225:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971388928 00000100:00100000:2.0:1788986695.803232:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971388928 00000100:00100000:3.0:1788986695.803410:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1366 00000100:00100000:3.0:1788986695.803421:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971388928:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986695.803481:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971388928:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 62us (3067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986695.803488:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1366 00010000:00010000:0.0:1788986696.704322:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986696.987025:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986696.987209:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971389440 00000100:00100000:3.0:1788986696.987218:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971389440 00000100:00100000:3.0:1788986696.987282:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1025 00000100:00100000:3.0:1788986696.987292:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:54816:x1875885971389440:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986696.987310:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986696.987383:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14b8 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.987439:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5499ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.987452:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5499ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.987465:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5499ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986696.987499:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788986696.987503:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986696.987534:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5499ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.987558:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14b8 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.987590:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5499ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14b8 expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.987599:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:3.0:1788986696.987602:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986696.987605:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3800, rc 0) 00000100:00100000:3.0:1788986696.987671:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54816:x1875885971389440:12345-192.168.206.21@tcp:101:rm.0 Request processed in 380us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986696.987682:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1025 00000100:00100000:2.0:1788986696.990334:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986696.990467:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971389568 00000100:00100000:3.0:1788986696.990476:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971389568 00000100:00100000:3.0:1788986696.990538:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1026 00000100:00100000:3.0:1788986696.990554:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:54816:x1875885971389568:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986696.990584:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986696.990603:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5499b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14bf expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.990679:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5499b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.990694:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5499b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.990704:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5499b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.990739:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5499c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.990747:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5499c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.990753:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5499c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991244:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5499c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991254:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5499c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991265:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5499c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986696.991294:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00000004:00200000:3.0:1788986696.991297:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986696.991314:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5499c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991325:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5499b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991331:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5499b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991337:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5499b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991343:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986696.991347:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5499b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991355:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5499b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991506:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:3.0:1788986696.991508:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986696.991513:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5499b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991519:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf5499b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991537:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5499c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991544:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5499c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991549:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5499c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991554:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986696.991556:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5499c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991562:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5499c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991578:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a55745300) 00010000:00010000:3.0:1788986696.991580:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986696.991583:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5499c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991589:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf5499c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991620:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5499b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14bf expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991633:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5499c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14bf expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.991646:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745400) 00010000:00010000:3.0:1788986696.991649:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986696.991651:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2c00, rc 0) 00000100:00100000:3.0:1788986696.991956:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54816:x1875885971389568:12345-192.168.206.21@tcp:101:rm.0 Request processed in 1404us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986696.991964:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1026 00000100:00100000:1.0:1788986696.998395:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986696.998564:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971389824 00000100:00100000:3.0:1788986696.998583:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971389824 00000100:00100000:3.0:1788986696.998653:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1027 00000100:00100000:3.0:1788986696.998664:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54816:x1875885971389824:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986696.998684:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986696.998702:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14c6 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986696.998788:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00010000:00010000:3.0:1788986696.999020:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14c6 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.999033:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:3.0:1788986696.999036:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788986696.999054:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14c6 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986696.999065:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986696.999164:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:54816:x1875885971389824:12345-192.168.206.21@tcp:101:rm.0 Request processed in 502us (777us total) trans 4294967684 rc 301/301 00000100:00100000:3.0:1788986696.999174:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1027 00000100:00100000:1.0:1788986697.002600:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986697.002994:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971389952 00000100:00100000:2.0:1788986697.003004:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971389952 00000100:00100000:2.0:1788986697.003325:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 102 00000100:00100000:2.0:1788986697.003336:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:54816:x1875885971389952:12345-192.168.206.21@tcp:37:rm.0 00000100:00080000:1.0:1788986697.007883:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986697.013560:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:54816:x1875885971389952:12345-192.168.206.21@tcp:37:rm.0 Request processed in 10216us (10958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986697.013581:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 102 00000100:00100000:2.0:1788986697.016385:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986697.016537:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971390208 00000100:00100000:0.0:1788986697.016546:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971390208 00000100:00100000:0.0:1788986697.016602:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 103 00000100:00100000:0.0:1788986697.016612:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:54816:x1875885971390208:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:0.0:1788986697.016820:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:54816:x1875885971390208:12345-192.168.206.21@tcp:35:rm.0 Request processed in 209us (444us total) trans 4294967685 rc 0/0 00000100:00100000:0.0:1788986697.016827:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 103 00000100:00100000:1.0:1788986697.020345:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986697.020405:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971390464 00000100:00100000:0.0:1788986697.020414:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971390464 00000100:00100000:0.0:1788986697.020513:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1028 00000100:00100000:0.0:1788986697.020533:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:54816:x1875885971390464:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1788986697.020594:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986697.020619:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf5499c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4e:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14bf expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.020638:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a55745400) 00010000:00010000:0.0:1788986697.020653:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf5499ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14b8 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.020664:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:0.0:1788986697.020670:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986697.020691:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5499dc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.020703:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5499dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.020711:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5499dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.020722:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5499e3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.020729:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5499e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.020736:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5499e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.021181:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5499ea lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.021192:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5499ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.021200:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5499ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986697.023356:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x4e:0x0]: returning size 16384 00010000:00010000:0.0:1788986697.023490:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5499ea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023500:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5499ea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023508:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5499ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023513:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986697.023518:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5499ea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023596:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5499ea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023612:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4e:0x0].0x0 (ffff9b0a4823bd00) 00010000:00010000:0.0:1788986697.023615:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788986697.023620:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5499ea lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023631:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf5499ea lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023656:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5499dc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023663:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5499dc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023669:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5499dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023673:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986697.023676:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5499dc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023681:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5499dc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023688:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bb00) 00010000:00010000:0.0:1788986697.023691:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986697.023694:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5499dc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.023699:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf5499dc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986697.023711:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000030828f75 reply state 0000000057dbade2 transno 4294967686 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5499e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986697.023719:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986697.024160:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:54816:x1875885971390464:12345-192.168.206.21@tcp:36:rm.0 Request processed in 3634us (3819us total) trans 4294967686 rc 0/0 00000100:00100000:0.0:1788986697.024169:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1028 00010000:00010000:3.0:1788986697.026612:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5499e3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.026628:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5499e3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.026635:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5499e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.026642:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986697.026646:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5499e3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.026653:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5499e3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.026668:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a4823b900) 00010000:00010000:3.0:1788986697.026671:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986697.026676:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5499e3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.026681:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf5499e3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986697.083011:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986697.083346:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971390592 00000100:00100000:3.0:1788986697.083358:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971390592 00000100:00100000:3.0:1788986697.083452:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1029 00000100:00100000:3.0:1788986697.083466:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:54820:x1875885971390592:12345-192.168.206.21@tcp:101:mkdir.0 00010000:00010000:3.0:1788986697.083497:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986697.083526:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14cd expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.083616:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5499f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.083632:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5499f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.083645:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5499f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986697.083693:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788986697.083697:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986697.083720:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5499f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.083748:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14cd expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.083772:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5499f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14cd expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.083782:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986697.083785:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986697.083789:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2600, rc 0) 00000100:00100000:3.0:1788986697.083866:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:54820:x1875885971390592:12345-192.168.206.21@tcp:101:mkdir.0 Request processed in 403us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986697.083873:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1029 00000100:00100000:1.0:1788986697.091142:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986697.091186:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986697.091268:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971390720 00000100:00100000:3.0:1788986697.091281:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971390720 00000100:00100000:3.0:1788986697.091372:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971390976 00000100:00100000:3.0:1788986697.091376:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971390976 00000100:00100000:3.0:1788986697.091418:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1030 00000100:00100000:3.0:1788986697.091432:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:2346:x1875885971390720:12345-192.168.206.21@tcp:41:mkdir.0 00000004:00000024:3.0:1788986697.091501:0:5855:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788986697.091599:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:2346:x1875885971390720:12345-192.168.206.21@tcp:41:mkdir.0 Request processed in 170us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986697.091606:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1030 00000100:00100000:3.0:1788986697.091630:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1031 00000100:00100000:3.0:1788986697.091641:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:54820:x1875885971390976:12345-192.168.206.21@tcp:36:mkdir.0 00010000:00010000:3.0:1788986697.091684:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986697.091715:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf5499f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14cd expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.091736:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986697.091749:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986697.091840:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ff lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.091856:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.092276:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.092295:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a06 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.092308:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a06 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.092315:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a06 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986697.094642:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00010000:00010000:3.0:1788986697.094664:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ff lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.094675:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ff lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.094683:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.094690:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986697.094695:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ff lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.094704:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ff lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.094721:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986697.094724:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986697.094729:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ff lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.094736:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf5499ff lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986697.094763:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fcd7fc15 reply state 000000008283af63 transno 4294967687 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a06 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986697.094773:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986697.095436:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:54820:x1875885971390976:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 3790us (4240us total) trans 4294967687 rc 0/0 00000100:00100000:3.0:1788986697.095448:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1031 00010000:00010000:3.0:1788986697.098332:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a06 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.098354:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a06 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.098362:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a06 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.098369:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986697.098374:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a06 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.098384:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a06 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.098406:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a55745000) 00010000:00010000:3.0:1788986697.098409:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986697.098414:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a06 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.098420:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a06 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986697.159912:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986697.160047:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971391104 00000100:00100000:0.0:1788986697.160060:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971391104 00000100:00100000:0.0:1788986697.160180:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1032 00000100:00100000:0.0:1788986697.160192:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:54824:x1875885971391104:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:0.0:1788986697.160221:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986697.160250:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf549a0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14d4 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.160323:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549a14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.160339:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.160352:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986697.160394:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788986697.160398:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986697.160420:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549a14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.160444:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf549a0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14d4 expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.160467:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549a14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14d4 expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986697.160482:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bb00) 00010000:00010000:0.0:1788986697.160485:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986697.160489:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eea00, rc 0) 00000100:00100000:0.0:1788986697.160564:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:54824:x1875885971391104:12345-192.168.206.21@tcp:101:chown.0 Request processed in 375us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986697.160582:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1032 00000100:00100000:1.0:1788986697.167192:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986697.167280:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971391232 00000100:00100000:2.0:1788986697.167293:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971391232 00000100:00100000:2.0:1788986697.167366:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1033 00000100:00100000:2.0:1788986697.167389:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:54824:x1875885971391232:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:2.0:1788986697.167419:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986697.167456:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549a1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14db expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167543:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549a22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167562:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549a22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167587:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549a22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167606:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549a29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167613:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167625:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167738:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549a30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167747:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167754:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986697.167795:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:2.0:1788986697.167799:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986697.167823:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549a30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167837:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549a22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167844:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549a22 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167851:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549a22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167858:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986697.167863:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549a22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167871:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549a22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167886:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bb00) 00010000:00010000:2.0:1788986697.167890:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986697.167895:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549a22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167902:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549a22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167919:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549a29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167925:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549a29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167931:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549a29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167936:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986697.167939:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549a29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167945:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549a29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167953:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986697.167956:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986697.167959:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549a29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.167965:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549a29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.168006:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549a1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14db expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.168023:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549a30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14db expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986697.168033:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986697.168035:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986697.168233:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0600, rc 0) 00000100:00100000:2.0:1788986697.168322:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:54824:x1875885971391232:12345-192.168.206.21@tcp:101:chown.0 Request processed in 935us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986697.168330:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1033 00000100:00100000:2.0:1788986697.174006:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986697.174151:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971391488 00000100:00100000:3.0:1788986697.174165:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971391488 00000100:00100000:3.0:1788986697.174250:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1034 00000100:00100000:3.0:1788986697.174264:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:54824:x1875885971391488:12345-192.168.206.21@tcp:36:chown.0 00010000:00010000:3.0:1788986697.174338:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986697.174384:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549a30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14db expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.174408:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:3.0:1788986697.174421:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986697.174463:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.174481:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.174493:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788986697.275254:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967686 is committed 00000001:00080000:1.0:1788986697.275278:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967688 is committed 00000004:00010000:2.0:1788986697.275636:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ff84d0da reply state 00000000d6da9894 transno 4294967688 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986697.275654:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986697.275725:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00010000:00080000:2.0:1788986697.275898:0:5855:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788986697.275928:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:54824:x1875885971391488:12345-192.168.206.21@tcp:36:chown.0 Request processed in 101662us (101930us total) trans 4294967688 rc 0/0 00000100:00100000:2.0:1788986697.275938:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1034 00010000:00010000:3.0:1788986697.276268:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.276278:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a37 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.276287:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.276294:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986697.276300:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.276309:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a37 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.276328:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745000) 00010000:00010000:3.0:1788986697.276332:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986697.276338:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a37 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986697.276344:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986697.729065:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993596032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986697.729201:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986697.729526:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993596032 00000100:00100000:3.0:1788986697.729535:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993596032 00000100:00100000:3.0:1788986697.729732:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 896 00000100:00100000:3.0:1788986697.729761:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993596032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986697.729809:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788986697.730224:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986697.730349:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45158c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993596032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 607us (1146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986697.730358:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 896 00000100:00100000:1.0:1788986697.730780:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993596032:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986697.734966:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986698.155266:0:93313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffef2d132a0 20000000:00000080:3.0:1788986698.155290:0:93313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094295c400 uarg=0000000000000000 00010000:00010000:3.0:1788986698.156255:0:93313:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788986698.156296:0:93313:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823bb00) 00010000:00010000:3.0:1788986698.156300:0:93313:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986698.156311:0:93313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549a14 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14d4 expref: 5 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986698.156341:0:93313:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1788986698.156358:0:93313:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986698.156371:0:93313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986698.156383:0:93313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54999d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549996 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986698.156392:0:93313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986698.156429:0:93313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54999d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549996 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986698.156442:0:93313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54999d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549996 expref: 18 pid: 5848 timeout: 2582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986698.156455:0:93313:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93313:1875885993596160:0@lo:104: 00000100:00100000:3.0:1788986698.156615:0:93313:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986698.156674:0:93313:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a41254180 going to sleep for 11 seconds 00000100:00100000:1.0:1788986698.156987:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993596160 00000100:00100000:1.0:1788986698.156995:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993596160 00000100:00100000:1.0:1788986698.157043:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 369 00000100:00100000:1.0:1788986698.157054:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:93313:x1875885993596160:12345-0@lo:104: 00010000:00010000:1.0:1788986698.157068:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54999d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986698.157169:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986698.157176:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:93313:x1875885993596160:12345-0@lo:104: Request processed in 125us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986698.157185:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 369 00010000:00010000:0.0:1788986698.157248:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986698.157262:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54999d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157274:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986698.157280:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54999d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157291:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54999d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986698.157298:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54999d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986698.157305:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986698.157368:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54999d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157375:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986698.157419:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54999d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157432:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf549996 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54999d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157456:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986698.157458:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986698.157460:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986698.157501:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986698.157523:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993596288:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986698.157619:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986698.157709:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993596288 00000100:00100000:0.0:1788986698.157715:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993596288 00010000:00010000:0.0:1788986698.157747:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54999d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549996 expref: 19 pid: 5848 timeout: 2582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986698.157783:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:0.0:1788986698.157792:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a5abf2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993596288:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986698.157805:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986698.157810:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54999d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549996 expref: 19 pid: 5848 timeout: 2582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157821:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54999d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549996 expref: 19 pid: 5848 timeout: 2582 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157841:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157850:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157868:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157881:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157889:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157896:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157901:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986698.157907:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157915:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157923:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986698.157934:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986698.157984:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a5abf2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993596288:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986698.157991:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1788986698.158199:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993596288:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986698.158383:0:93313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54999d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549996 expref: 18 pid: 5848 timeout: 2582 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986698.158402:0:93313:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93313:1875885993596160:0@lo:104: 00010000:00010000:3.0:1788986698.158434:0:93313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986698.158446:0:93313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986698.158454:0:93313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986698.158460:0:93313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a3e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986698.756854:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986698.757228:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986698.757272:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986698.757290:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993596544:0@lo:400:kworker.0 00000100:00100000:1.0:1788986698.757361:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986698.757421:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993596544 00000100:00100000:1.0:1788986698.757429:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993596544 00000100:00100000:1.0:1788986698.757487:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1765 00000100:00100000:1.0:1788986698.757497:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993596544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986698.757542:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993596544:12345-0@lo:400:kworker.0 Request processed in 48us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986698.757549:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1765 00000100:00080000:1.0:1788986698.757581:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986698.757610:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993596544:0@lo:400:kworker.0 00000100:00100000:2.0:1788986698.759374:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993596416:0@lo:400:kworker.0 00000100:00100000:2.0:1788986698.759434:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986698.759610:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993596416 00000100:00100000:2.0:1788986698.759617:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993596416 00000100:00100000:2.0:1788986698.759730:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1766 00000100:00100000:2.0:1788986698.759741:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993596416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986698.759798:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993596416:12345-0@lo:400:kworker.0 Request processed in 59us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986698.759807:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1766 00000100:00100000:2.0:1788986698.759862:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993596416:0@lo:400:kworker.0 00000100:00100000:2.0:1788986698.760586:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993596672:0@lo:400:kworker.0 00000100:00100000:2.0:1788986698.760629:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986698.760686:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986698.760694:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993596800:0@lo:400:kworker.0 00000100:00100000:2.0:1788986698.760723:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986698.760764:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993596672 00000100:00100000:2.0:1788986698.760769:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993596672 00000100:00100000:2.0:1788986698.760815:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1788986698.760825:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993596672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986698.760873:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993596672:12345-0@lo:400:kworker.0 Request processed in 49us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986698.760882:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1324 00000100:00100000:2.0:1788986698.760911:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993596800 00000100:00100000:2.0:1788986698.760915:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993596800 00000100:00100000:2.0:1788986698.761186:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1767 00000100:00100000:2.0:1788986698.761195:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993596800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986698.761239:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993596800:12345-0@lo:400:kworker.0 Request processed in 45us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986698.761248:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1767 00000100:00100000:2.0:1788986698.761294:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993596800:0@lo:400:kworker.0 00000100:00100000:2.0:1788986698.761311:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993596672:0@lo:400:kworker.0 00000100:00100000:2.0:1788986698.761342:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986698.761352:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993596928:0@lo:400:kworker.0 00000100:00100000:2.0:1788986698.761393:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986698.761452:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993596928 00000100:00100000:2.0:1788986698.761457:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993596928 00000100:00100000:2.0:1788986698.761499:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1788986698.761508:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993596928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986698.761553:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993596928:12345-0@lo:400:kworker.0 Request processed in 47us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986698.761574:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1325 00000100:00100000:2.0:1788986698.761617:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993596928:0@lo:400:kworker.0 00000100:00080000:0.0:1788986698.762017:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986698.762022:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1788986699.024894:0:93361:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd8388790 20000000:00000080:1.0:1788986699.024909:0:93361:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a44c51c00 uarg=0000000000000000 10000000:01000000:1.0:1788986699.024949:0:93361:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986699.024967:0:93361:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf549a45 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.024981:0:93361:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf549a45 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.024992:0:93361:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf549a45 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.024999:0:93361:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf549a45 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.025006:0:93361:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf549a45 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.025013:0:93361:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf549a45 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.025019:0:93361:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986699.025025:0:93361:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf549a45 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.025176:0:93361:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf549a45 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.025188:0:93361:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf549a45 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.025197:0:93361:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf549a45 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.025204:0:93361:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf549a45 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93361 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986699.270222:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993597056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986699.270979:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986699.278739:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993597056 00000100:00100000:1.0:1788986699.278823:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993597056 00000100:00100000:1.0:1788986699.278881:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 897 00000100:00100000:1.0:1788986699.278891:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993597056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986699.278925:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986699.279003:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993597056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (8025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986699.279011:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 897 00000100:00100000:3.0:1788986699.282840:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993597056:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1788986699.520208:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986699.520217:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986699.520223:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986699.520269:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.520282:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.520299:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986699.520324:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8096e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993597184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986699.520409:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986699.520467:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788986699.520527:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993597184 00000100:00100000:2.0:1788986699.520535:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993597184 00000100:00100000:2.0:1788986699.520601:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1367 00000100:00100000:2.0:1788986699.520611:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993597184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986699.520624:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986699.520636:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549a53 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549a4c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986699.520662:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549a53 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549a4c expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986699.520673:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549a53 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549a4c expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986699.520681:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1200, rc 0) 00000100:00100000:2.0:1788986699.520742:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993597184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986699.520749:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1367 00000100:00100000:1.0:1788986699.521264:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8096e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993597184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986699.521280:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549a53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.521289:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549a53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986699.521310:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986699.521315:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549a53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986699.521322:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549a53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986699.776333:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986700.803407:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986700.927316:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986700.928727:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986700.928790:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986700.928820:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986700.928863:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971391616 00000100:00100000:2.0:1788986700.928872:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971391616 00000100:00100000:2.0:1788986700.928916:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1368 00000100:00100000:2.0:1788986700.928925:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971391616:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986700.928995:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971391616:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 71us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986700.929002:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1368 00000100:00100000:2.0:1788986700.929044:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971392000 00000100:00100000:2.0:1788986700.929048:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971392000 00000100:00100000:2.0:1788986700.929080:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971391872 00000100:00100000:2.0:1788986700.929082:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971391872 00000100:00100000:2.0:1788986700.929135:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1326 00000100:00100000:2.0:1788986700.929142:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971392000:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986700.929171:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971392000:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986700.929178:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1326 00000100:00100000:2.0:1788986700.929191:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1327 00000100:00100000:2.0:1788986700.929197:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971391872:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986700.929221:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971391872:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986700.929227:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1327 00000100:00080000:2.0:1788986700.929351:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986700.929355:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986700.934208:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971391744 00000100:00100000:1.0:1788986700.934222:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971391744 00000100:00100000:1.0:1788986700.936370:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1768 00000100:00100000:1.0:1788986700.936390:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971391744:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986700.936482:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971391744:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 99us (9173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986700.936491:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1768 00000100:00080000:2.0:1788986700.940298:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788986701.825215:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986702.288714:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986702.288881:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971392128 00000100:00100000:3.0:1788986702.288890:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971392128 00000100:00100000:3.0:1788986702.288965:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00100000:3.0:1788986702.288988:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5589:x1875885971392128:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986702.289003:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986702.289018:0:5839:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf549a14) 00010000:00010000:3.0:1788986702.289020:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986702.289069:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5589:x1875885971392128:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 95us (363us total) trans 0 rc 116/116 00000100:00100000:3.0:1788986702.289076:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 16 00000100:00080000:0.0:1788986702.289280:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986702.855148:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993597312:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986702.855215:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986702.855323:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993597312 00000100:00100000:2.0:1788986702.855331:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993597312 00000100:00100000:2.0:1788986702.855402:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 898 00000100:00100000:2.0:1788986702.855412:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993597312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986702.855445:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986702.855497:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993597312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986702.855504:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 898 00000100:00100000:2.0:1788986702.855563:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993597312:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986702.855609:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986702.856042:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986703.874001:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986703.874508:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993597824:0@lo:400:kworker.0 00000100:00100000:2.0:1788986703.874583:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986703.874638:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788986703.874644:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993597440:0@lo:400:kworker.0 00000100:00100000:2.0:1788986703.874673:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986703.874694:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993597952:0@lo:400:kworker.0 00000100:00100000:2.0:1788986703.874718:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986703.874745:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993597824 00000100:00100000:2.0:1788986703.874752:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993597824 00000100:00100000:2.0:1788986703.874793:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1788986703.874802:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993597824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986703.874847:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993597824:12345-0@lo:400:kworker.0 Request processed in 46us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986703.874853:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1328 00000100:00100000:2.0:1788986703.874871:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993597952 00000100:00100000:2.0:1788986703.874874:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993597952 00000100:00100000:2.0:1788986703.874900:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1769 00000100:00100000:2.0:1788986703.874905:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993597952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986703.874930:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993597952:12345-0@lo:400:kworker.0 Request processed in 25us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986703.874935:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1769 00000100:00080000:2.0:1788986703.874950:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986703.874975:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993597952:0@lo:400:kworker.0 00000100:00100000:2.0:1788986703.874984:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993597824:0@lo:400:kworker.0 00000100:00100000:3.0:1788986703.875046:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993597568:0@lo:400:kworker.0 00000100:00100000:3.0:1788986703.875075:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986703.875122:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993598080:0@lo:400:kworker.0 00000100:00100000:3.0:1788986703.875143:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986703.875161:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986703.875166:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993597696:0@lo:400:kworker.0 00000100:00100000:3.0:1788986703.875186:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986703.875210:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993597440 00000100:00100000:3.0:1788986703.875213:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993597440 00000100:00100000:3.0:1788986703.875236:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:3.0:1788986703.875241:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993597440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986703.875269:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993597440:12345-0@lo:400:kworker.0 Request processed in 28us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986703.875275:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00100000:3.0:1788986703.875298:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993598080 00000100:00100000:3.0:1788986703.875300:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993598080 00000100:00100000:3.0:1788986703.875323:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1329 00000100:00100000:3.0:1788986703.875327:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993598080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986703.875353:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993598080:12345-0@lo:400:kworker.0 Request processed in 25us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986703.875358:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1329 00000100:00100000:3.0:1788986703.875371:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993597568 00000100:00100000:3.0:1788986703.875373:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993597568 00000100:00100000:3.0:1788986703.875387:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993597696 00000100:00100000:3.0:1788986703.875389:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993597696 00000100:00100000:3.0:1788986703.875404:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1770 00000100:00100000:3.0:1788986703.875410:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993597568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986703.875436:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993597568:12345-0@lo:400:kworker.0 Request processed in 26us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986703.875441:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1770 00000100:00100000:3.0:1788986703.875453:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1771 00000100:00100000:3.0:1788986703.875459:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993597696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986703.875483:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993597696:12345-0@lo:400:kworker.0 Request processed in 25us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986703.875488:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1771 00000100:00080000:3.0:1788986703.875511:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986703.875514:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986703.875541:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993597696:0@lo:400:kworker.0 00000100:00100000:3.0:1788986703.875552:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993597568:0@lo:400:kworker.0 00000100:00100000:3.0:1788986703.875560:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993598080:0@lo:400:kworker.0 00000100:00100000:3.0:1788986703.875583:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993597440:0@lo:400:kworker.0 00000020:00000080:3.0:1788986703.895340:0:93607:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe80458bc0 20000000:00000080:3.0:1788986703.895355:0:93607:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094295d400 uarg=0000000000000000 00010000:00010000:3.0:1788986703.895845:0:93607:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986703.895860:0:93607:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986703.895873:0:93607:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986703.895889:0:93607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986703.895906:0:93607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549a53 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549a4c expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986703.895915:0:93607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986703.895949:0:93607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549a53 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549a4c expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986703.895963:0:93607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549a53 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549a4c expref: 18 pid: 5849 timeout: 2587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986703.895982:0:93607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93607:1875885993598208:0@lo:104: 00000100:00100000:3.0:1788986703.896042:0:93607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986703.896084:0:93607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c4a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788986703.896193:0:7642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788986703.896206:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993598208 00000100:00100000:0.0:1788986703.896213:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993598208 00000100:00100000:0.0:1788986703.896256:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788986703.896265:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094197ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:93607:x1875885993598208:12345-0@lo:104: 00010000:00010000:0.0:1788986703.896277:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549a53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986703.896329:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986703.896335:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094197ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:93607:x1875885993598208:12345-0@lo:104: Request processed in 72us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986703.896342:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00010000:00010000:1.0:1788986703.896527:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986703.896544:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549a53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896552:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986703.896556:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549a53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896564:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549a53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986703.896571:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549a53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986703.896577:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986703.896612:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549a53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896619:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986703.896646:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549a53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896653:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030e00/0xc20d828fcf549a4c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549a53 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896672:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986703.896674:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986703.896676:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986703.896683:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986703.896693:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8096f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993598336:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986703.896721:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986703.896754:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993598336 00000100:00100000:1.0:1788986703.896758:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993598336 00010000:00010000:1.0:1788986703.896776:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549a53 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549a4c expref: 19 pid: 5849 timeout: 2587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986703.896798:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1788986703.896804:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993598336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986703.896813:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986703.896818:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549a53 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549a4c expref: 19 pid: 5849 timeout: 2587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896828:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549a53 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549a4c expref: 19 pid: 5849 timeout: 2587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896842:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896849:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896862:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896873:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896878:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896884:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896888:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986703.896892:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896898:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896906:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986703.896914:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986703.896942:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993598336:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986703.896948:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00000100:00100000:1.0:1788986703.896983:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8096f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993598336:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986703.897278:0:93607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549a53 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549a4c expref: 18 pid: 5849 timeout: 2587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986703.897289:0:93607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93607:1875885993598208:0@lo:104: 00010000:00010000:3.0:1788986703.897302:0:93607:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986703.897310:0:93607:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986703.897316:0:93607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986703.897322:0:93607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549a5a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986704.386239:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993598464:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986704.386305:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986704.386664:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993598464 00000100:00100000:3.0:1788986704.386671:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993598464 00000100:00100000:3.0:1788986704.386723:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1788986704.386734:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993598464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986704.386763:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986704.386824:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993598464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986704.386831:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 899 00000100:00100000:3.0:1788986704.386877:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993598464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986704.897694:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788986705.156054:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986705.156062:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986705.156068:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986705.156330:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986705.156347:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986705.156358:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986705.156521:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8096f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993598592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986705.156592:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986705.156639:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0942afee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788986705.156693:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993598592 00000100:00100000:2.0:1788986705.156700:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993598592 00000100:00100000:2.0:1788986705.156747:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:2.0:1788986705.156755:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993598592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986705.156766:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986705.156777:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549a68 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549a61 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986705.156808:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549a68 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549a61 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986705.156818:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549a68 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549a61 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986705.156826:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0600, rc 0) 00000100:00100000:2.0:1788986705.156873:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993598592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986705.156880:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00000100:00100000:1.0:1788986705.157113:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8096f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993598592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986705.157128:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549a68 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986705.157137:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549a68 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986705.157156:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986705.157162:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549a68 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986705.157170:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549a68 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986705.920299:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986706.042436:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986706.042466:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986706.042489:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986706.042508:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986706.042542:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971392384 00000100:00100000:2.0:1788986706.042551:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971392384 00000100:00100000:2.0:1788986706.042613:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1772 00000100:00100000:2.0:1788986706.042622:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971392384:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986706.042690:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971392384:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 69us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986706.042697:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1772 00000100:00100000:2.0:1788986706.042733:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971392640 00000100:00100000:2.0:1788986706.042736:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971392640 00000100:00100000:2.0:1788986706.042758:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971392512 00000100:00100000:2.0:1788986706.042761:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971392512 00000100:00100000:2.0:1788986706.042782:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1330 00000100:00100000:2.0:1788986706.042789:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971392640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986706.042822:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971392640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986706.042828:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1330 00000100:00100000:2.0:1788986706.042842:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1331 00000100:00100000:2.0:1788986706.042849:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971392512:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986706.042872:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971392512:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986706.042878:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1331 00000100:00100000:3.0:1788986706.051175:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971392256 00000100:00100000:3.0:1788986706.051189:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971392256 00000100:00100000:3.0:1788986706.051268:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1371 00000100:00100000:3.0:1788986706.051279:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971392256:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986706.051348:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971392256:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (8857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986706.051355:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1371 00000100:00080000:3.0:1788986706.051384:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986706.051389:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986706.051391:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986706.892816:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986706.894291:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971392768 00000100:00100000:3.0:1788986706.894302:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971392768 00000100:00100000:3.0:1788986706.894367:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1035 00000100:00100000:3.0:1788986706.894379:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55003:x1875885971392768:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986706.894409:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986706.894431:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549a6f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14e2 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986706.894484:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a76 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986706.894496:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986706.894508:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986706.894552:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788986706.894555:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986706.894572:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a76 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986706.894593:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549a6f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14e2 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986706.894607:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a76 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14e2 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986706.894615:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986706.894618:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986706.894621:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2800, rc 0) 00000100:00100000:3.0:1788986706.894673:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55003:x1875885971392768:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 297us (1865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986706.894680:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1035 00000100:00100000:3.0:1788986706.900462:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986706.901973:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971392896 00000100:00100000:1.0:1788986706.901986:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971392896 00000100:00100000:1.0:1788986706.902049:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1036 00000100:00100000:1.0:1788986706.902059:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55003:x1875885971392896:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986706.902077:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986706.902125:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549a7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14e9 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902186:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549a84 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902201:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549a84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902213:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549a84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902229:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549a8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902236:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549a8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902243:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549a8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902534:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549a92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902543:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902551:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986706.902578:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:1.0:1788986706.902582:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986706.902598:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549a92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902610:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549a84 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902617:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549a84 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902624:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549a84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902630:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986706.902635:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549a84 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902642:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549a84 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902653:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:1.0:1788986706.902656:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986706.902661:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549a84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902668:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549a84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902680:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549a8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902686:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549a8b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902696:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549a8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902702:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986706.902705:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549a8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902711:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549a8b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902719:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a45316f00) 00010000:00010000:1.0:1788986706.902721:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986706.902724:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549a8b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902730:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549a8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902757:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549a7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14e9 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902770:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549a92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14e9 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.902778:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45316400) 00010000:00010000:1.0:1788986706.902781:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986706.902783:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788986706.902844:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55003:x1875885971392896:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 786us (2398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986706.902855:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1036 00000100:00100000:1.0:1788986706.920004:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986706.920080:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971393152 00000100:00100000:0.0:1788986706.920182:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971393152 00000100:00100000:0.0:1788986706.920249:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1037 00000100:00100000:0.0:1788986706.920259:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55003:x1875885971393152:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788986706.920314:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986706.920339:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549a92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14e9 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986706.920360:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45316400) 00010000:00010000:0.0:1788986706.920370:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986706.920390:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549a99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986706.920403:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549a99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986706.920416:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549a99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986706.947370:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788986706.966201:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967689 is committed 00000004:00010000:0.0:1788986706.966441:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001ffe7142 reply state 0000000026223f9e transno 4294967689 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549a99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986706.966455:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788986706.966469:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00010000:00080000:0.0:1788986706.966575:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788986706.966597:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55003:x1875885971393152:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 46336us (46615us total) trans 4294967689 rc 0/0 00000100:00100000:0.0:1788986706.966606:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1037 00010000:00010000:1.0:1788986706.966664:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549a99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.966672:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549a99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.966679:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549a99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.966684:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986706.966688:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549a99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.966696:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549a99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.966709:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a4823b100) 00010000:00010000:1.0:1788986706.966712:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986706.966716:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549a99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986706.966722:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef800/0xc20d828fcf549a99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788986707.576684:0:93804:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff76bc39e0 20000000:00000080:3.0:1788986707.576707:0:93804:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f3e5c00 uarg=0000000000000000 00010000:00010000:3.0:1788986707.579596:0:93804:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788986707.579643:0:93804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986707.579648:0:93804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986707.579659:0:93804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549a76 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14e2 expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986707.579744:0:93804:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:3.0:1788986707.579771:0:93804:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986707.579788:0:93804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986707.579803:0:93804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549a68 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549a61 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986707.579812:0:93804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986707.579857:0:93804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549a68 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549a61 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986707.579933:0:93804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549a68 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549a61 expref: 18 pid: 5849 timeout: 2591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986707.579950:0:93804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93804:1875885993598720:0@lo:104: 00000100:00100000:3.0:1788986707.580016:0:93804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986707.580136:0:93804:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a44db3000 going to sleep for 11 seconds 00000100:00100000:1.0:1788986707.580222:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993598720 00000100:00100000:1.0:1788986707.580229:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993598720 00000100:00100000:0.0:1788986707.580372:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 371 00000100:00100000:0.0:1788986707.580382:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:93804:x1875885993598720:12345-0@lo:104: 00010000:00010000:0.0:1788986707.580396:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549a68 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986707.580490:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986707.580497:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:93804:x1875885993598720:12345-0@lo:104: Request processed in 117us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986707.580504:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 371 00010000:00010000:1.0:1788986707.580571:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986707.580578:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549a68 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580587:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986707.580591:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549a68 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580600:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549a68 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986707.580607:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549a68 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986707.580613:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986707.580645:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549a68 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580653:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986707.580673:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549a68 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580679:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549a61 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549a68 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580706:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986707.580708:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986707.580710:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986707.580720:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8096c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993598848:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986707.580748:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986707.580786:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993598848 00000100:00100000:1.0:1788986707.580789:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993598848 00010000:00010000:1.0:1788986707.580807:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549a68 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549a61 expref: 19 pid: 5849 timeout: 2591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986707.580826:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1788986707.580832:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993598848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986707.580842:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986707.580847:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549a68 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549a61 expref: 19 pid: 5849 timeout: 2591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580856:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549a68 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549a61 expref: 19 pid: 5849 timeout: 2591 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580880:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580889:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580903:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580910:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580917:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580923:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580929:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986707.580933:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580941:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580950:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986707.580959:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986707.580985:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993598848:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986707.580992:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00000100:00100000:1.0:1788986707.581027:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8096c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993598848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986707.581351:0:93804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf549a68 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549a61 expref: 18 pid: 5849 timeout: 2591 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986707.581363:0:93804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:93804:1875885993598720:0@lo:104: 00010000:00010000:2.0:1788986707.581382:0:93804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986707.581391:0:93804:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986707.581398:0:93804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986707.581404:0:93804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549aa0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 93804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986707.968720:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986707.968958:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993598976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986707.969027:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986707.969292:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993598976 00000100:00100000:3.0:1788986707.969300:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993598976 00000100:00100000:3.0:1788986707.969353:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1788986707.969375:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993598976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986707.969417:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986707.969463:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993598976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986707.969470:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 900 00000100:00100000:3.0:1788986707.969522:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993598976:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986707.970052:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:0.0:1788986708.672580:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986708.672586:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986708.672590:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986708.672636:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986708.672648:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986708.672664:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986708.672687:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993599104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986708.672744:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986708.672790:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80e92b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788986708.672858:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993599104 00000100:00100000:3.0:1788986708.672865:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993599104 00000100:00100000:3.0:1788986708.672921:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1372 00000100:00100000:3.0:1788986708.672932:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993599104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986708.672943:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986708.672954:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549aae lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549aa7 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986708.672975:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549aae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549aa7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986708.672998:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549aae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549aa7 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986708.673006:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2800, rc 0) 00000100:00100000:3.0:1788986708.673050:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993599104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986708.673056:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1372 00000100:00100000:2.0:1788986708.673724:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993599104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986708.673741:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986708.673750:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986708.673778:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986708.673783:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986708.673790:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986708.997007:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993599360:0@lo:400:kworker.0 00000100:00100000:0.0:1788986708.997076:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986708.997153:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986708.997159:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993599488:0@lo:400:kworker.0 00000100:00100000:0.0:1788986708.997185:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986708.997223:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993599360 00000100:00100000:0.0:1788986708.997230:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993599360 00000100:00100000:0.0:1788986708.997278:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1773 00000100:00100000:0.0:1788986708.997287:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993599360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986708.997327:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993599360:12345-0@lo:400:kworker.0 Request processed in 43us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986708.997333:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1773 00000100:00080000:0.0:1788986708.997350:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986708.997388:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993599360:0@lo:400:kworker.0 00000100:00100000:1.0:1788986708.997598:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993599232:0@lo:400:kworker.0 00000100:00100000:1.0:1788986708.997626:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986708.997655:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993599744:0@lo:400:kworker.0 00000100:00100000:1.0:1788986708.997672:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986708.997689:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986708.997695:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993599616:0@lo:400:kworker.0 00000100:00100000:1.0:1788986708.997715:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986708.997740:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993599488 00000100:00100000:1.0:1788986708.997744:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993599488 00000100:00100000:1.0:1788986708.997770:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993599744 00000100:00100000:1.0:1788986708.997773:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993599744 00000100:00100000:1.0:1788986708.997798:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1788986708.997804:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993599488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986708.997832:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993599488:12345-0@lo:400:kworker.0 Request processed in 29us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986708.997837:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1332 00000100:00100000:1.0:1788986708.997848:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1788986708.997853:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993599744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986708.997877:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993599744:12345-0@lo:400:kworker.0 Request processed in 24us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986708.997882:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1333 00000100:00100000:1.0:1788986708.997895:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993599232 00000100:00100000:1.0:1788986708.997898:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993599232 00000100:00100000:1.0:1788986708.997914:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993599616 00000100:00100000:1.0:1788986708.997916:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993599616 00000100:00100000:1.0:1788986708.997929:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1774 00000100:00100000:1.0:1788986708.997934:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993599232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986708.997957:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993599232:12345-0@lo:400:kworker.0 Request processed in 23us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986708.997962:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1774 00000100:00100000:1.0:1788986708.997971:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1775 00000100:00100000:1.0:1788986708.997976:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993599616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986708.998002:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993599616:12345-0@lo:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986708.998007:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1775 00000100:00100000:1.0:1788986708.998035:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993599616:0@lo:400:kworker.0 00000100:00100000:1.0:1788986708.998044:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993599232:0@lo:400:kworker.0 00000100:00100000:1.0:1788986708.998053:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993599744:0@lo:400:kworker.0 00000100:00080000:2.0:1788986708.998244:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986708.998247:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986708.999688:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993599488:0@lo:400:kworker.0 00010000:00010000:0.0:1788986709.000165:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986709.504949:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986709.504972:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993599872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986709.505036:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986709.505115:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993599872 00000100:00100000:0.0:1788986709.505123:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993599872 00000100:00100000:0.0:1788986709.505173:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1788986709.505182:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993599872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986709.505211:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986709.505268:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993599872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986709.505274:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 901 00000100:00100000:0.0:1788986709.505315:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993599872:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986710.038113:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986710.640935:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986710.641069:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971393280 00000100:00100000:2.0:1788986710.641082:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971393280 00000100:00100000:2.0:1788986710.641199:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1038 00000100:00100000:2.0:1788986710.641212:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55079:x1875885971393280:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986710.641242:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986710.641269:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549ab5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14f0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641350:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549abc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641367:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549abc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641383:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549abc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641399:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ac3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641406:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641413:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641770:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549aca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641779:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641787:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986710.641813:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:2.0:1788986710.641817:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986710.641840:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549aca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641854:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549abc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641862:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549abc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641874:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549abc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641881:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986710.641886:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549abc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641894:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549abc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641919:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986710.641923:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986710.641929:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549abc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641936:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549abc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641950:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ac3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641955:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ac3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641961:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641966:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986710.641969:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ac3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641978:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ac3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641984:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986710.641987:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986710.641989:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ac3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.641994:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ac3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.642022:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549ab5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14f0 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.642036:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549aca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14f0 expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.642042:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986710.642044:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986710.642046:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0400, rc 0) 00000100:00100000:2.0:1788986710.642141:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55079:x1875885971393280:12345-192.168.206.21@tcp:101:touch.0 Request processed in 931us (1219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986710.642149:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1038 00000100:00080000:3.0:1788986710.643191:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986710.677732:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986710.677807:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971393536 00000100:00100000:2.0:1788986710.677819:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971393536 00000100:00100000:2.0:1788986710.677886:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1039 00000100:00100000:2.0:1788986710.677898:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55079:x1875885971393536:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986710.678251:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986710.678279:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549ad1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14f7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.678615:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ad8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.678634:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ad8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.678825:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ad8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.678844:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549adf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.678852:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549adf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.678859:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549adf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986710.682627:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x21:0x0], index 0: 0 00010000:00010000:2.0:1788986710.688887:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549ae6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.688926:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.688943:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549ae6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.689004:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ad8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.689012:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ad8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.689019:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ad8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.689026:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986710.689030:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ad8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.689038:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ad8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.689052:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986710.689056:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986710.689062:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ad8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.689068:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ad8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986710.689084:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000234b641 reply state 00000000c126c247 transno 4294967690 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549adf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986710.689119:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986710.689170:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf549ad1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14f7 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.689193:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549ae6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14f7 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.689201:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986710.689204:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986710.689206:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1a00, rc 0) 00000100:00100000:2.0:1788986710.689298:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:55079:x1875885971393536:12345-192.168.206.21@tcp:101:touch.0 Request processed in 11402us (11581us total) trans 4294967690 rc 0/0 00000100:00100000:2.0:1788986710.689309:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1039 00010000:00010000:1.0:1788986710.695128:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549adf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.695152:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549adf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.695161:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549adf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.695168:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986710.695174:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549adf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.695184:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549adf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.695204:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a45acac00) 00010000:00010000:1.0:1788986710.695208:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986710.695214:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549adf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.695221:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549adf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986710.717665:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986710.717716:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971393792 00000100:00100000:3.0:1788986710.717727:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971393792 00000100:00100000:3.0:1788986710.718083:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1040 00000100:00100000:3.0:1788986710.718116:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:55079:x1875885971393792:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:3.0:1788986710.718187:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986710.718220:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549ae6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14f7 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.718240:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:3.0:1788986710.718253:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986710.718303:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549af4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.718317:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.718328:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986710.722695:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000030921d77 reply state 000000008417deb0 transno 4294967691 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986710.722718:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986710.722881:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:55079:x1875885971393792:12345-192.168.206.21@tcp:36:touch.0 Request processed in 4765us (5224us total) trans 4294967691 rc 0/0 00000100:00100000:3.0:1788986710.722891:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1040 00000100:00100000:2.0:1788986710.740572:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:2.0:1788986710.740623:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549af4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.740639:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549af4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.740648:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549af4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.740656:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986710.740661:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549af4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.740670:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549af4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.740690:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:2.0:1788986710.740694:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986710.740701:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549af4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986710.740708:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549af4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986710.740839:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971393920 00000100:00100000:1.0:1788986710.740852:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971393920 00000100:00100000:1.0:1788986710.740918:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1041 00000100:00100000:1.0:1788986710.740930:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:55079:x1875885971393920:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986710.740960:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986710.740981:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549afb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d14fe expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.741048:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549afb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14fe expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.741063:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549afb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x55:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14fe expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.741084:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:1.0:1788986710.741110:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788986710.741113:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986710.741179:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:55079:x1875885971393920:12345-192.168.206.21@tcp:101:touch.0 Request processed in 251us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986710.741186:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1041 00000100:00100000:1.0:1788986710.746685:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986710.747884:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971394048 00000100:00100000:3.0:1788986710.747899:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971394048 00000100:00100000:3.0:1788986710.748118:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 564 00000100:00100000:3.0:1788986710.748147:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971394048:12345-192.168.206.21@tcp:2:touch.0 00000100:00100000:3.0:1788986710.750175:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971394048:12345-192.168.206.21@tcp:2:touch.0 Request processed in 2035us (3493us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788986710.750191:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 564 00000100:00080000:3.0:1788986710.750410:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986710.758569:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986710.758754:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971394304 00000100:00100000:2.0:1788986710.758766:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971394304 00000100:00100000:2.0:1788986710.758859:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00100000:2.0:1788986710.758871:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:55079:x1875885971394304:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:2.0:1788986710.759341:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:55079:x1875885971394304:12345-192.168.206.21@tcp:35:touch.0 Request processed in 470us (784us total) trans 4294967692 rc 0/0 00000100:00100000:2.0:1788986710.759350:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 104 00000100:00100000:2.0:1788986710.872976:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986710.873182:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971394432 00000100:00100000:0.0:1788986710.873194:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971394432 00000100:00100000:0.0:1788986710.873268:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1042 00000100:00100000:0.0:1788986710.873279:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:55083:x1875885971394432:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986710.873311:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986710.873337:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf549b02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1505 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873413:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873429:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873441:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873468:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549b10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873480:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873486:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873592:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549b17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873600:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549b17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873606:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549b17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986710.873643:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x55:0x0]: returning size 0 00000004:00200000:0.0:1788986710.873647:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986710.873667:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549b17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873679:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549b17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873688:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873695:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873701:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873712:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986710.873717:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873725:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873737:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:0.0:1788986710.873740:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986710.873755:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873762:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873778:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549b10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873784:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549b10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873790:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873796:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986710.873799:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549b10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873805:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549b10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873817:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a4823be00) 00010000:00010000:0.0:1788986710.873819:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986710.873822:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549b10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873828:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf549b10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873862:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf549b02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1505 expref: 12 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873877:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549b17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1505 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986710.873885:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:0.0:1788986710.873887:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986710.873890:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eee00, rc 0) 00000100:00100000:0.0:1788986710.873958:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:55083:x1875885971394432:12345-192.168.206.21@tcp:101:rm.0 Request processed in 681us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986710.873966:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1042 00000100:00100000:0.0:1788986710.896561:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986710.896696:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971394560 00000100:00100000:1.0:1788986710.896708:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971394560 00000100:00100000:1.0:1788986710.896784:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 565 00000100:00100000:1.0:1788986710.896795:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971394560:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986710.896816:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986710.896839:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf549b1e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d150c expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788986710.896870:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x6aa1c556, atime: 0x6aa1c556, ctime: 0x6aa1c556, blocks: 0x1 00010000:00010000:1.0:1788986710.897168:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=2494s v=(0 0) 00010000:00010000:1.0:1788986710.897174:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986710.897186:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf549b1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d150c expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.897211:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf549b1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d150c expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.897227:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00100000:1.0:1788986710.897307:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971394560:12345-192.168.206.21@tcp:101:rm.0 Request processed in 514us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986710.897314:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 565 00000100:00100000:1.0:1788986710.902699:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986710.902841:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971394816 00000100:00100000:3.0:1788986710.902854:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971394816 00000100:00100000:3.0:1788986710.903129:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1043 00000100:00100000:3.0:1788986710.903144:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:55083:x1875885971394816:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788986710.903213:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986710.903245:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549b17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x55:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1505 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.903270:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549afb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x55:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14fe expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.903282:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:3.0:1788986710.903294:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986710.903320:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549b25 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.903334:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549b25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.903344:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549b25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.903358:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549b2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.903366:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.903372:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.903852:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b33 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.903864:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.903873:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788986710.904912:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].33, 64 off10304 00000004:00080000:3.0:1788986710.904924:0:7899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2494807833966ns, next at 2495807831409ns, rc = 0 00010000:00010000:3.0:1788986710.904994:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549b3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905009:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905212:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549b3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905223:0:7899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549b3a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905230:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549b3a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905237:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549b3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905265:0:7899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986710.905295:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b33 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905302:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b33 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905308:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905315:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986710.905321:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b33 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905330:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b33 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905344:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:3.0:1788986710.905347:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986710.905353:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b33 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905360:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b33 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x55:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905383:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549b25 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905389:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549b25 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905394:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549b25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905399:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986710.905402:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549b25 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905407:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549b25 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905420:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:3.0:1788986710.905422:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986710.905425:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549b25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986710.905431:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549b25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986710.905440:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000053bc9e06 reply state 000000000d6c0bda transno 4294967693 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986710.905450:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986710.906189:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986710.906199:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549b3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.906207:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986710.906211:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549b3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.906218:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549b3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.906229:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x55:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:1.0:1788986710.906232:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788986710.906235:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549b3a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.906241:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf549b3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x55:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.906263:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986710.906265:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986710.906267:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986710.906356:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:55083:x1875885971394816:12345-192.168.206.21@tcp:36:rm.0 Request processed in 3212us (3664us total) trans 4294967693 rc 0/0 00000100:00100000:3.0:1788986710.906366:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1043 00010000:00010000:1.0:1788986710.911320:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549b2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.911340:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549b2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.911349:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549b2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.911355:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986710.911361:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549b2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.911369:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549b2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.911388:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a55745a00) 00010000:00010000:1.0:1788986710.911391:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986710.911396:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549b2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986710.911402:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549b2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986711.040798:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986711.159400:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986711.159449:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986711.159484:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971395072 00000100:00100000:1.0:1788986711.159514:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971395072 00000100:00100000:1.0:1788986711.159587:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 566 00000100:00100000:1.0:1788986711.159599:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971395072:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:1.0:1788986711.159650:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf5498e7 00000100:00080000:1.0:1788986711.159663:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9b0a7fa0d800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788986711.159709:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967361 00000100:00100000:1.0:1788986711.160025:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971395072:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 428us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986711.160034:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 566 00000100:00100000:1.0:1788986711.160060:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971394944 00000100:00100000:1.0:1788986711.160064:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971394944 00000100:00100000:1.0:1788986711.160114:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1373 00000100:00100000:1.0:1788986711.160122:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971394944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986711.160150:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971394944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986711.160156:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1373 00000100:00080000:1.0:1788986711.160183:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788986711.160198:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986712.068498:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788986712.190536:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967692 is committed 00000001:00080000:1.0:1788986712.190559:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967693 is committed 00000004:00080000:1.0:1788986712.190563:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 89 committed 00000100:00100000:1.0:1788986712.191471:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993600000:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788986712.191574:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986712.191669:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993600000 00000100:00100000:1.0:1788986712.191678:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993600000 00000100:00100000:1.0:1788986712.191762:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1788986712.191774:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993600000:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788986712.191814:0:8478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:33 count 1 00010000:00010000:1.0:1788986712.191846:0:8478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986712.191886:0:8478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf549b1e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d150c expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986712.191898:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788986712.191903:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986712.191909:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986712.191948:0:8478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf549b1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d150c expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986712.191978:0:8478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf549b1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d150c expref: 6 pid: 6697 timeout: 2596 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986712.191993:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8478:1875885993600128:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986712.192067:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094390b000 going to sleep for 11 seconds 00000100:00080000:1.0:1788986712.192081:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986712.223171:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8478:1875885993600128:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788986712.223216:0:8478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986712.225519:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986712.226013:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971395200 00000100:00100000:3.0:1788986712.226027:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971395200 00010000:00010000:3.0:1788986712.226144:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf549b1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d150c expref: 7 pid: 6697 timeout: 2596 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986712.226191:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 434 00000100:00100000:3.0:1788986712.226203:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971395200:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986712.226221:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986712.226229:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf549b1e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d150c expref: 7 pid: 6697 timeout: 2596 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986712.226244:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf549b1e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d150c expref: 7 pid: 6697 timeout: 2596 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986712.226278:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012df4e95/0xc20d828fcf549b1e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d150c expref: 7 pid: 6697 timeout: 2596 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986712.226299:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986712.226304:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986712.226311:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986712.226322:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986712.226355:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986712.226417:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971395200:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 216us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986712.226426:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 434 00010000:00010000:3.0:1788986712.226458:0:8478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986712.226468:0:8478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986712.226480:0:8478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986712.226500:0:8478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986712.226521:0:8478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788986712.227169:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993600000:12345-0@lo:6:osp-syn-0-0.0 Request processed in 35396us (35593us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788986712.227180:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00080000:2.0:1788986712.227280:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986712.229162:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986712.229177:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986712.229193:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986712.229199:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986712.229218:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986712.229246:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986712.229255:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019618814/0xc20d828fcf549b41 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986712.229289:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986712.229291:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986712.229293:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986712.231167:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a80d39f80/2, rc 0, transno 4294967363 00000100:00100000:3.0:1788986712.231185:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993600000:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788986713.088476:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986713.088536:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986713.088564:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993600256:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986713.088668:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986713.088960:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993600256 00000100:00100000:3.0:1788986713.088970:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993600256 00000100:00100000:3.0:1788986713.089212:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:3.0:1788986713.089224:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993600256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986713.089270:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986713.089581:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993600256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 358us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986713.089590:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:1.0:1788986713.089842:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993600256:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788986713.351660:0:94050:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe13b61b80 20000000:00000080:0.0:1788986713.351682:0:94050:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a761c7c00 uarg=0000000000000000 00010000:00010000:0.0:1788986713.352420:0:94050:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788986713.352466:0:94050:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:0.0:1788986713.352471:0:94050:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986713.352498:0:94050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549aca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d14f0 expref: 5 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986713.352527:0:94050:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1788986713.352547:0:94050:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986713.352565:0:94050:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986713.352581:0:94050:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549aae lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549aa7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986713.352589:0:94050:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986713.352636:0:94050:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549aae lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549aa7 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986713.352653:0:94050:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549aae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549aa7 expref: 18 pid: 5846 timeout: 2597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986713.352668:0:94050:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94050:1875885993600384:0@lo:104: 00000100:00100000:0.0:1788986713.352746:0:94050:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986713.352873:0:94050:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c6b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788986713.352964:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993600384 00000100:00100000:2.0:1788986713.352973:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993600384 00000100:00100000:2.0:1788986713.353069:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:2.0:1788986713.353080:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:94050:x1875885993600384:12345-0@lo:104: 00010000:00010000:2.0:1788986713.353121:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986713.353197:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986713.353204:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:94050:x1875885993600384:12345-0@lo:104: Request processed in 126us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986713.353211:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00010000:00010000:1.0:1788986713.353265:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986713.353274:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353281:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986713.353286:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353294:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986713.353301:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986713.353307:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986713.353342:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353348:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986713.353370:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353378:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549aa7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549aae expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353395:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986713.353397:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986713.353398:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986713.353420:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993600512:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986713.353456:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986713.353520:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993600512 00000100:00100000:1.0:1788986713.353525:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993600512 00010000:00010000:1.0:1788986713.353547:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549aae lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549aa7 expref: 19 pid: 5846 timeout: 2597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986713.353572:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1788986713.353578:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993600512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986713.353590:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986713.353595:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549aae lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549aa7 expref: 19 pid: 5846 timeout: 2597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353605:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549aae lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549aa7 expref: 19 pid: 5846 timeout: 2597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353621:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353630:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353644:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353652:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353659:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353666:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353677:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986713.353682:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353690:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353698:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986713.353708:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986713.353739:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993600512:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986713.353745:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:1.0:1788986713.353788:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993600512:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986713.353901:0:94050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549aae lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549aa7 expref: 18 pid: 5846 timeout: 2597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986713.353912:0:94050:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94050:1875885993600384:0@lo:104: 00010000:00010000:0.0:1788986713.353927:0:94050:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986713.353936:0:94050:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986713.353943:0:94050:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986713.353950:0:94050:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549b48 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94050 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986714.116705:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993600768:0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.116796:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986714.116869:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993601280:0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.116900:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986714.116930:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788986714.116938:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993600640:0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.116985:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986714.117012:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993601152:0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117037:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986714.117068:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993600896:0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117127:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986714.117148:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986714.117155:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993601024:0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117178:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788986714.117209:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986714.117228:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993601280 00000100:00100000:3.0:1788986714.117236:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993601280 00000100:00100000:3.0:1788986714.117301:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993601024 00000100:00100000:3.0:1788986714.117304:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993601024 00000100:00100000:3.0:1788986714.117332:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1788986714.117343:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993601280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117403:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993601280:12345-0@lo:400:kworker.0 Request processed in 63us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986714.117411:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1334 00000100:00100000:3.0:1788986714.117432:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1788986714.117439:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993601024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117474:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993601024:12345-0@lo:400:kworker.0 Request processed in 35us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986714.117492:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1335 00000100:00100000:3.0:1788986714.117514:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993600640 00000100:00100000:3.0:1788986714.117518:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993600640 00000100:00100000:3.0:1788986714.117546:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:3.0:1788986714.117554:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993600640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117585:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993600640:12345-0@lo:400:kworker.0 Request processed in 33us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986714.117592:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:3.0:1788986714.117622:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993600768 00000100:00100000:3.0:1788986714.117627:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993600768 00000100:00100000:3.0:1788986714.117652:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993601152 00000100:00100000:3.0:1788986714.117655:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993601152 00000100:00100000:3.0:1788986714.117673:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993600896 00000100:00100000:3.0:1788986714.117676:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993600896 00000100:00100000:3.0:1788986714.117690:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1776 00000100:00100000:3.0:1788986714.117695:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993600768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117725:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993600768:12345-0@lo:400:kworker.0 Request processed in 29us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986714.117730:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1776 00000100:00100000:3.0:1788986714.117742:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1777 00000100:00100000:3.0:1788986714.117748:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993601152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117774:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993601152:12345-0@lo:400:kworker.0 Request processed in 27us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986714.117779:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1777 00000100:00100000:3.0:1788986714.117790:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1778 00000100:00100000:3.0:1788986714.117796:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993600896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117823:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993600896:12345-0@lo:400:kworker.0 Request processed in 28us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986714.117830:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1778 00000100:00100000:3.0:1788986714.117894:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943706300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993601024:0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117904:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993600896:0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117934:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993600640:0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117945:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993601152:0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117958:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993600768:0@lo:400:kworker.0 00000100:00100000:3.0:1788986714.117967:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993601280:0@lo:400:kworker.0 00000100:00080000:2.0:1788986714.117993:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986714.117999:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986714.118001:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986714.626364:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993601408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986714.626457:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986714.626901:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993601408 00000100:00100000:0.0:1788986714.626912:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993601408 00000100:00100000:0.0:1788986714.626965:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1788986714.626975:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993601408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986714.627016:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986714.627075:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993601408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986714.627083:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:0.0:1788986714.627172:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993601408:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788986714.779741:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967363 is committed 00000001:00080000:1.0:1788986714.779761:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967362 is committed 00000001:00100000:2.0:1788986714.782443:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788986714.782454:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b0a7fa08000/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788986714.784699:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a7fa08000/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0001 00000020:00000080:2.0:1788986714.785354:0:489:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a7fa0d800 for lustre-OST0001 10000000:01000000:1.0:1788986715.072305:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986715.072314:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986715.072320:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986715.072389:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986715.072405:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986715.072419:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986715.072465:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993601536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986715.072670:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986715.072830:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eac000 going to sleep for 11 seconds 00000100:00100000:3.0:1788986715.078126:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993601536 00000100:00100000:3.0:1788986715.078144:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993601536 00000100:00100000:3.0:1788986715.078234:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1375 00000100:00100000:3.0:1788986715.078247:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993601536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986715.078268:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986715.078294:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf549b56 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549b4f expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986715.078328:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf549b56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549b4f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986715.078341:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf549b56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549b4f expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986715.078351:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3c00, rc 0) 00000100:00100000:3.0:1788986715.078445:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993601536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (5776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986715.078451:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1375 00000100:00100000:2.0:1788986715.080213:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993601536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986715.080251:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549b56 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986715.080264:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549b56 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986715.080294:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986715.080300:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549b56 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986715.080309:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549b56 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986715.143508:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986716.160377:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986716.277736:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986716.277803:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986716.277836:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986716.277883:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971395584 00000100:00100000:2.0:1788986716.277894:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971395584 00000100:00100000:2.0:1788986716.277982:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1336 00000100:00100000:2.0:1788986716.277995:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971395584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986716.278370:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971395328 00000100:00100000:1.0:1788986716.278375:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971395328 00000100:00100000:1.0:1788986716.278415:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1376 00000100:00100000:1.0:1788986716.278422:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971395328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986716.278453:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971395328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986716.278460:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1376 00000100:00100000:2.0:1788986716.278588:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971395584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 94us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986716.278599:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1336 00000100:00080000:2.0:1788986716.278632:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986716.279438:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971395456 00000100:00100000:3.0:1788986716.279448:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971395456 00000100:00100000:3.0:1788986716.279516:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1779 00000100:00100000:3.0:1788986716.279526:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971395456:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986716.279591:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971395456:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (1869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986716.279598:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1779 00000100:00080000:2.0:1788986716.281147:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986717.188807:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986717.646385:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986717.646545:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971395712 00000100:00100000:3.0:1788986717.646558:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971395712 00000100:00100000:3.0:1788986717.646671:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1044 00000100:00100000:3.0:1788986717.646682:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55171:x1875885971395712:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986717.646706:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986717.646729:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549b5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1513 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986717.646804:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986717.646821:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986717.646836:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986717.646893:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:3.0:1788986717.646898:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986717.646922:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986717.646964:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549b5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1513 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986717.646997:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1513 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986717.647011:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:3.0:1788986717.647015:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986717.647019:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3200, rc 0) 00000100:00100000:3.0:1788986717.647164:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55171:x1875885971395712:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 483us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986717.647171:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1044 00000100:00100000:3.0:1788986717.650534:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986717.650668:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971395968 00000100:00100000:2.0:1788986717.650680:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971395968 00000100:00100000:2.0:1788986717.650751:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1045 00000100:00100000:2.0:1788986717.650763:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55171:x1875885971395968:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986717.650828:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986717.650862:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549b64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1513 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986717.650887:0:5854:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf549aca) 00010000:00010000:2.0:1788986717.650892:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:2.0:1788986717.650905:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986717.650949:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf549b6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986717.650964:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf549b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986717.650976:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf549b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986717.682004:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000edf09b85 reply state 00000000a5e4a0ab transno 4294967694 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf549b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986717.682029:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986717.682051:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000100:00100000:2.0:1788986717.682209:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55171:x1875885971395968:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 31442us (31683us total) trans 4294967694 rc 0/0 00000100:00100000:2.0:1788986717.682223:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1045 00000001:00080000:1.0:1788986717.682506:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967694 is committed 00010000:00010000:2.0:1788986717.682554:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf549b6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986717.682565:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf549b6b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986717.682573:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf549b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986717.682580:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986717.682585:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf549b6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986717.682594:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf549b6b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986717.682613:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986717.682617:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986717.682623:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf549b6b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986717.682629:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf549b6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986718.208598:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993601664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986718.208666:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986718.209570:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993601664 00000100:00100000:2.0:1788986718.209579:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993601664 00000100:00100000:2.0:1788986718.209640:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 904 00000100:00100000:2.0:1788986718.209649:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993601664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986718.209682:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00010000:00010000:3.0:1788986718.212173:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986718.213071:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993601664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3416us (4398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986718.213083:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 904 00000100:00080000:2.0:1788986718.213137:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986718.215758:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967363 gen 2 00000004:00080000:1.0:1788986718.215769:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a80d39f80, transno 4294967363 00000100:00100000:1.0:1788986718.215804:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993601664:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788986718.300678:0:94249:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee3522ac0 20000000:00000080:3.0:1788986718.300695:0:94249:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a797dd400 uarg=0000000000000000 00010000:00010000:3.0:1788986718.301204:0:94249:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986718.301221:0:94249:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986718.301236:0:94249:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986718.301253:0:94249:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986718.301605:0:94249:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf549b56 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549b4f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986718.301616:0:94249:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986718.301657:0:94249:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf549b56 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549b4f expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986718.301672:0:94249:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf549b56 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549b4f expref: 18 pid: 5846 timeout: 2602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986718.301690:0:94249:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94249:1875885993601792:0@lo:104: 00000100:00100000:3.0:1788986718.301749:0:94249:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986718.301838:0:94249:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a457dc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986718.302243:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993601792 00000100:00100000:1.0:1788986718.302251:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993601792 00000100:00100000:1.0:1788986718.302302:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 373 00000100:00100000:1.0:1788986718.302311:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:94249:x1875885993601792:12345-0@lo:104: 00010000:00010000:1.0:1788986718.302323:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549b56 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.302431:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986718.302539:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:94249:x1875885993601792:12345-0@lo:104: Request processed in 229us (789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986718.302548:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 373 00010000:00010000:1.0:1788986718.302569:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986718.302575:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549b56 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.302582:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986718.302586:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549b56 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.302595:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549b56 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986718.302602:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549b56 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986718.302608:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986718.302645:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549b56 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.302652:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986718.302677:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549b56 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.302684:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40031600/0xc20d828fcf549b4f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549b56 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.302699:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986718.302702:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986718.302703:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986718.302710:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986718.302721:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993601920:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986718.302753:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986718.302784:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993601920 00000100:00100000:1.0:1788986718.302788:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993601920 00010000:00010000:1.0:1788986718.302805:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf549b56 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549b4f expref: 19 pid: 5846 timeout: 2602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986718.302826:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 436 00000100:00100000:1.0:1788986718.302832:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993601920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986718.302842:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986718.302847:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf549b56 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549b4f expref: 19 pid: 5846 timeout: 2602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.302857:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf549b56 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549b4f expref: 19 pid: 5846 timeout: 2602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.303025:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.303034:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.303048:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.303055:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.303062:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.303073:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.303078:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986718.303082:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.303116:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.303125:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986718.303134:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986718.303167:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993601920:12345-0@lo:103:ldlm_bl.0 Request processed in 335us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986718.303174:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 436 00000100:00100000:3.0:1788986718.303250:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993601920:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986718.305722:0:94249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf549b56 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549b4f expref: 18 pid: 5846 timeout: 2602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986718.305743:0:94249:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94249:1875885993601792:0@lo:104: 00010000:00010000:2.0:1788986718.305776:0:94249:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986718.305786:0:94249:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986718.305792:0:94249:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986718.305798:0:94249:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549b72 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94249 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986719.233181:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986719.235635:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993602304:0@lo:400:kworker.0 00000100:00100000:1.0:1788986719.235698:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986719.235763:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788986719.235770:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993602176:0@lo:400:kworker.0 00000100:00100000:1.0:1788986719.235792:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986719.235809:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993602688:0@lo:400:kworker.0 00000100:00100000:1.0:1788986719.235833:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986719.235861:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993602304 00000100:00100000:1.0:1788986719.235868:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993602304 00000100:00100000:1.0:1788986719.235933:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993602176 00000100:00100000:1.0:1788986719.235937:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993602176 00000100:00100000:1.0:1788986719.235958:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1780 00000100:00100000:1.0:1788986719.235966:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993602304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986719.236029:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993602304:12345-0@lo:400:kworker.0 Request processed in 64us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986719.236036:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1780 00000100:00100000:1.0:1788986719.236054:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1781 00000100:00100000:1.0:1788986719.236061:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993602176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986719.236117:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993602176:12345-0@lo:400:kworker.0 Request processed in 57us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986719.236123:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1781 00000100:00100000:1.0:1788986719.236158:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993602176:0@lo:400:kworker.0 00000100:00100000:1.0:1788986719.236170:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993602304:0@lo:400:kworker.0 00000100:00100000:3.0:1788986719.238799:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993602048:0@lo:400:kworker.0 00000100:00100000:3.0:1788986719.238863:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986719.238904:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993602560:0@lo:400:kworker.0 00000100:00100000:3.0:1788986719.238948:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986719.238992:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986719.239001:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993602432:0@lo:400:kworker.0 00000100:00100000:3.0:1788986719.239028:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986719.239028:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993602560 00000100:00100000:0.0:1788986719.239037:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993602560 00000100:00100000:3.0:1788986719.239070:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993602688 00000100:00100000:3.0:1788986719.239075:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993602688 00000100:00100000:0.0:1788986719.239121:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1782 00000100:00100000:3.0:1788986719.239129:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993602432 00000100:00100000:3.0:1788986719.239134:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993602432 00000100:00100000:0.0:1788986719.239134:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993602560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986719.239176:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1788986719.239186:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993602688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986719.239200:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993602560:12345-0@lo:400:kworker.0 Request processed in 69us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986719.239208:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1782 00000100:00100000:3.0:1788986719.239232:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993602688:12345-0@lo:400:kworker.0 Request processed in 49us (3398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986719.239239:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1337 00000100:00100000:3.0:1788986719.239257:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1338 00000100:00100000:3.0:1788986719.239267:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993602432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986719.239284:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993602560:0@lo:400:kworker.0 00000100:00100000:3.0:1788986719.239302:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993602432:12345-0@lo:400:kworker.0 Request processed in 38us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986719.239309:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1338 00000100:00100000:0.0:1788986719.239316:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993602432:0@lo:400:kworker.0 00000100:00100000:3.0:1788986719.239337:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993602048 00000100:00100000:3.0:1788986719.239341:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993602048 00000100:00100000:3.0:1788986719.239368:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:3.0:1788986719.239375:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993602048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986719.239411:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993602048:12345-0@lo:400:kworker.0 Request processed in 37us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986719.239416:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:3.0:1788986719.239475:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993602688:0@lo:400:kworker.0 00000100:00080000:0.0:1788986719.239491:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986719.239497:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986719.239507:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993602048:0@lo:400:kworker.0 10000000:01000000:3.0:1788986719.426054:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986719.426062:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986719.426067:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986719.426143:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986719.426157:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986719.426168:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986719.426194:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943706300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993602816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986719.426260:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986719.426306:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a516f4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788986719.426509:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993602816 00000100:00100000:0.0:1788986719.426517:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993602816 00000100:00100000:0.0:1788986719.426562:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:0.0:1788986719.426571:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993602816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986719.426585:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986719.426598:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549b80 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549b79 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986719.426619:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549b80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549b79 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986719.426630:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549b80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549b79 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986719.426638:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef800, rc 0) 00000100:00100000:0.0:1788986719.426688:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993602816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986719.426695:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00100000:3.0:1788986719.427878:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943706300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993602816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986719.427911:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986719.427921:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986719.427940:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986719.427945:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986719.427952:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986719.752034:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993602944:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986719.752113:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986719.753370:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993602944 00000100:00100000:2.0:1788986719.753380:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993602944 00000100:00100000:2.0:1788986719.753422:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 905 00000100:00100000:2.0:1788986719.753431:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993602944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986719.753473:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986719.753545:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993602944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986719.753553:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 905 00000100:00100000:1.0:1788986719.754103:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993602944:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986720.256700:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986721.281372:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986721.402455:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986721.402498:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986721.402521:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986721.404364:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971396352 00000100:00100000:2.0:1788986721.404381:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971396352 00000100:00100000:2.0:1788986721.404477:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1339 00000100:00100000:2.0:1788986721.404489:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971396352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986721.404580:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971396352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 94us (2058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986721.404588:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1339 00000100:00080000:2.0:1788986721.404611:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986721.413650:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971396224 00000100:00100000:0.0:1788986721.413669:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971396224 00000100:00100000:0.0:1788986721.413783:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1783 00000100:00100000:0.0:1788986721.413795:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971396224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986721.413920:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971396224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 127us (11490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986721.413930:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1783 00000100:00100000:0.0:1788986721.413960:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971396096 00000100:00100000:0.0:1788986721.413965:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971396096 00000100:00100000:0.0:1788986721.413992:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1379 00000100:00100000:0.0:1788986721.414000:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971396096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986721.414026:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971396096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (11527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986721.414033:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1379 00000100:00080000:0.0:1788986721.414068:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788986722.304942:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986722.467037:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986722.467455:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971396480 00000100:00100000:0.0:1788986722.467465:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971396480 00000100:00100000:0.0:1788986722.467512:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1046 00000100:00100000:0.0:1788986722.467522:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55248:x1875885971396480:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788986722.467542:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986722.467562:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549b87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d151a expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.467624:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549b8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.467637:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.467649:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.467662:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549b95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.467669:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.467675:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.467963:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.467974:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.467981:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986722.468002:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:0.0:1788986722.468006:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986722.468025:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468036:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549b8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468042:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549b8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468049:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549b8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468055:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986722.468060:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549b8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468067:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549b8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468078:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b400) 00010000:00010000:0.0:1788986722.468081:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986722.468086:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549b8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468113:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549b8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468124:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549b95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468130:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549b95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468135:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468140:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986722.468143:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549b95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468149:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549b95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468157:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a4823b800) 00010000:00010000:0.0:1788986722.468159:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986722.468162:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549b95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468172:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549b95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468200:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549b87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d151a expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468215:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d151a expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.468222:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:0.0:1788986722.468224:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986722.468226:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee000, rc 0) 00000100:00100000:0.0:1788986722.468285:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55248:x1875885971396480:12345-192.168.206.21@tcp:101:touch.0 Request processed in 764us (1255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986722.468293:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1046 00000100:00100000:1.0:1788986722.479112:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986722.479185:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971396736 00000100:00100000:2.0:1788986722.479195:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971396736 00000100:00100000:2.0:1788986722.479248:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1047 00000100:00100000:2.0:1788986722.479259:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55248:x1875885971396736:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986722.479278:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986722.479298:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ba3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1521 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479381:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549baa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479395:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549baa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479405:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549baa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479418:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549bb1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479425:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479447:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986722.479459:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00010000:00010000:2.0:1788986722.479476:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549baa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479483:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549baa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479489:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549baa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479494:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986722.479499:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549baa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479505:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549baa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479515:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:2.0:1788986722.479518:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986722.479522:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549baa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479529:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549baa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479540:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549bb1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479549:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549bb1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479555:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549bb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479559:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986722.479562:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549bb1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479568:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549bb1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479575:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a45acae00) 00010000:00010000:2.0:1788986722.479577:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986722.479580:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549bb1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479586:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549bb1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479616:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ba3 lrc: 1/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1521 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479625:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:2.0:1788986722.479627:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986722.479630:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549ba3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1521 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986722.479644:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788986722.479768:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55248:x1875885971396736:12345-192.168.206.21@tcp:101:touch.0 Request processed in 510us (686us total) trans 0 rc 301/301 00000100:00100000:2.0:1788986722.479776:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1047 00000100:00100000:2.0:1788986722.483652:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986722.483713:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971396864 00000100:00100000:3.0:1788986722.483724:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971396864 00000100:00100000:3.0:1788986722.483793:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1048 00000100:00100000:3.0:1788986722.483814:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55248:x1875885971396864:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:3.0:1788986722.483833:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986722.483853:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549bb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1528 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.483918:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549bbf lrc: 3/1,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.483932:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.483944:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.483957:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549bc6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.483963:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.483970:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.483989:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549bbf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.483996:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549bbf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484003:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484019:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986722.484023:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549bbf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484031:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549bbf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484042:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:3.0:1788986722.484045:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986722.484050:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549bbf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484057:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549bbf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484072:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549bc6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484109:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549bc6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484116:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484121:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986722.484124:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549bc6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484130:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549bc6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484138:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a55745800) 00010000:00010000:3.0:1788986722.484142:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986722.484146:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549bc6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484151:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549bc6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484182:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549bb8 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1528 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484197:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:3.0:1788986722.484199:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986722.484202:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549bb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1528 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986722.484210:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:2.0:1788986722.484426:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55248:x1875885971396864:12345-192.168.206.21@tcp:101:touch.0 Request processed in 615us (786us total) trans 0 rc 301/301 00000100:00100000:2.0:1788986722.484443:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1048 00000100:00100000:3.0:1788986722.490351:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986722.490500:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971396992 00000100:00100000:0.0:1788986722.490510:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971396992 00000100:00100000:0.0:1788986722.490576:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1049 00000100:00100000:0.0:1788986722.490587:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55248:x1875885971396992:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788986722.490605:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986722.490634:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549bcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d152f expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490699:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549bd4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490712:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490723:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490737:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549bdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490744:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490751:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490770:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549bd4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490777:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549bd4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490784:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490790:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986722.490804:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549bd4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490812:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549bd4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490823:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:0.0:1788986722.490826:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986722.490830:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549bd4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490836:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549bd4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490849:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549bdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490855:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549bdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490861:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549bdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490866:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986722.490868:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549bdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490873:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549bdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490880:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a4823b400) 00010000:00010000:0.0:1788986722.490883:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986722.490886:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549bdb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490891:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549bdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490919:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549bcd lrc: 1/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d152f expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490935:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:0.0:1788986722.490937:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986722.490941:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549bcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d152f expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986722.490949:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efc00, rc 0) 00000100:00100000:0.0:1788986722.491329:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55248:x1875885971396992:12345-192.168.206.21@tcp:101:touch.0 Request processed in 420us (662us total) trans 0 rc 301/301 00000100:00100000:0.0:1788986722.491339:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1049 00010000:00010000:3.0:1788986723.328265:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986723.328321:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986723.328341:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993603072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986723.328412:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986723.328585:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993603072 00000100:00100000:3.0:1788986723.328592:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993603072 00000100:00080000:0.0:1788986723.328650:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986723.328666:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:3.0:1788986723.328687:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993603072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986723.328727:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986723.328784:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993603072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986723.328791:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:0.0:1788986723.328832:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993603072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986724.356711:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986724.376352:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993603328:0@lo:400:kworker.0 00000100:00100000:1.0:1788986724.376417:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986724.376475:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993603840:0@lo:400:kworker.0 00000100:00100000:1.0:1788986724.376504:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986724.376528:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986724.376534:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993603456:0@lo:400:kworker.0 00000100:00100000:1.0:1788986724.376555:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986724.376585:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993603328 00000100:00100000:1.0:1788986724.376592:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993603328 00000100:00100000:1.0:1788986724.376629:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993603456 00000100:00100000:1.0:1788986724.376632:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993603456 00000100:00100000:1.0:1788986724.376658:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1784 00000100:00100000:1.0:1788986724.376666:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993603328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986724.376714:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993603328:12345-0@lo:400:kworker.0 Request processed in 48us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986724.376721:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1784 00000100:00100000:1.0:1788986724.376737:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1785 00000100:00100000:1.0:1788986724.376743:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993603456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986724.376771:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993603456:12345-0@lo:400:kworker.0 Request processed in 29us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986724.376777:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1785 00000100:00100000:1.0:1788986724.376812:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993603456:0@lo:400:kworker.0 00000100:00100000:1.0:1788986724.376822:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993603328:0@lo:400:kworker.0 00000100:00100000:0.0:1788986724.377209:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993603200:0@lo:400:kworker.0 00000100:00100000:0.0:1788986724.377243:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986724.377275:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993603712:0@lo:400:kworker.0 00000100:00100000:0.0:1788986724.377311:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986724.377336:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986724.377342:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993603584:0@lo:400:kworker.0 00000100:00100000:0.0:1788986724.377362:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986724.377390:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993603840 00000100:00100000:0.0:1788986724.377393:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993603840 00000100:00100000:0.0:1788986724.377450:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993603584 00000100:00100000:0.0:1788986724.377454:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993603584 00000100:00100000:0.0:1788986724.377472:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1788986724.377478:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993603840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986724.377515:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993603840:12345-0@lo:400:kworker.0 Request processed in 38us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986724.377521:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1340 00000100:00100000:0.0:1788986724.377532:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1341 00000100:00100000:0.0:1788986724.377538:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993603584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986724.377573:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993603584:12345-0@lo:400:kworker.0 Request processed in 36us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986724.377578:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1341 00000100:00080000:0.0:1788986724.377591:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986724.377595:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986724.377616:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993603584:0@lo:400:kworker.0 00000100:00100000:0.0:1788986724.377638:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941837b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993603840:0@lo:400:kworker.0 00000100:00100000:1.0:1788986724.378076:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993603200 00000100:00100000:1.0:1788986724.378081:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993603200 00000100:00100000:1.0:1788986724.378129:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:1.0:1788986724.378136:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993603200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986724.378172:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993603200:12345-0@lo:400:kworker.0 Request processed in 37us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986724.378178:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:2.0:1788986724.378251:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993603712 00000100:00100000:2.0:1788986724.378256:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993603712 00000100:00100000:2.0:1788986724.378310:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1786 00000100:00100000:2.0:1788986724.378317:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993603712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986724.378358:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993603712:12345-0@lo:400:kworker.0 Request processed in 42us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986724.378364:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1786 00000100:00080000:1.0:1788986724.379389:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986724.379670:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993603200:0@lo:400:kworker.0 00000100:00100000:0.0:1788986724.379686:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993603712:0@lo:400:kworker.0 00000020:00000080:0.0:1788986724.794899:0:94494:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd988aea50 20000000:00000080:0.0:1788986724.794917:0:94494:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a42c4b400 uarg=0000000000000000 00010000:00010000:0.0:1788986724.796017:0:94494:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788986724.796051:0:94494:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:0.0:1788986724.796055:0:94494:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986724.796065:0:94494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf549b9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d151a expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986724.796261:0:94494:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:0.0:1788986724.796280:0:94494:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986724.796449:0:94494:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986724.796470:0:94494:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549b80 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549b79 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986724.796479:0:94494:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986724.796514:0:94494:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549b80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549b79 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986724.796740:0:94494:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549b80 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549b79 expref: 18 pid: 5848 timeout: 2608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986724.796756:0:94494:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94494:1875885993603968:0@lo:104: 00000100:00100000:0.0:1788986724.796884:0:94494:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986724.797349:0:94494:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b6780 going to sleep for 11 seconds 00000100:00100000:3.0:1788986724.799046:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993603968 00000100:00100000:3.0:1788986724.799057:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993603968 00000100:00100000:3.0:1788986724.799872:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788986724.799890:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:94494:x1875885993603968:12345-0@lo:104: 00010000:00010000:3.0:1788986724.799907:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986724.799999:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986724.800005:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:94494:x1875885993603968:12345-0@lo:104: Request processed in 124us (3121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986724.800012:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00010000:2.0:1788986724.800065:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986724.800072:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.800080:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986724.800084:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.800113:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986724.800124:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986724.800129:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986724.800166:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.800173:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986724.800192:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.800199:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf549b79 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549b80 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.800215:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986724.800217:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986724.800219:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986724.800268:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986724.800284:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993604096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986724.800337:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986724.800429:0:94494:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94494:1875885993603968:0@lo:104: 00010000:00010000:0.0:1788986724.800448:0:94494:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986724.801214:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993604096 00000100:00100000:2.0:1788986724.801223:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993604096 00010000:00010000:2.0:1788986724.801247:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549b80 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549b79 expref: 19 pid: 5848 timeout: 2608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986724.801274:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 437 00000100:00100000:2.0:1788986724.801281:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45613c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993604096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986724.801300:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986724.801304:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549b80 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549b79 expref: 19 pid: 5848 timeout: 2608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.801315:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549b80 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549b79 expref: 19 pid: 5848 timeout: 2608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.801328:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549b80 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549b79 expref: 19 pid: 5848 timeout: 2608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.801341:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.801350:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.801378:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.801385:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.801393:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.801399:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.801405:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986724.801409:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.801416:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.801438:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986724.801451:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986724.801492:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45613c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993604096:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986724.801499:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 437 00000100:00100000:0.0:1788986724.801845:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993604096:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986724.801871:0:94494:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986724.801879:0:94494:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986724.801888:0:94494:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf549be2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94494 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986724.865250:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993604224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986724.865311:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986724.865363:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993604224 00000100:00100000:3.0:1788986724.865370:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993604224 00000100:00100000:3.0:1788986724.865438:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:3.0:1788986724.865449:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993604224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986724.865481:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986724.865542:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993604224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986724.865549:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:3.0:1788986724.865593:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80b43b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993604224:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986725.376221:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788986726.144362:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986726.144370:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986726.144376:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986726.144431:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986726.144442:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986726.144453:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986726.144478:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993604352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986726.144542:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986726.144630:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986726.148820:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993604352 00000100:00100000:1.0:1788986726.148833:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993604352 00000100:00100000:1.0:1788986726.148879:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:1.0:1788986726.148889:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993604352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986726.148904:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986726.148924:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549bf0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549be9 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986726.148948:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549bf0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549be9 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986726.148958:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549bf0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549be9 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986726.148966:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788986726.149031:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993604352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (4489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986726.149038:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:2.0:1788986726.149313:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993604352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986726.149331:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549bf0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986726.149341:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549bf0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986726.149360:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986726.149365:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549bf0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986726.149373:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549bf0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986726.400300:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986726.515456:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986726.515506:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986726.515543:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986726.515667:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971397376 00000100:00100000:3.0:1788986726.515675:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971397376 00000100:00100000:3.0:1788986726.515738:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1342 00000100:00100000:3.0:1788986726.515758:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971397376:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986726.515818:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971397376:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 73us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986726.515826:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1342 00000100:00100000:0.0:1788986726.515956:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971397120 00000100:00100000:0.0:1788986726.515961:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971397120 00000100:00100000:0.0:1788986726.516005:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1382 00000100:00100000:0.0:1788986726.516013:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971397120:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986726.516045:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971397120:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986726.516052:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1382 00000100:00100000:2.0:1788986726.516160:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971397248 00000100:00100000:2.0:1788986726.516166:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971397248 00000100:00100000:2.0:1788986726.516206:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1787 00000100:00100000:2.0:1788986726.516213:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971397248:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986726.516245:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971397248:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986726.516252:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1787 00000100:00080000:1.0:1788986726.516567:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986726.516572:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986727.424376:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986728.453576:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986728.460914:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986728.460935:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993604480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986728.460998:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986728.461065:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993604480 00000100:00100000:3.0:1788986728.461073:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993604480 00000100:00100000:3.0:1788986728.461173:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 908 00000100:00100000:3.0:1788986728.461185:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993604480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986728.461215:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986728.461258:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993604480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986728.461264:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 908 00000100:00080000:3.0:1788986728.461284:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986728.461317:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993604480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986728.812079:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986728.812262:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971397504 00000100:00100000:2.0:1788986728.812273:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971397504 00000100:00100000:2.0:1788986728.812339:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1050 00000100:00100000:2.0:1788986728.812349:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55335:x1875885971397504:12345-192.168.206.21@tcp:101:chmod.0 00000100:00080000:3.0:1788986728.812368:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986728.812369:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986728.812390:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549bf7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1536 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986728.812463:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549bfe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986728.812477:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986728.812490:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986728.812527:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:2.0:1788986728.812531:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986728.812551:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549bfe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986728.812589:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549bf7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1536 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986728.812613:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549bfe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1536 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986728.812622:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986728.812626:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986728.812629:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0200, rc 0) 00000100:00100000:2.0:1788986728.812690:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55335:x1875885971397504:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 341us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986728.812697:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1050 00000100:00100000:3.0:1788986728.815994:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986728.816189:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971397760 00000100:00100000:1.0:1788986728.816199:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971397760 00000100:00100000:1.0:1788986728.816249:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1051 00000100:00100000:1.0:1788986728.816258:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55335:x1875885971397760:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986728.816309:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986728.816334:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549bfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1536 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986728.816352:0:7899:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf549b9c) 00010000:00010000:1.0:1788986728.816356:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:1.0:1788986728.816367:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986728.816392:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549c05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986728.816415:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986728.816425:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986728.816757:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000078de1580 reply state 00000000598105b0 transno 4294967695 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986728.816767:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986728.816775:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000100:00100000:1.0:1788986728.816859:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55335:x1875885971397760:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 601us (874us total) trans 4294967695 rc 0/0 00000100:00100000:1.0:1788986728.816866:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1051 00010000:00010000:1.0:1788986728.819112:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549c05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986728.819128:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549c05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986728.819141:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549c05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986728.819148:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986728.819152:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549c05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986728.819159:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549c05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986728.819174:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45316500) 00010000:00010000:1.0:1788986728.819178:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986728.819182:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549c05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986728.819189:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549c05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986729.472327:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993604736:0@lo:400:kworker.0 00000100:00100000:1.0:1788986729.472389:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986729.472448:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993605248:0@lo:400:kworker.0 00000100:00100000:1.0:1788986729.472474:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986729.472497:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788986729.472503:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993604608:0@lo:400:kworker.0 00000100:00100000:1.0:1788986729.472530:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986729.472552:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993605120:0@lo:400:kworker.0 00000100:00100000:1.0:1788986729.472572:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986729.472597:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993604992:0@lo:400:kworker.0 00000100:00100000:1.0:1788986729.472618:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986729.472637:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986729.472642:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993604864:0@lo:400:kworker.0 00000100:00100000:1.0:1788986729.472664:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986729.472691:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993604736 00000100:00100000:1.0:1788986729.472698:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993604736 00000100:00100000:1.0:1788986729.472737:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993605120 00000100:00100000:1.0:1788986729.472740:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993605120 00000100:00100000:1.0:1788986729.472762:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993604864 00000100:00100000:1.0:1788986729.472765:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993604864 00000100:00100000:1.0:1788986729.472779:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1788 00000100:00100000:1.0:1788986729.472787:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993604736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986729.472836:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993604736:12345-0@lo:400:kworker.0 Request processed in 48us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986729.472843:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1788 00000100:00100000:1.0:1788986729.472860:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1789 00000100:00100000:1.0:1788986729.473067:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993605120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986729.473116:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993605120:12345-0@lo:400:kworker.0 Request processed in 52us (543us total) trans 0 rc 0/0 00000100:00080000:3.0:1788986729.473196:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986729.473230:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986729.479406:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993605248 00000100:00100000:0.0:1788986729.479418:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993605248 00000100:00100000:0.0:1788986729.479478:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993604992 00000100:00100000:0.0:1788986729.479482:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993604992 00000100:00100000:0.0:1788986729.479501:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1788986729.479509:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993605248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986729.479579:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993605248:12345-0@lo:400:kworker.0 Request processed in 72us (7105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986729.479586:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1343 00000100:00100000:0.0:1788986729.479600:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1788986729.479605:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993604992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986729.479636:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993604992:12345-0@lo:400:kworker.0 Request processed in 31us (7017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986729.479641:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1344 00000100:00100000:0.0:1788986729.479657:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993604608 00000100:00100000:0.0:1788986729.479660:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993604608 00000100:00100000:0.0:1788986729.479679:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1788986729.479683:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993604608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986729.479707:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993604608:12345-0@lo:400:kworker.0 Request processed in 24us (7177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986729.479713:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00080000:3.0:1788986729.479980:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986729.480285:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1790 00000100:00100000:2.0:1788986729.480303:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993604864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986729.480356:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1789 00000100:00100000:2.0:1788986729.483636:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993604864:12345-0@lo:400:kworker.0 Request processed in 3334us (10963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986729.483649:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1790 00000100:00100000:1.0:1788986729.484567:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993604992:0@lo:400:kworker.0 00000100:00100000:1.0:1788986729.484602:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993604864:0@lo:400:kworker.0 00000100:00100000:0.0:1788986729.490019:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993604608:0@lo:400:kworker.0 00000100:00100000:2.0:1788986729.490188:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993605120:0@lo:400:kworker.0 00000100:00100000:2.0:1788986729.490201:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942cc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993604736:0@lo:400:kworker.0 00000100:00100000:2.0:1788986729.490212:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993605248:0@lo:400:kworker.0 00000020:00000080:0.0:1788986729.852669:0:94692:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffbeacf3b0 20000000:00000080:0.0:1788986729.852686:0:94692:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a42c4a800 uarg=0000000000000000 00010000:00010000:0.0:1788986729.854362:0:94692:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986729.854381:0:94692:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986729.854405:0:94692:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986729.854423:0:94692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986729.854440:0:94692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549bf0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549be9 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986729.854447:0:94692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986729.854482:0:94692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549bf0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549be9 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986729.854496:0:94692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549bf0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549be9 expref: 18 pid: 5848 timeout: 2613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986729.854509:0:94692:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94692:1875885993605376:0@lo:104: 00000100:00100000:0.0:1788986729.854564:0:94692:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986729.854619:0:94692:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80e929c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986729.854769:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993605376 00000100:00100000:2.0:1788986729.854776:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993605376 00000100:00100000:2.0:1788986729.854815:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 375 00000100:00100000:2.0:1788986729.854824:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:94692:x1875885993605376:12345-0@lo:104: 00010000:00010000:2.0:1788986729.854836:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549bf0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986729.854904:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986729.854910:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:94692:x1875885993605376:12345-0@lo:104: Request processed in 88us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986729.854917:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 375 00010000:00010000:3.0:1788986729.854984:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986729.854991:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549bf0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986729.854998:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986729.855002:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549bf0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986729.855010:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549bf0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986729.855017:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549bf0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986729.855023:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986729.855057:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549bf0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986729.855063:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986729.855082:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549bf0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986729.855112:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2000/0xc20d828fcf549be9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549bf0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986729.855128:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986729.855130:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986729.855132:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986729.855143:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993605504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986729.855173:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986729.855259:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993605504 00000100:00100000:1.0:1788986729.855264:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993605504 00010000:00010000:1.0:1788986729.855284:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549bf0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549be9 expref: 19 pid: 5848 timeout: 2613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986729.855318:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1788986729.855325:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993605504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986729.855335:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986729.855339:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549bf0 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549be9 expref: 19 pid: 5848 timeout: 2613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986729.855347:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549bf0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549be9 expref: 19 pid: 5848 timeout: 2613 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986729.855360:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986729.855367:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986729.855379:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986729.855385:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986729.855404:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986729.855410:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986729.855414:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986729.855418:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986729.855424:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986729.855431:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986729.855439:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986729.855472:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993605504:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986729.855478:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 438 00000100:00100000:1.0:1788986729.855509:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993605504:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986729.856043:0:94692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf549bf0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549be9 expref: 18 pid: 5848 timeout: 2613 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986729.856056:0:94692:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:94692:1875885993605376:0@lo:104: 00010000:00010000:0.0:1788986729.856070:0:94692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986729.856079:0:94692:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986729.856085:0:94692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986729.856160:0:94692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549c0c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 94692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986729.984298:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993605632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986729.984363:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986729.984925:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993605632 00000100:00100000:3.0:1788986729.984943:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993605632 00000100:00100000:3.0:1788986729.985000:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 909 00000100:00100000:3.0:1788986729.985012:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993605632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986729.985043:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986729.985119:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993605632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986729.985126:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 909 00000100:00100000:3.0:1788986729.985174:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993605632:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986730.499332:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788986731.456256:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986731.456263:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986731.456268:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986731.456316:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986731.456328:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986731.456338:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986731.456361:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993605760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986731.456518:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986731.456655:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993605760 00000100:00100000:3.0:1788986731.456667:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993605760 00000100:00100000:3.0:1788986731.456725:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:3.0:1788986731.456734:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993605760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986731.456747:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986731.456760:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf549c1a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549c13 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986731.456782:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf549c1a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549c13 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986731.456792:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf549c1a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549c13 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986731.456800:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3200, rc 0) 00000100:00100000:3.0:1788986731.456834:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993605760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986731.456840:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:2.0:1788986731.456975:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a581613c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986731.456999:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993605760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986731.457013:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549c1a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986731.457021:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549c1a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986731.457039:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986731.457043:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549c1a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986731.457050:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549c1a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986731.520648:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986731.635180:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986731.635215:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986731.635249:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986731.635351:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971398144 00000100:00100000:3.0:1788986731.635360:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971398144 00000100:00100000:3.0:1788986731.635438:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 568 00000100:00100000:3.0:1788986731.635450:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971398144:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788986731.635478:0:86533:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf5495e5 00000100:00080000:3.0:1788986731.635490:0:86533:0:(import.c:65:import_set_state_nolock()) ffff9b094371e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788986731.635522:0:86533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967363 00000100:00100000:2.0:1788986731.635860:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971397888 00000100:00100000:2.0:1788986731.635865:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971397888 00000100:00100000:2.0:1788986731.635895:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1385 00000100:00100000:2.0:1788986731.635903:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971397888:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986731.636065:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971397888:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 162us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986731.636073:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1385 00000100:00100000:0.0:1788986731.636403:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971398016 00000100:00100000:0.0:1788986731.636408:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971398016 00000100:00100000:0.0:1788986731.636442:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1791 00000100:00100000:0.0:1788986731.636450:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971398016:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986731.636486:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971398016:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986731.636492:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1791 00010000:00010000:0.0:1788986731.636517:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986731.637207:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971398144:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 1758us (1954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986731.637217:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 568 00000100:00080000:3.0:1788986731.637239:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986731.637244:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986732.544257:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986733.062667:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986733.063744:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971398272 00000100:00100000:0.0:1788986733.063754:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971398272 00000100:00100000:0.0:1788986733.063820:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1052 00000100:00100000:0.0:1788986733.063832:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55419:x1875885971398272:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986733.063934:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55419:x1875885971398272:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 104us (1273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986733.063941:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1052 00000100:00080000:3.0:1788986733.065208:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986733.070412:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986733.073905:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971398400 00000100:00100000:2.0:1788986733.073920:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971398400 00000100:00100000:2.0:1788986733.074209:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 569 00000100:00100000:2.0:1788986733.074219:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1875885971398400:12345-192.168.206.21@tcp:8:lfs.0 00010000:00080000:2.0:1788986733.074252:0:6698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 2516 last 0 00000020:00000080:2.0:1788986733.074463:0:6698:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf549c21 00002000:00100000:2.0:1788986733.074475:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b094371d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788986733.074497:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788986733.074584:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788986733.074616:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9b094371d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788986733.074726:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971398400:12345-192.168.206.21@tcp:8:lfs.0 Request processed in 507us (4323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986733.074735:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 569 00000001:00080000:3.0:1788986733.082757:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967695 is committed 00000100:00100000:3.0:1788986733.088687:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986733.088799:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971398528 00000100:00100000:0.0:1788986733.088808:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971398528 00000100:00100000:0.0:1788986733.088886:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 570 00000100:00100000:0.0:1788986733.088897:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55419:x1875885971398528:12345-192.168.206.21@tcp:19:lfs.0 00000100:00080000:3.0:1788986733.089476:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986733.089760:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55419:x1875885971398528:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 862us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986733.089769:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 570 00000100:00100000:3.0:1788986733.092407:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986733.092488:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971398656 00000100:00100000:0.0:1788986733.092497:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971398656 00000100:00100000:0.0:1788986733.092667:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 571 00000100:00100000:0.0:1788986733.092675:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2345:x1875885971398656:12345-192.168.206.21@tcp:8:lfs.0 00010000:00080000:0.0:1788986733.092705:0:86533:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 2516 last 0 00000020:00000080:0.0:1788986733.092748:0:86533:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf549c28 00002000:00100000:0.0:1788986733.093484:0:86533:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b0a489ef000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788986733.093509:0:86533:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788986733.093729:0:86533:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788986733.093779:0:86533:0:(import.c:65:import_set_state_nolock()) ffff9b0a489e9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788986733.093851:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971398656:12345-192.168.206.21@tcp:8:lfs.0 Request processed in 1174us (1451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986733.093860:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 571 00000100:00100000:3.0:1788986733.095987:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986733.096130:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971398784 00000100:00100000:2.0:1788986733.096140:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971398784 00000100:00100000:2.0:1788986733.096205:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 572 00000100:00100000:2.0:1788986733.096214:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55419:x1875885971398784:12345-192.168.206.21@tcp:19:lfs.0 00000100:00080000:3.0:1788986733.096520:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986733.096591:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55419:x1875885971398784:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 377us (611us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986733.096600:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 572 00000100:00100000:3.0:1788986733.099043:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986733.099173:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971398912 00000100:00100000:2.0:1788986733.099182:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971398912 00000100:00100000:2.0:1788986733.099235:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1053 00000100:00100000:2.0:1788986733.099253:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55419:x1875885971398912:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986733.099733:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55419:x1875885971398912:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 489us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986733.099741:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1053 00000100:00100000:3.0:1788986733.102660:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986733.102768:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971399040 00000100:00100000:2.0:1788986733.102777:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971399040 00000100:00100000:2.0:1788986733.102840:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1054 00000100:00100000:2.0:1788986733.102980:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55419:x1875885971399040:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986733.103076:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55419:x1875885971399040:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 101us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986733.103083:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1054 00000100:00100000:2.0:1788986733.104647:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986733.104728:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971399168 00000100:00100000:0.0:1788986733.104736:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971399168 00000100:00100000:0.0:1788986733.104784:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 573 00000100:00100000:0.0:1788986733.104793:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55419:x1875885971399168:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986733.105295:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55419:x1875885971399168:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 502us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986733.105304:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 573 00000100:00100000:3.0:1788986733.107186:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986733.107371:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971399296 00000100:00100000:0.0:1788986733.107389:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971399296 00000100:00100000:0.0:1788986733.107439:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 574 00000100:00100000:0.0:1788986733.107449:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55419:x1875885971399296:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986733.107915:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55419:x1875885971399296:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 466us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986733.107924:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 574 00000100:00100000:3.0:1788986733.110524:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986733.110621:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971399424 00000100:00100000:0.0:1788986733.110629:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971399424 00000100:00100000:0.0:1788986733.110684:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1055 00000100:00100000:0.0:1788986733.110693:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55419:x1875885971399424:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986733.111158:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55419:x1875885971399424:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 465us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986733.111167:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1055 00000100:00100000:1.0:1788986733.196699:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986733.196783:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971399552 00000100:00100000:2.0:1788986733.196791:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971399552 00000100:00100000:2.0:1788986733.196851:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1056 00000100:00100000:2.0:1788986733.196860:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55423:x1875885971399552:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788986733.196878:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986733.196897:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549c2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d153d expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.196964:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549c36 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.196977:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549c36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.196989:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549c36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197001:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549c3d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197008:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197015:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197352:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf549c44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197361:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf549c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197368:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf549c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986733.197399:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:2.0:1788986733.197402:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986733.197418:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf549c44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197433:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549c36 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197440:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549c36 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197447:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549c36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197452:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986733.197456:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549c36 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197463:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549c36 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197474:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:2.0:1788986733.197477:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986733.197481:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549c36 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197487:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf549c36 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197498:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549c3d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197503:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549c3d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197508:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549c3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197513:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986733.197517:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549c3d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197522:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549c3d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197528:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a45aca200) 00010000:00010000:2.0:1788986733.197530:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986733.197532:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549c3d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197537:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf549c3d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197564:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf549c2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d153d expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197578:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf549c44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d153d expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.197585:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:2.0:1788986733.197587:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986733.197589:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0c00, rc 0) 00000100:00100000:2.0:1788986733.197647:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55423:x1875885971399552:12345-192.168.206.21@tcp:101:dd.0 Request processed in 788us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986733.197653:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1056 00000100:00100000:3.0:1788986733.204201:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986733.204462:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971399808 00000100:00100000:0.0:1788986733.204472:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971399808 00000100:00100000:0.0:1788986733.204529:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1057 00000100:00100000:0.0:1788986733.204540:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55423:x1875885971399808:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:0.0:1788986733.204559:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986733.204577:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549c4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1544 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.204831:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549c52 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.204863:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549c52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.204874:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549c52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.204890:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549c59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.204898:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.204904:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986733.205630:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x21:0x0], index 1: 0 00010000:00010000:0.0:1788986733.205884:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549c60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.205897:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.205905:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549c60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.205940:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549c52 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.205948:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549c52 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.205955:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549c52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.205961:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986733.205966:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549c52 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.205974:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549c52 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.205985:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:0.0:1788986733.205988:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986733.205993:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549c52 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.205999:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf549c52 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986733.206011:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000028700f3e reply state 000000008010e50f transno 4294967696 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986733.206019:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788986733.206048:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf549c4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1544 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.206062:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549c60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1544 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986733.206069:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x57:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:0.0:1788986733.206071:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986733.206073:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986733.206177:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:55423:x1875885971399808:12345-192.168.206.21@tcp:101:dd.0 Request processed in 1639us (1984us total) trans 4294967696 rc 0/0 00000100:00100000:0.0:1788986733.206186:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1057 00010000:00010000:2.0:1788986733.208601:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549c59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.208618:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549c59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.208624:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549c59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.208630:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986733.208634:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549c59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.208640:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549c59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.208654:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a4823bb00) 00010000:00010000:2.0:1788986733.208657:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986733.208662:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549c59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986733.208668:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf549c59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986733.215215:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986733.215496:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971399936 00000100:00100000:1.0:1788986733.215505:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971399936 00000100:00100000:1.0:1788986733.215562:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 575 00000100:00100000:1.0:1788986733.215571:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55423:x1875885971399936:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:1.0:1788986733.215589:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986733.215609:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000701745c7/0xc20d828fcf549c6e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d154b expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788986733.215635:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788986733.215655:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=2517s v=(0 0) 00010000:00010000:1.0:1788986733.215660:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986733.215668:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000701745c7/0xc20d828fcf549c6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d154b expref: 7 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986733.215685:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000701745c7/0xc20d828fcf549c6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d154b expref: 7 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986733.215696:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788986733.215755:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55423:x1875885971399936:12345-192.168.206.21@tcp:101:dd.0 Request processed in 185us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986733.215762:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 575 00000100:00100000:3.0:1788986733.255594:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986733.255729:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971400064 00000100:00100000:0.0:1788986733.255738:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971400064 00002000:00100000:0.0:1788986733.255787:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (0->1048575) req@ffff9b0a80907b80 x1875885971400064/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:654/0 lens 488/0 e 0 to 0 dl 1788986744 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788986733.255799:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a80907b80 with x1875885971400064 ext(0->1048575) 00002000:00010000:0.0:1788986733.255804:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a80907b80 00000100:00100000:0.0:1788986733.255844:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 26 00000100:00100000:0.0:1788986733.255854:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971400064:12345-192.168.206.21@tcp:4:dd.0 00000001:00100000:0.0:1788986733.345562:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:0.0:1788986733.349903:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971400064:12345-192.168.206.21@tcp:4:dd.0 Request processed in 94040us (94309us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788986733.349918:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 26 00002000:00100000:0.0:1788986733.349930:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x21:0x0] (0->1048575) req@ffff9b0a80907b80 x1875885971400064/t4294967362(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:654/0 lens 488/448 e 0 to 0 dl 1788986744 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788986733.349941:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a80907b80 with x1875885971400064 ext(0->1048575) 00002000:00010000:0.0:1788986733.349948:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a80907b80 00000100:00100000:2.0:1788986733.354732:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986733.354821:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971400192 00000100:00100000:1.0:1788986733.354831:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971400192 00000100:00100000:1.0:1788986733.354885:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1058 00000100:00100000:1.0:1788986733.354894:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:55423:x1875885971400192:12345-192.168.206.21@tcp:44:dd.0 00000100:00100000:1.0:1788986733.409130:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:55423:x1875885971400192:12345-192.168.206.21@tcp:44:dd.0 Request processed in 54225us (54395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986733.409142:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1058 00000001:00080000:3.0:1788986733.409567:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967696 is committed 00000100:00100000:3.0:1788986733.412238:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986733.412419:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971400320 00000100:00100000:2.0:1788986733.412427:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971400320 00000100:00100000:2.0:1788986733.412478:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 576 00000100:00100000:2.0:1788986733.412488:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971400320:12345-192.168.206.21@tcp:16:dd.0 00000100:00100000:2.0:1788986733.459173:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971400320:12345-192.168.206.21@tcp:16:dd.0 Request processed in 46676us (46933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986733.459188:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 576 00000100:00100000:2.0:1788986733.463546:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000001:00080000:0.0:1788986733.464273:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967362 is committed 00000100:00100000:3.0:1788986733.464494:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971400576 00000100:00100000:3.0:1788986733.464504:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971400576 00000100:00100000:3.0:1788986733.464679:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 105 00000100:00100000:3.0:1788986733.464693:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55423:x1875885971400576:12345-192.168.206.21@tcp:35:dd.0 00000001:00080000:3.0:1788986733.465236:0:5858:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967697 00000100:00100000:3.0:1788986733.465350:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:55423:x1875885971400576:12345-192.168.206.21@tcp:35:dd.0 Request processed in 661us (1821us total) trans 4294967698 rc 0/0 00000100:00100000:3.0:1788986733.465357:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 105 00000020:00080000:3.0:1788986733.465361:0:5858:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788986733.568528:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993605888:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986733.568615:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986733.568621:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986733.568673:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993605888 00000100:00100000:0.0:1788986733.568681:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993605888 00000100:00100000:0.0:1788986733.568752:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00000100:00100000:0.0:1788986733.568762:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993605888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986733.568782:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986733.568836:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993605888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986733.568843:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:3.0:1788986733.568950:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993605888:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986733.569419:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986734.594221:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986734.594813:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8096f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993606144:0@lo:400:kworker.0 00000100:00100000:2.0:1788986734.594877:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986734.594925:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993606656:0@lo:400:kworker.0 00000100:00100000:2.0:1788986734.594950:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986734.594971:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986734.594976:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993606272:0@lo:400:kworker.0 00000100:00100000:2.0:1788986734.594994:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986734.595112:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993606400:0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595140:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986734.595159:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788986734.595164:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8096c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993606016:0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595188:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986734.595208:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993606528:0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595227:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986734.595252:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993606144 00000100:00100000:0.0:1788986734.595259:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993606144 00000100:00100000:0.0:1788986734.595296:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993606272 00000100:00100000:0.0:1788986734.595298:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993606272 00000100:00100000:0.0:1788986734.595320:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993606528 00000100:00100000:0.0:1788986734.595323:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993606528 00000100:00100000:0.0:1788986734.595337:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1792 00000100:00100000:0.0:1788986734.595344:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993606144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595401:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993606144:12345-0@lo:400:kworker.0 Request processed in 57us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986734.595408:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1792 00000100:00100000:0.0:1788986734.595425:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1793 00000100:00100000:0.0:1788986734.595431:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993606272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595456:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993606272:12345-0@lo:400:kworker.0 Request processed in 25us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986734.595461:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1793 00000100:00100000:0.0:1788986734.595473:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1794 00000100:00100000:0.0:1788986734.595479:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993606528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595521:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993606528:12345-0@lo:400:kworker.0 Request processed in 42us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986734.595527:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1794 00000100:00100000:0.0:1788986734.595544:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993606656 00000100:00100000:0.0:1788986734.595547:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993606656 00000100:00100000:0.0:1788986734.595570:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993606400 00000100:00100000:0.0:1788986734.595573:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993606400 00000100:00100000:0.0:1788986734.595590:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1788986734.595595:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993606656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595624:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993606656:12345-0@lo:400:kworker.0 Request processed in 28us (673us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986734.595640:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1345 00000100:00100000:0.0:1788986734.595652:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1788986734.595657:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993606400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595683:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993606400:12345-0@lo:400:kworker.0 Request processed in 26us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986734.595688:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1346 00000100:00100000:0.0:1788986734.595711:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993606016 00000100:00100000:0.0:1788986734.595714:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993606016 00000100:00100000:0.0:1788986734.595738:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:0.0:1788986734.595744:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993606016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595771:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993606016:12345-0@lo:400:kworker.0 Request processed in 27us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986734.595777:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00080000:0.0:1788986734.595804:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986734.595808:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986734.595840:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8096c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993606016:0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595852:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993606528:0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595860:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993606400:0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595896:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993606272:0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595906:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8096f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993606144:0@lo:400:kworker.0 00000100:00100000:0.0:1788986734.595914:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993606656:0@lo:400:kworker.0 00000001:00080000:3.0:1788986734.781923:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967698 is committed 00000100:00100000:3.0:1788986735.104433:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993606784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986735.104493:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986735.104557:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993606784 00000100:00100000:3.0:1788986735.104565:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993606784 00000100:00100000:2.0:1788986735.104846:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1788986735.104858:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993606784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986735.104890:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788986735.104952:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993606784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986735.104958:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:1.0:1788986735.105144:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993606784:0@lo:13:osp-pre-1-0.0 00000001:00100000:2.0:1788986735.177855:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000001:00100000:2.0:1788986735.177871:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788986735.177874:0:6721:0:(genops.c:885:class_export_put()) final put ffff9b094371a800/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:3.0:1788986735.177983:0:81874:0:(genops.c:844:class_export_destroy()) destroying export ffff9b094371a800/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0000 00000020:00000080:3.0:1788986735.178044:0:81874:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b094371e000 for lustre-OST0000 00010000:00010000:0.0:1788986735.616368:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986736.365729:0:94940:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2520268635485ns, next at 2495807831409ns, rc = 0 00000004:00080000:3.0:1788986736.365876:0:94940:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2520268785866ns, next at 2453492304877ns, rc = 0 00000004:00080000:0.0:1788986736.375718:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 90 committed 00000004:00080000:0.0:1788986736.375753:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 90 committed 00010000:00010000:3.0:1788986736.645324:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986736.754019:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986736.754067:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986736.754152:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986736.754184:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986736.754223:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971401088 00000100:00100000:3.0:1788986736.754224:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971400704 00000100:00100000:3.0:1788986736.754236:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971400704 00000100:00100000:1.0:1788986736.754240:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971401088 00000100:00100000:0.0:1788986736.754241:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971400832 00000100:00100000:0.0:1788986736.754245:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971400832 00000100:00100000:2.0:1788986736.754309:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971400960 00000100:00100000:2.0:1788986736.754313:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971400960 00000100:00100000:1.0:1788986736.754320:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1347 00000100:00100000:3.0:1788986736.754322:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1387 00000100:00100000:1.0:1788986736.754333:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971401088:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986736.754338:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971400704:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986736.754432:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971401088:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 103us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986736.754441:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1347 00000100:00100000:0.0:1788986736.754445:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1795 00000100:00100000:0.0:1788986736.754451:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971400832:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:1.0:1788986736.754465:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986736.754470:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986736.754472:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986736.754518:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1348 00000100:00100000:2.0:1788986736.754525:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971400960:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986736.756646:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971400704:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 2300us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986736.756722:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1387 00000100:00100000:0.0:1788986736.763280:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971400832:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 8809us (9256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986736.763299:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1795 00000100:00100000:2.0:1788986736.763420:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971400960:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 8891us (9231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986736.763434:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1348 00010000:00010000:3.0:1788986737.665042:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986737.828068:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986737.828294:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971401216 00000100:00100000:3.0:1788986737.828304:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971401216 00000100:00100000:3.0:1788986737.828369:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1059 00000100:00100000:3.0:1788986737.828382:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55616:x1875885971401216:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986737.828510:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55616:x1875885971401216:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 131us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986737.828518:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1059 00000100:00100000:0.0:1788986737.833208:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986737.833294:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971401344 00000100:00100000:3.0:1788986737.833303:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971401344 00000100:00100000:3.0:1788986737.833376:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 577 00000100:00100000:3.0:1788986737.833388:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55616:x1875885971401344:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986737.833862:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55616:x1875885971401344:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 475us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986737.833870:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 577 00000100:00100000:3.0:1788986737.843646:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986737.843719:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971401472 00000100:00100000:2.0:1788986737.843729:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971401472 00000100:00100000:2.0:1788986737.843784:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 578 00000100:00100000:2.0:1788986737.843794:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55616:x1875885971401472:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986737.844162:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55616:x1875885971401472:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 368us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986737.844170:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 578 00000100:00100000:3.0:1788986737.847404:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986737.847479:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971401600 00000100:00100000:2.0:1788986737.847487:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971401600 00000100:00100000:2.0:1788986737.847539:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1060 00000100:00100000:2.0:1788986737.847548:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55616:x1875885971401600:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986737.847857:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55616:x1875885971401600:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 310us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986737.847865:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1060 00000100:00100000:2.0:1788986737.851143:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986737.851315:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971401728 00000100:00100000:0.0:1788986737.851323:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971401728 00000100:00100000:0.0:1788986737.851385:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1061 00000100:00100000:0.0:1788986737.851395:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55616:x1875885971401728:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986737.851633:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55616:x1875885971401728:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 239us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986737.851641:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1061 00000100:00100000:0.0:1788986737.855752:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986737.855842:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971401856 00000100:00100000:3.0:1788986737.855852:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971401856 00000100:00100000:3.0:1788986737.856170:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 579 00000100:00100000:3.0:1788986737.856182:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55616:x1875885971401856:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986737.856975:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55616:x1875885971401856:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 794us (1225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986737.856984:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 579 00000100:00100000:1.0:1788986737.873201:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986737.873251:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971401984 00000100:00100000:1.0:1788986737.873259:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971401984 00000100:00100000:1.0:1788986737.873315:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 580 00000100:00100000:1.0:1788986737.873324:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55616:x1875885971401984:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986737.873683:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55616:x1875885971401984:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 360us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986737.873691:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 580 00000100:00100000:2.0:1788986737.883712:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986737.883754:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971402112 00000100:00100000:2.0:1788986737.883762:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971402112 00000100:00100000:2.0:1788986737.883813:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1062 00000100:00100000:2.0:1788986737.883823:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55616:x1875885971402112:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986737.884235:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55616:x1875885971402112:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 412us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986737.884243:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1062 00000100:00100000:0.0:1788986737.951857:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986737.951939:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971402368 00000100:00100000:3.0:1788986737.951949:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971402368 00000100:00100000:3.0:1788986737.952016:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1063 00000100:00100000:3.0:1788986737.952027:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:55620:x1875885971402368:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788986737.952077:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986737.952147:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf549c60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x57:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1544 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.952164:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x57:0x0].0x0 (ffff9b0a4823b700) 00010000:00010000:3.0:1788986737.952174:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986737.952194:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549c75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.952207:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549c75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.952216:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549c75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.952229:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549c7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.952236:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549c7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.952242:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549c7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.952550:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549c83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x57:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.952560:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.952568:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788986737.953513:0:15241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].33, 64 off10304 00000004:00080000:3.0:1788986737.953525:0:15241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2521856434859ns, next at 2522856432252ns, rc = 0 00010000:00010000:3.0:1788986737.953621:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549c8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x57:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.953632:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549c8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.953641:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549c8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.953648:0:15241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549c8a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.953654:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549c8a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.953659:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549c8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x57:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954019:0:15241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986737.954042:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549c83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954049:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549c83 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954056:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549c83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954062:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986737.954071:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549c83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954078:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549c83 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954163:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x57:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:3.0:1788986737.954166:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986737.954171:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549c83 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954178:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549c83 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x57:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954193:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549c75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954199:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549c75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954204:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549c75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954209:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986737.954212:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549c75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954218:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549c75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954225:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:3.0:1788986737.954227:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986737.954230:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549c75 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986737.954236:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549c75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986737.954243:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003f039eb6 reply state 000000001f501a87 transno 4294967699 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549c7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986737.954251:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986737.954367:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986737.954374:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549c8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986737.954379:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986737.954382:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549c8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986737.954387:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549c8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986737.954397:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x57:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:2.0:1788986737.954399:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788986737.954402:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549c8a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986737.954406:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549c8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x57:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986737.954422:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986737.954423:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986737.954425:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986737.954525:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:55620:x1875885971402368:12345-192.168.206.21@tcp:36:rm.0 Request processed in 2498us (2675us total) trans 4294967699 rc 0/0 00000100:00100000:0.0:1788986737.954533:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1063 00010000:00010000:1.0:1788986737.956909:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549c7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986737.956924:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549c7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986737.956932:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549c7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986737.956937:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986737.956942:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549c7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986737.956949:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549c7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986737.956962:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a55745000) 00010000:00010000:1.0:1788986737.956966:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986737.956971:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549c7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986737.956978:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549c7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986738.690169:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8096f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993606912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986738.690236:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986738.690352:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993606912 00000100:00100000:0.0:1788986738.690359:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993606912 00000100:00100000:0.0:1788986738.690420:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 912 00000100:00100000:0.0:1788986738.690428:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993606912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986738.690460:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986738.690503:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993606912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986738.690509:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 912 00000100:00080000:1.0:1788986738.690562:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986738.690595:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8096f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993606912:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986738.691957:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986739.712263:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993607168:0@lo:400:kworker.0 00000100:00100000:2.0:1788986739.712327:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986739.712395:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993607680:0@lo:400:kworker.0 00000100:00100000:2.0:1788986739.712423:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986739.712445:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986739.712450:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993607296:0@lo:400:kworker.0 00000100:00100000:2.0:1788986739.712468:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986739.712499:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993607168 00000100:00100000:2.0:1788986739.712505:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993607168 00000100:00100000:2.0:1788986739.712545:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993607296 00000100:00100000:2.0:1788986739.712548:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993607296 00000100:00100000:2.0:1788986739.712579:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1796 00000100:00100000:2.0:1788986739.712587:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993607168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986739.712633:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993607168:12345-0@lo:400:kworker.0 Request processed in 47us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986739.712640:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1796 00000100:00100000:2.0:1788986739.712657:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1797 00000100:00100000:2.0:1788986739.712662:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993607296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986739.712690:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993607296:12345-0@lo:400:kworker.0 Request processed in 28us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986739.712695:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1797 00000100:00080000:2.0:1788986739.712716:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986739.712747:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993607296:0@lo:400:kworker.0 00000100:00100000:2.0:1788986739.712757:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993607168:0@lo:400:kworker.0 00000100:00100000:1.0:1788986739.712864:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993607424:0@lo:400:kworker.0 00000100:00100000:1.0:1788986739.712894:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986739.712915:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788986739.712920:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993607040:0@lo:400:kworker.0 00000100:00100000:1.0:1788986739.712946:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986739.712970:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993607552:0@lo:400:kworker.0 00000100:00100000:1.0:1788986739.712991:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986739.713015:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993607040 00000100:00100000:1.0:1788986739.713018:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993607040 00000100:00100000:1.0:1788986739.713041:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1388 00000100:00100000:1.0:1788986739.713047:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993607040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986739.713080:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993607040:12345-0@lo:400:kworker.0 Request processed in 33us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986739.713106:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1388 00000100:00100000:1.0:1788986739.713133:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993607552 00000100:00100000:1.0:1788986739.713136:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993607552 00000100:00100000:1.0:1788986739.713165:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1798 00000100:00100000:1.0:1788986739.713171:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993607552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986739.713200:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993607552:12345-0@lo:400:kworker.0 Request processed in 30us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986739.713206:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1798 00000100:00080000:1.0:1788986739.713220:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986739.713248:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993607040:0@lo:400:kworker.0 00000100:00100000:1.0:1788986739.713258:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993607552:0@lo:400:kworker.0 00000100:00100000:3.0:1788986739.713563:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993607680 00000100:00100000:3.0:1788986739.713567:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993607680 00000100:00100000:3.0:1788986739.713602:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993607424 00000100:00100000:3.0:1788986739.713606:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993607424 00000100:00100000:3.0:1788986739.713634:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1349 00000100:00100000:3.0:1788986739.713642:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993607680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986739.713683:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993607680:12345-0@lo:400:kworker.0 Request processed in 43us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986739.713689:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1349 00000100:00100000:3.0:1788986739.713702:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1350 00000100:00100000:3.0:1788986739.713711:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993607424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986739.713745:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993607424:12345-0@lo:400:kworker.0 Request processed in 36us (849us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986739.713751:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1350 00010000:00010000:3.0:1788986739.713813:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788986739.713821:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986739.713841:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993607424:0@lo:400:kworker.0 00000100:00100000:3.0:1788986739.713868:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993607680:0@lo:400:kworker.0 00000004:00080000:3.0:1788986740.222850:0:95084:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2524125758399ns, next at 2495807831409ns, rc = 0 00000004:00080000:3.0:1788986740.223006:0:95084:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2524125916424ns, next at 2522856432252ns, rc = 0 00000004:00080000:1.0:1788986740.224214:0:7935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2524127122824ns, next at 2525127121379ns, rc = 0 00000100:00100000:3.0:1788986740.224285:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986740.224303:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993607808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986740.224372:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986740.224443:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993607808 00000100:00100000:1.0:1788986740.224450:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993607808 00000100:00100000:1.0:1788986740.224499:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 913 00000100:00100000:1.0:1788986740.224508:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993607808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986740.224542:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1788986740.224597:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993607808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986740.224604:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 913 00000100:00100000:3.0:1788986740.224684:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993607808:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788986740.290304:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 93 committed 00000004:00080000:1.0:1788986740.290344:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 92 committed 00000004:00080000:1.0:1788986740.290350:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 91 committed 00000001:00080000:1.0:1788986740.290367:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967699 is committed 00000004:00080000:1.0:1788986740.290372:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 91 committed 00000100:00100000:0.0:1788986740.290700:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986740.290723:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993607936:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788986740.290786:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986740.291006:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993607936 00000100:00100000:2.0:1788986740.291014:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993607936 00000100:00100000:2.0:1788986740.291125:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00000100:00100000:2.0:1788986740.291135:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993607936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788986740.291163:0:8478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:33 count 1 00010000:00010000:2.0:1788986740.291186:0:8478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986740.291205:0:8478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000701745c7/0xc20d828fcf549c6e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d154b expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986740.291219:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21:0x0].0x0 since=7s v=(0 0) 00010000:00010000:2.0:1788986740.291223:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788986740.291228:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986740.291258:0:8478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000701745c7/0xc20d828fcf549c6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d154b expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986740.291271:0:8478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000701745c7/0xc20d828fcf549c6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d154b expref: 5 pid: 8478 timeout: 2624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986740.291283:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8478:1875885993608064:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986740.291352:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788986740.297109:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986740.297757:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8478:1875885993608064:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788986740.297785:0:8478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986740.297884:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971402496 00000100:00100000:1.0:1788986740.297892:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971402496 00010000:00010000:1.0:1788986740.297943:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000701745c7/0xc20d828fcf549c6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d154b expref: 6 pid: 8478 timeout: 2624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986740.297992:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 439 00000100:00100000:1.0:1788986740.298001:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971402496:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986740.298016:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986740.298021:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000701745c7/0xc20d828fcf549c6e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d154b expref: 6 pid: 8478 timeout: 2624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.298033:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000701745c7/0xc20d828fcf549c6e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d154b expref: 6 pid: 8478 timeout: 2624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.298058:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000701745c7/0xc20d828fcf549c6e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d154b expref: 6 pid: 8478 timeout: 2624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.298077:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986740.298081:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986740.298107:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.298118:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.298144:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986740.298197:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971402496:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 195us (1116us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986740.298205:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 439 00010000:00010000:1.0:1788986740.298355:0:8478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.298365:0:8478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.298376:0:8478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.298383:0:8478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.298401:0:8478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788986740.299017:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993607936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 7882us (8228us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788986740.299025:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00010000:00010000:1.0:1788986740.299050:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986740.299056:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.299064:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986740.299068:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.299077:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.299118:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.299125:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080be8d2f/0xc20d828fcf549c91 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986740.299143:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986740.299144:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986740.299146:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788986740.299176:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7f5f3100/2, rc 0, transno 4294967363 00000100:00100000:1.0:1788986740.299187:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993607936:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1788986740.299628:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788986740.736714:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986741.760601:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986741.882249:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986741.882309:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986741.882357:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986741.882400:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971402624 00000100:00100000:0.0:1788986741.882404:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986741.882423:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971402624 00000100:00100000:0.0:1788986741.882440:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971402880 00000100:00100000:0.0:1788986741.882446:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971402880 00000100:00100000:0.0:1788986741.882500:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971403008 00000100:00100000:0.0:1788986741.882504:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971403008 00000100:00100000:0.0:1788986741.882528:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1351 00000100:00100000:0.0:1788986741.882539:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971402880:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986741.882644:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1352 00000100:00100000:2.0:1788986741.882656:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1389 00000100:00100000:2.0:1788986741.882668:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971402624:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986741.882679:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971403008:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986741.882748:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971402752 00000100:00100000:2.0:1788986741.882753:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971402624:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 86us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986741.882755:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971402752 00000100:00100000:2.0:1788986741.882765:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1389 00000100:00100000:1.0:1788986741.882819:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1799 00000100:00100000:1.0:1788986741.882830:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971402752:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986741.887628:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971403008:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 4955us (5205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986741.887650:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1352 00000100:00080000:3.0:1788986741.887771:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986741.887779:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986741.893697:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971402752:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 10852us (11321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986741.893714:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1799 00000100:00100000:0.0:1788986741.903223:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971402880:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 20661us (20888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986741.903247:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1351 00010000:00010000:3.0:1788986742.784339:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788986742.829023:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967363 is committed 00010000:00010000:2.0:1788986743.808267:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986743.808309:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993608192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986743.808394:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986743.808475:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993608192 00000100:00100000:2.0:1788986743.808482:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993608192 00000100:00100000:2.0:1788986743.808543:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:2.0:1788986743.808552:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993608192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986743.808584:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788986743.808608:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986743.808647:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993608192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986743.808654:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1788986743.808704:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993608192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986744.832355:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993608320:0@lo:400:kworker.0 00000100:00100000:2.0:1788986744.832395:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993608704:0@lo:400:kworker.0 00000100:00100000:0.0:1788986744.832422:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986744.832425:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986744.832475:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993608832:0@lo:400:kworker.0 00000100:00100000:1.0:1788986744.832496:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993608448:0@lo:400:kworker.0 00000100:00100000:0.0:1788986744.832500:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986744.832522:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986744.832540:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993608704 00000100:00100000:0.0:1788986744.832546:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993608704 00000100:00100000:0.0:1788986744.832589:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1353 00000100:00100000:0.0:1788986744.832598:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993608704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986744.832600:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993608576:0@lo:400:kworker.0 00000100:00100000:3.0:1788986744.832631:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993608320 00000100:00100000:3.0:1788986744.832634:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993608320 00000100:00100000:0.0:1788986744.832638:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993608704:12345-0@lo:400:kworker.0 Request processed in 42us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986744.832644:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1353 00000100:00100000:3.0:1788986744.832669:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00100000:3.0:1788986744.832682:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993608320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986744.832721:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993608320:12345-0@lo:400:kworker.0 Request processed in 45us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986744.832727:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00010000:00010000:3.0:1788986744.832786:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986744.833209:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eeb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993608704:0@lo:400:kworker.0 00000100:00100000:2.0:1788986744.833258:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993608320:0@lo:400:kworker.0 00000100:00100000:0.0:1788986744.833468:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993608832 00000100:00100000:0.0:1788986744.833473:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993608832 00000100:00100000:0.0:1788986744.833519:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993608448 00000100:00100000:0.0:1788986744.833522:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993608448 00000100:00100000:0.0:1788986744.833540:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1800 00000100:00100000:0.0:1788986744.833545:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993608832:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788986744.835666:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986744.835716:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1801 00000100:00100000:2.0:1788986744.835735:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993608448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986744.835939:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986744.836009:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993608576 00000100:00100000:3.0:1788986744.836017:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993608576 00000100:00100000:3.0:1788986744.836065:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1802 00000100:00100000:3.0:1788986744.836074:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993608576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986744.836141:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993608576:12345-0@lo:400:kworker.0 Request processed in 68us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986744.836148:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1802 00000100:00100000:3.0:1788986744.836187:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993608576:0@lo:400:kworker.0 00000100:00080000:3.0:1788986744.836211:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986744.837555:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993608960:0@lo:400:kworker.0 00000100:00100000:1.0:1788986744.837618:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986744.839582:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993608960 00000100:00100000:3.0:1788986744.839594:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993608960 00000100:00100000:3.0:1788986744.839681:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1354 00000100:00100000:3.0:1788986744.839693:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993608960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986744.839774:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993608960:12345-0@lo:400:kworker.0 Request processed in 84us (2155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986744.839785:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1354 00000100:00100000:0.0:1788986744.840026:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993608832:12345-0@lo:400:kworker.0 Request processed in 6479us (7522us total) trans 0 rc 0/0 00000100:00080000:1.0:1788986744.840034:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986744.840036:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1800 00000100:00100000:1.0:1788986744.840064:0:3321:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967363 gen 2 00000004:00080000:1.0:1788986744.840070:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7f5f3100, transno 4294967363 00000100:00100000:1.0:1788986744.840111:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80717800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993608960:0@lo:400:kworker.0 00000100:00100000:3.0:1788986744.840249:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993608832:0@lo:400:kworker.0 00000100:00100000:2.0:1788986744.841791:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993608448:12345-0@lo:400:kworker.0 Request processed in 6059us (9260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986744.841803:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1801 00000100:00100000:1.0:1788986744.846560:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993608448:0@lo:400:kworker.0 00000100:00100000:3.0:1788986745.345039:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993609088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986745.345128:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986745.345198:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993609088 00000100:00100000:3.0:1788986745.345205:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993609088 00000100:00100000:3.0:1788986745.345265:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:3.0:1788986745.345276:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993609088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986745.345316:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986745.345374:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993609088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986745.345381:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:3.0:1788986745.345426:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993609088:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986745.862882:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986746.880330:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986746.992958:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986746.993042:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971403136 00000100:00100000:3.0:1788986746.993051:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971403136 00000100:00100000:3.0:1788986746.993151:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1391 00000100:00100000:3.0:1788986746.993164:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971403136:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986746.993389:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971403136:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 229us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986746.993397:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1391 00000100:00100000:2.0:1788986747.004843:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986747.008720:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971403264 00000100:00100000:3.0:1788986747.008733:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971403264 00000100:00080000:1.0:1788986747.010426:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986747.012960:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1803 00000100:00100000:3.0:1788986747.012988:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971403264:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986747.013070:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971403264:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 98us (8236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986747.013077:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1803 00000100:00100000:1.0:1788986747.015389:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986747.015448:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986747.015494:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971403520 00000100:00100000:1.0:1788986747.015512:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971403520 00000100:00100000:1.0:1788986747.015566:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971403392 00000100:00100000:1.0:1788986747.015569:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971403392 00000100:00100000:1.0:1788986747.015593:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1355 00000100:00100000:1.0:1788986747.015602:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971403520:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986747.015658:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971403520:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 57us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986747.015665:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1355 00000100:00100000:1.0:1788986747.015683:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1356 00000100:00100000:1.0:1788986747.015690:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971403392:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986747.015714:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971403392:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986747.015719:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1356 00000100:00080000:1.0:1788986747.015741:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986747.015745:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788986747.905444:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986748.928312:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986748.929241:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993609216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986748.929313:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986748.931908:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993609216 00000100:00100000:2.0:1788986748.931921:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993609216 00000100:00100000:2.0:1788986748.932083:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 916 00000100:00100000:2.0:1788986748.932115:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993609216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986748.932150:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986748.932237:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993609216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (2924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986748.932244:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 916 00000100:00100000:0.0:1788986748.932366:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993609216:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986748.933028:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986749.954075:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986749.955011:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993609472:0@lo:400:kworker.0 00000100:00100000:0.0:1788986749.955032:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993609728:0@lo:400:kworker.0 00000100:00100000:2.0:1788986749.955116:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993609600:0@lo:400:kworker.0 00000100:00100000:3.0:1788986749.955144:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993609344:0@lo:400:kworker.0 00000100:00100000:1.0:1788986749.956517:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986749.956517:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986749.960105:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993609984:0@lo:400:kworker.0 00000100:00100000:1.0:1788986749.960169:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986749.960222:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993609728 00000100:00100000:1.0:1788986749.960230:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993609728 00000100:00100000:1.0:1788986749.960349:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993609984 00000100:00100000:1.0:1788986749.960353:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993609984 00000100:00100000:1.0:1788986749.960395:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1788986749.960403:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993609728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986749.960455:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993609728:12345-0@lo:400:kworker.0 Request processed in 53us (3944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986749.960462:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1357 00000100:00100000:1.0:1788986749.960479:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1358 00000100:00100000:1.0:1788986749.960485:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993609984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986749.960533:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993609984:12345-0@lo:400:kworker.0 Request processed in 48us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986749.960537:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986749.960544:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1358 00000100:00080000:1.0:1788986749.960580:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986749.960614:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993609984:0@lo:400:kworker.0 00000100:00100000:2.0:1788986749.960619:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993609472 00000100:00100000:2.0:1788986749.960625:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993609472 00000100:00100000:2.0:1788986749.960654:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993609600 00000100:00100000:2.0:1788986749.960657:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993609600 00000100:00100000:2.0:1788986749.960680:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1804 00000100:00080000:1.0:1788986749.960726:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986749.960859:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993609472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986749.960900:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993609472:12345-0@lo:400:kworker.0 Request processed in 45us (4389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986749.960906:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1804 00000100:00100000:2.0:1788986749.960921:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1805 00000100:00100000:2.0:1788986749.960927:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993609600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986749.960958:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993609600:12345-0@lo:400:kworker.0 Request processed in 31us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986749.960963:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1805 00000100:00100000:2.0:1788986749.960997:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993609600:0@lo:400:kworker.0 00000100:00100000:0.0:1788986749.961267:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993609728:0@lo:400:kworker.0 00000100:00100000:0.0:1788986749.961313:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993609472:0@lo:400:kworker.0 00000100:00100000:3.0:1788986749.962567:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986749.962618:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993609856:0@lo:400:kworker.0 00000100:00100000:3.0:1788986749.962651:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986749.962965:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993609344 00000100:00100000:2.0:1788986749.962972:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993609344 00000100:00100000:2.0:1788986749.963012:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1392 00000100:00100000:2.0:1788986749.963020:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993609344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986749.963267:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993609344:12345-0@lo:400:kworker.0 Request processed in 248us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986749.963274:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1392 00000100:00100000:0.0:1788986749.963420:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993609344:0@lo:400:kworker.0 00000100:00100000:1.0:1788986749.963871:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993609856 00000100:00100000:1.0:1788986749.963877:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993609856 00000100:00100000:1.0:1788986749.963935:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1806 00000100:00100000:1.0:1788986749.963943:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993609856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986749.964006:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993609856:12345-0@lo:400:kworker.0 Request processed in 64us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986749.964013:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1806 00000100:00100000:0.0:1788986749.964176:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993609856:0@lo:400:kworker.0 00000100:00080000:2.0:1788986749.964347:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986750.464491:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986750.464512:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993610112:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986750.464572:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986750.465154:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993610112 00000100:00100000:1.0:1788986750.465162:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993610112 00000100:00100000:1.0:1788986750.465213:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 917 00000100:00100000:1.0:1788986750.465222:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993610112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986750.465251:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986750.465314:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993610112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986750.465320:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 917 00000100:00100000:0.0:1788986750.465398:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993610112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986750.976297:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986752.000308:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986752.116008:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986752.116057:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986752.116084:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986752.116136:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986752.116211:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971403648 00000100:00100000:3.0:1788986752.116222:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971403648 00000100:00100000:3.0:1788986752.116292:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1393 00000100:00100000:3.0:1788986752.116304:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971403648:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986752.116369:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971403648:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986752.116377:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1393 00000100:00100000:1.0:1788986752.116969:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971404032 00000100:00100000:1.0:1788986752.116975:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971404032 00000100:00100000:1.0:1788986752.117012:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971403904 00000100:00100000:1.0:1788986752.117014:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971403904 00000100:00100000:1.0:1788986752.117032:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1359 00000100:00100000:1.0:1788986752.117039:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971404032:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986752.117079:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971404032:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986752.117085:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1359 00000100:00100000:1.0:1788986752.117127:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1360 00000100:00100000:1.0:1788986752.117133:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971403904:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986752.117158:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971403904:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986752.117164:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1360 00000100:00080000:1.0:1788986752.117182:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986752.117185:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986752.117466:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971403776 00000100:00100000:0.0:1788986752.117471:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971403776 00000100:00100000:0.0:1788986752.117521:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1807 00000100:00100000:0.0:1788986752.117528:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971403776:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986752.117562:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971403776:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (1563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986752.117568:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1807 00000100:00080000:1.0:1788986752.118228:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986753.025127:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986754.048496:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993610240:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986754.048564:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986754.048710:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993610240 00000100:00100000:1.0:1788986754.048718:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993610240 00000100:00100000:1.0:1788986754.048791:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1788986754.048799:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993610240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986754.048937:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986754.048987:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993610240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986754.048994:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00080000:0.0:1788986754.049119:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986754.049153:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993610240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986754.049302:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986755.072515:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993610624:0@lo:400:kworker.0 00000100:00100000:3.0:1788986755.072581:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986755.072635:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986755.072640:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993610752:0@lo:400:kworker.0 00000100:00100000:3.0:1788986755.072665:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986755.072759:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993610624 00000100:00100000:2.0:1788986755.072767:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993610624 00000100:00100000:2.0:1788986755.072819:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1808 00000100:00100000:2.0:1788986755.072828:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993610624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986755.072883:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993610624:12345-0@lo:400:kworker.0 Request processed in 56us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986755.072889:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1808 00000100:00100000:2.0:1788986755.072914:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993610752 00000100:00100000:2.0:1788986755.072922:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993610752 00000100:00100000:2.0:1788986755.072945:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1361 00000100:00100000:2.0:1788986755.072953:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993610752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986755.072986:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993610752:12345-0@lo:400:kworker.0 Request processed in 35us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986755.072991:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1361 00010000:00010000:2.0:1788986755.073007:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986755.073034:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993610752:0@lo:400:kworker.0 00000100:00100000:2.0:1788986755.073044:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993610624:0@lo:400:kworker.0 00000100:00100000:0.0:1788986755.073119:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993610368:0@lo:400:kworker.0 00000100:00100000:0.0:1788986755.073152:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986755.073183:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993610880:0@lo:400:kworker.0 00000100:00100000:0.0:1788986755.073204:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986755.073220:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788986755.073226:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993610496:0@lo:400:kworker.0 00000100:00100000:0.0:1788986755.073245:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986755.073274:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993611008:0@lo:400:kworker.0 00000100:00100000:0.0:1788986755.073294:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986755.073319:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993610880 00000100:00100000:0.0:1788986755.073322:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993610880 00000100:00100000:0.0:1788986755.073348:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993610496 00000100:00100000:0.0:1788986755.073351:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993610496 00000100:00100000:0.0:1788986755.073370:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1809 00000100:00100000:0.0:1788986755.073377:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993610880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986755.073412:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993610880:12345-0@lo:400:kworker.0 Request processed in 35us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986755.073417:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1809 00000100:00100000:0.0:1788986755.073431:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1810 00000100:00100000:0.0:1788986755.073437:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993610496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986755.073462:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993610496:12345-0@lo:400:kworker.0 Request processed in 26us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986755.073468:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1810 00000100:00100000:0.0:1788986755.073484:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993611008 00000100:00100000:0.0:1788986755.073488:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993611008 00000100:00100000:0.0:1788986755.073511:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1788986755.073517:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993611008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986755.073549:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993611008:12345-0@lo:400:kworker.0 Request processed in 32us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986755.073555:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1362 00000100:00100000:0.0:1788986755.073586:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993610496:0@lo:400:kworker.0 00000100:00100000:0.0:1788986755.073597:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993611008:0@lo:400:kworker.0 00000100:00100000:0.0:1788986755.073606:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993610880:0@lo:400:kworker.0 00000100:00100000:2.0:1788986755.073673:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993610368 00000100:00100000:2.0:1788986755.073677:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993610368 00000100:00100000:2.0:1788986755.073712:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:2.0:1788986755.073719:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993610368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986755.073754:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993610368:12345-0@lo:400:kworker.0 Request processed in 36us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986755.073760:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00080000:3.0:1788986755.074405:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986755.074411:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986755.077023:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993610368:0@lo:400:kworker.0 00000100:00100000:3.0:1788986755.585122:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986755.585144:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993611136:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986755.585235:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986755.585487:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993611136 00000100:00100000:1.0:1788986755.585495:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993611136 00000100:00100000:1.0:1788986755.585599:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:1.0:1788986755.585609:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993611136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986755.585638:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986755.585689:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993611136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986755.585696:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:0.0:1788986755.585829:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993611136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986755.979071:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986755.979384:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971404160 00000100:00100000:2.0:1788986755.979393:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971404160 00000100:00100000:2.0:1788986755.979474:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1064 00000100:00100000:2.0:1788986755.979484:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55839:x1875885971404160:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986755.979588:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55839:x1875885971404160:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 105us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986755.979595:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1064 00000100:00080000:3.0:1788986755.979653:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986755.983823:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986755.984326:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971404288 00000100:00100000:1.0:1788986755.984339:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971404288 00000100:00100000:1.0:1788986755.984423:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 582 00000100:00100000:1.0:1788986755.984433:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55839:x1875885971404288:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986755.984975:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55839:x1875885971404288:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 541us (1164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986755.984983:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 582 00000100:00080000:3.0:1788986755.985062:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986755.993262:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986755.993355:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971404416 00000100:00100000:2.0:1788986755.993365:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971404416 00000100:00100000:2.0:1788986755.993427:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 583 00000100:00100000:2.0:1788986755.993436:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55839:x1875885971404416:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986755.993784:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55839:x1875885971404416:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 349us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986755.993790:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 583 00000100:00080000:1.0:1788986755.994596:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986756.002577:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986756.002632:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971404544 00000100:00100000:0.0:1788986756.002640:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971404544 00000100:00100000:0.0:1788986756.002687:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1065 00000100:00100000:0.0:1788986756.002697:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55839:x1875885971404544:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986756.003655:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55839:x1875885971404544:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 957us (1081us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986756.003664:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1065 00000100:00100000:2.0:1788986756.014289:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986756.014351:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971404672 00000100:00100000:3.0:1788986756.014361:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971404672 00000100:00100000:3.0:1788986756.014430:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1066 00000100:00100000:3.0:1788986756.014441:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55839:x1875885971404672:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986756.014543:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55839:x1875885971404672:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 104us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986756.014549:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1066 00000100:00100000:0.0:1788986756.016865:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986756.016944:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971404800 00000100:00100000:3.0:1788986756.016951:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971404800 00000100:00100000:3.0:1788986756.017007:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 584 00000100:00100000:3.0:1788986756.017019:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55839:x1875885971404800:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986756.017396:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55839:x1875885971404800:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 379us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986756.017404:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 584 00000100:00100000:0.0:1788986756.022201:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986756.022270:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971404928 00000100:00100000:3.0:1788986756.022279:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971404928 00000100:00100000:3.0:1788986756.022335:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 585 00000100:00100000:3.0:1788986756.022344:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55839:x1875885971404928:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986756.022683:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55839:x1875885971404928:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 340us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986756.022691:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 585 00000100:00100000:3.0:1788986756.027388:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986756.027438:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971405056 00000100:00100000:0.0:1788986756.027447:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971405056 00000100:00100000:0.0:1788986756.027548:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1067 00000100:00100000:0.0:1788986756.027560:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55839:x1875885971405056:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986756.027979:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55839:x1875885971405056:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 420us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986756.027986:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1067 00010000:00010000:1.0:1788986756.098301:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986757.121467:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986757.234520:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986757.234647:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986757.234678:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986757.234739:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971405440 00000100:00100000:3.0:1788986757.234750:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971405440 00000100:00100000:0.0:1788986757.234756:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986757.234784:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971405568 00000100:00100000:0.0:1788986757.234789:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971405568 00000100:00100000:2.0:1788986757.234856:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971405184 00000100:00100000:2.0:1788986757.234861:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971405184 00000100:00100000:3.0:1788986757.234869:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1363 00000100:00100000:3.0:1788986757.234884:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971405440:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986757.234894:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1395 00000100:00100000:2.0:1788986757.234905:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971405184:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986757.234956:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971405440:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986757.235007:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971405312 00000100:00100000:1.0:1788986757.235011:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971405312 00000100:00100000:1.0:1788986757.235050:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1811 00000100:00100000:1.0:1788986757.235057:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971405312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986757.235565:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1364 00000100:00100000:3.0:1788986757.235574:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1363 00000100:00100000:0.0:1788986757.235579:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971405568:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:3.0:1788986757.235607:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986757.235612:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986757.235615:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986757.235649:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971405184:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 745us (1001us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986757.235658:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1395 00000100:00100000:1.0:1788986757.235881:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971405312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 823us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986757.235890:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1811 00000100:00100000:0.0:1788986757.237410:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971405568:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1819us (2638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986757.237423:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1364 00000020:00000080:2.0:1788986757.816732:0:95356:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff57e7df50 20000000:00000080:2.0:1788986757.816747:0:95356:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f58e800 uarg=0000000000000000 00010000:00010000:2.0:1788986757.817343:0:95356:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788986757.817373:0:95356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:2.0:1788986757.817377:0:95356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986757.817388:0:95356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0c00/0xc20d828fcf549c44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d153d expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986757.817407:0:95356:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1788986757.817420:0:95356:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986757.817433:0:95356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986757.817445:0:95356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf549c1a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549c13 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986757.817453:0:95356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986757.817486:0:95356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf549c1a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549c13 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986757.817500:0:95356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf549c1a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549c13 expref: 18 pid: 5846 timeout: 2641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986757.817514:0:95356:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eeb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95356:1875885993611264:0@lo:104: 00000100:00100000:2.0:1788986757.817568:0:95356:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986757.817611:0:95356:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a41370b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788986757.817680:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993611264 00000100:00100000:0.0:1788986757.817687:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993611264 00000100:00100000:0.0:1788986757.817733:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:0.0:1788986757.817742:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:95356:x1875885993611264:12345-0@lo:104: 00010000:00010000:0.0:1788986757.817754:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549c1a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986757.817852:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986757.817859:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:95356:x1875885993611264:12345-0@lo:104: Request processed in 118us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986757.817865:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:2.0:1788986757.817936:0:95356:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eeb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95356:1875885993611264:0@lo:104: 00010000:00010000:2.0:1788986757.817953:0:95356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986757.818033:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986757.818039:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549c1a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986757.818047:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986757.818051:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549c1a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986757.818059:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549c1a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986757.818066:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549c1a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986757.818072:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986757.818199:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549c1a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986757.818207:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788986757.818263:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993611392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986757.818293:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986757.818361:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993611392 00000100:00100000:1.0:1788986757.818366:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993611392 00010000:00010000:1.0:1788986757.818388:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf549c1a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549c13 expref: 19 pid: 5846 timeout: 2641 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986757.818410:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 440 00000100:00100000:1.0:1788986757.818417:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993611392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986757.818428:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986757.818433:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf549c1a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549c13 expref: 19 pid: 5846 timeout: 2641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986757.818442:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf549c1a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549c13 expref: 19 pid: 5846 timeout: 2641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986757.818453:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf549c1a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549c13 expref: 19 pid: 5846 timeout: 2641 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986757.818466:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986757.818474:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986757.818491:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986757.818498:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986757.818504:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986757.818511:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986757.818516:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986757.818519:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986757.818526:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986757.818539:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986757.818548:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986757.818590:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549c1a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986757.818597:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf549c13 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549c1a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986757.818611:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986757.818612:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986757.818614:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986757.818663:0:95356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986757.818671:0:95356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986757.818678:0:95356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf549c98 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986757.821292:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993611392:12345-0@lo:103:ldlm_bl.0 Request processed in 2868us (2990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986757.821305:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 440 00000100:00100000:0.0:1788986757.821398:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993611392:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986758.144686:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986759.168352:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986759.168385:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993611520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986759.168476:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986759.168551:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993611520 00000100:00100000:1.0:1788986759.168559:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993611520 00000100:00100000:1.0:1788986759.168613:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 920 00000100:00100000:1.0:1788986759.168622:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094385a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993611520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986759.168654:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986759.168700:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094385a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993611520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986759.168706:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 920 00000100:00080000:1.0:1788986759.168726:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986759.168761:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943858a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993611520:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986759.170274:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788986759.233665:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986759.233672:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986759.233678:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986759.233725:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986759.233738:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986759.233748:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986759.233772:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993611648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986759.233835:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986759.233892:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f89e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788986759.233949:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993611648 00000100:00100000:1.0:1788986759.233956:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993611648 00000100:00100000:1.0:1788986759.234013:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1396 00000100:00100000:1.0:1788986759.234022:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993611648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986759.234035:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986759.234048:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549ca6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549c9f expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986759.234070:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549ca6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549c9f expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986759.234080:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549ca6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549c9f expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986759.234118:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986759.234160:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993611648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986759.234170:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1396 00000100:00100000:0.0:1788986759.238280:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993611648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986759.238307:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986759.238320:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986759.238342:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986759.238347:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986759.238359:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986760.192389:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993611904:0@lo:400:kworker.0 00000100:00100000:1.0:1788986760.192412:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993611776:0@lo:400:kworker.0 00000100:00100000:2.0:1788986760.192477:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993612160:0@lo:400:kworker.0 00000100:00100000:1.0:1788986760.195526:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986760.195662:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993612288:0@lo:400:kworker.0 00000100:00100000:1.0:1788986760.195701:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986760.195743:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993612288 00000100:00100000:1.0:1788986760.195749:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993612288 00000100:00100000:1.0:1788986760.195795:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1812 00000100:00100000:1.0:1788986760.195804:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993612288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986760.195863:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943858a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993612288:12345-0@lo:400:kworker.0 Request processed in 60us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986760.195870:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1812 00000100:00080000:1.0:1788986760.195898:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986760.195929:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993612288:0@lo:400:kworker.0 00010000:00010000:1.0:1788986760.196760:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986760.196775:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993612032:0@lo:400:kworker.0 00000100:00100000:1.0:1788986760.196811:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986760.196846:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993612032 00000100:00100000:1.0:1788986760.196851:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993612032 00000100:00100000:1.0:1788986760.196896:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1813 00000100:00100000:1.0:1788986760.196904:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094385b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993612032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986760.196941:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094385b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993612032:12345-0@lo:400:kworker.0 Request processed in 38us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986760.196947:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1813 00000100:00080000:1.0:1788986760.196964:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986760.196982:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993612032:0@lo:400:kworker.0 00000100:00100000:0.0:1788986760.197144:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986760.197167:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993612416:0@lo:400:kworker.0 00000100:00100000:3.0:1788986760.200075:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993611776 00000100:00100000:3.0:1788986760.200101:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993611776 00000100:00100000:3.0:1788986760.200155:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1788986760.200165:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993611776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986760.200251:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993611776:12345-0@lo:400:kworker.0 Request processed in 88us (4729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986760.200258:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:1.0:1788986760.200951:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993611904 00000100:00100000:1.0:1788986760.200957:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993611904 00000100:00100000:1.0:1788986760.200993:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1814 00000100:00100000:1.0:1788986760.201000:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993611904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986760.201044:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993611904:12345-0@lo:400:kworker.0 Request processed in 45us (3899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986760.201050:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1814 00000100:00100000:1.0:1788986760.201112:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993611776:0@lo:400:kworker.0 00000100:00100000:0.0:1788986760.201214:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986760.201261:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993612416 00000100:00100000:3.0:1788986760.201265:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993612416 00000100:00100000:0.0:1788986760.201267:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993611904:0@lo:400:kworker.0 00000100:00100000:3.0:1788986760.201356:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1365 00000100:00100000:3.0:1788986760.201362:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993612416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986760.201398:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993612416:12345-0@lo:400:kworker.0 Request processed in 36us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986760.201403:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1365 00000100:00100000:3.0:1788986760.201429:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe14e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993612416:0@lo:400:kworker.0 00000100:00080000:1.0:1788986760.203984:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986760.204923:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986760.205115:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993612160 00000100:00100000:3.0:1788986760.205123:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993612160 00000100:00100000:3.0:1788986760.205166:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1366 00000100:00100000:3.0:1788986760.205176:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993612160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986760.205247:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993612160:12345-0@lo:400:kworker.0 Request processed in 72us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986760.205254:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1366 00000100:00100000:2.0:1788986760.205374:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993612160:0@lo:400:kworker.0 00000100:00100000:0.0:1788986760.586899:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986760.586969:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971405696 00000100:00100000:3.0:1788986760.586978:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971405696 00000100:00100000:3.0:1788986760.587052:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1068 00000100:00100000:3.0:1788986760.587063:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:55925:x1875885971405696:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986760.587080:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986760.587121:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549cad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1552 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986760.587313:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549cb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986760.587326:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986760.587339:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986760.587370:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:3.0:1788986760.587373:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986760.587390:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549cb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986760.587413:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549cad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1552 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986760.587434:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549cb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1552 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986760.587444:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:3.0:1788986760.587447:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986760.587451:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788986760.587506:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55925:x1875885971405696:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 444us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986760.587513:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1068 00000100:00080000:0.0:1788986760.587879:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986760.610695:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986760.610789:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971405952 00000100:00100000:1.0:1788986760.610798:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971405952 00000100:00100000:1.0:1788986760.610846:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1069 00000100:00100000:1.0:1788986760.610856:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55925:x1875885971405952:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986760.610900:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986760.610925:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf549cb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1552 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986760.610939:0:5854:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf549c44) 00010000:00010000:1.0:1788986760.610943:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:1.0:1788986760.610953:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986760.610976:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549cbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986760.610988:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986760.610998:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986760.673495:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000aa43cbf2 reply state 00000000f155793c transno 4294967700 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986760.673513:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788986760.673527:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000001:00080000:3.0:1788986760.673536:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967700 is committed 00010000:00080000:0.0:1788986760.673620:0:5854:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788986760.673643:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:55925:x1875885971405952:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 62785us (62951us total) trans 4294967700 rc 0/0 00000100:00100000:0.0:1788986760.673653:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1069 00010000:00010000:1.0:1788986760.673925:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549cbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986760.673934:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549cbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986760.673941:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549cbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986760.673947:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986760.673952:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549cbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986760.673959:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549cbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986760.673973:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:1.0:1788986760.673976:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986760.673981:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549cbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986760.673987:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549cbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986760.704502:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986760.704524:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993612544:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986760.704587:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986760.704687:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993612544 00000100:00100000:1.0:1788986760.704702:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993612544 00000100:00100000:1.0:1788986760.704745:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 921 00000100:00100000:1.0:1788986760.704754:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993612544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986760.704783:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986760.704837:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993612544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986760.704845:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 921 00000100:00100000:2.0:1788986760.705037:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943858700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993612544:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986761.216280:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986761.392169:0:95553:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff39508940 20000000:00000080:2.0:1788986761.392185:0:95553:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f8bb400 uarg=0000000000000000 00010000:00010000:2.0:1788986761.392644:0:95553:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986761.392660:0:95553:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986761.392673:0:95553:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986761.392690:0:95553:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986761.392706:0:95553:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549ca6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549c9f expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986761.392714:0:95553:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986761.392748:0:95553:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549ca6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549c9f expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986761.392761:0:95553:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549ca6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549c9f expref: 18 pid: 5848 timeout: 2645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986761.392773:0:95553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95553:1875885993612672:0@lo:104: 00000100:00100000:2.0:1788986761.392829:0:95553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986761.392894:0:95553:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f89ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788986761.393164:0:7642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788986761.393179:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993612672 00000100:00100000:0.0:1788986761.393184:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993612672 00000100:00100000:0.0:1788986761.393238:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 377 00000100:00100000:0.0:1788986761.393247:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:95553:x1875885993612672:12345-0@lo:104: 00010000:00010000:0.0:1788986761.393260:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393318:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986761.393324:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:95553:x1875885993612672:12345-0@lo:104: Request processed in 79us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986761.393330:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 377 00010000:00010000:0.0:1788986761.393369:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986761.393374:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393381:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986761.393385:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393392:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986761.393399:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986761.393405:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986761.393443:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393449:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986761.393471:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393478:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef600/0xc20d828fcf549c9f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549ca6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393497:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986761.393498:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986761.393500:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986761.393518:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993612800:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986761.393548:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986761.393582:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993612800 00000100:00100000:0.0:1788986761.393586:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993612800 00010000:00010000:0.0:1788986761.393604:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549ca6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549c9f expref: 19 pid: 5848 timeout: 2645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986761.393626:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1788986761.393633:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993612800:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986761.393645:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986761.393649:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549ca6 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549c9f expref: 19 pid: 5848 timeout: 2645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393658:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549ca6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549c9f expref: 19 pid: 5848 timeout: 2645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393672:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393679:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393690:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393696:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393703:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393709:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393714:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986761.393717:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393724:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393731:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986761.393738:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986761.393768:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe15c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993612800:12345-0@lo:103:ldlm_bl.0 Request processed in 136us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986761.393775:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 441 00000100:00100000:0.0:1788986761.393803:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993612800:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986761.394466:0:95553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030e00/0xc20d828fcf549ca6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549c9f expref: 18 pid: 5848 timeout: 2645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986761.394480:0:95553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95553:1875885993612672:0@lo:104: 00010000:00010000:1.0:1788986761.394496:0:95553:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986761.394505:0:95553:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986761.394511:0:95553:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986761.394518:0:95553:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf549cc2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95553 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986762.250871:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986762.357145:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986762.357202:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986762.357255:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986762.357310:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986762.357361:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971406080 00000100:00100000:1.0:1788986762.357373:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971406080 00000100:00100000:1.0:1788986762.357445:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1398 00000100:00100000:1.0:1788986762.357459:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971406080:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986762.357468:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971406464 00000100:00100000:0.0:1788986762.357482:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971406464 00000100:00100000:0.0:1788986762.357540:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971406336 00000100:00100000:0.0:1788986762.357544:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971406336 00000100:00100000:0.0:1788986762.357573:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1367 00000100:00100000:0.0:1788986762.357583:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094385b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971406464:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986762.357654:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094385b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971406464:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986762.357662:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1367 00000100:00100000:0.0:1788986762.357686:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1368 00000100:00100000:0.0:1788986762.357694:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a76788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971406336:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986762.357713:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971406208 00000100:00100000:2.0:1788986762.357720:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971406208 00000100:00100000:0.0:1788986762.357727:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a76788450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971406336:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986762.357735:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1368 00000100:00100000:2.0:1788986762.357775:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1815 00000100:00100000:2.0:1788986762.357786:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971406208:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986762.357840:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943858380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971406208:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 56us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986762.357850:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1815 00000100:00100000:1.0:1788986762.358262:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971406080:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 623us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986762.358277:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1398 00000100:00080000:1.0:1788986762.358348:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986762.358353:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986762.358355:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:0.0:1788986762.884699:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986762.884706:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986762.884711:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986762.884755:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986762.884767:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986762.884779:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986762.884803:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993612928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986762.884882:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986762.884928:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a808dbc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788986762.884948:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993612928 00000100:00100000:0.0:1788986762.884955:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993612928 00000100:00100000:0.0:1788986762.884999:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:0.0:1788986762.885008:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993612928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986762.885021:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986762.885032:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549cd0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549cc9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986762.885054:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549cd0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549cc9 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986762.885065:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549cd0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549cc9 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986762.885073:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788986762.885134:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993612928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986762.885141:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00100000:0.0:1788986762.885547:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993612928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986762.885561:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549cd0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986762.885570:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549cd0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986762.885586:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986762.885591:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549cd0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986762.885598:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549cd0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986763.269235:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986764.289234:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986764.298801:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986764.298820:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993613056:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986764.298879:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986764.299049:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993613056 00000100:00100000:1.0:1788986764.299057:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993613056 00000100:00100000:1.0:1788986764.299151:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 922 00000100:00100000:1.0:1788986764.299161:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993613056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986764.299195:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986764.299255:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993613056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986764.299262:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 922 00000100:00100000:1.0:1788986764.299316:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993613056:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986764.299536:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986764.705832:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986764.706929:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971406592 00000100:00100000:2.0:1788986764.706940:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971406592 00000100:00100000:2.0:1788986764.707005:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1070 00000100:00100000:2.0:1788986764.707015:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56002:x1875885971406592:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986764.707033:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986764.707053:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549cd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1559 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788986764.708556:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986764.708694:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549cde lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.708711:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549cde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.708725:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549cde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.708741:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ce5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.708748:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.708754:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.709033:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549cec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.709042:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.709054:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986764.709076:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:2.0:1788986764.709080:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986764.710040:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549cec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.710057:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549cde lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.710064:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549cde lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.710071:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549cde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.710078:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986764.710082:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549cde lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.713190:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549cde lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.713216:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986764.713220:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986764.713225:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549cde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.713232:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549cde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.713249:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ce5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.713254:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ce5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.713260:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.713265:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986764.713268:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ce5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.714363:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ce5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.714375:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986764.714377:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986764.714382:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ce5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.714388:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549ce5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.715228:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf549cd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1559 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.715250:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549cec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1559 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.715263:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:2.0:1788986764.715266:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986764.715269:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788986764.716266:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56002:x1875885971406592:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 9250us (10443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986764.716342:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1070 00000100:00100000:1.0:1788986764.720668:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986764.720756:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971406848 00000100:00100000:0.0:1788986764.720765:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971406848 00000100:00100000:0.0:1788986764.720847:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1071 00000100:00100000:0.0:1788986764.720857:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56002:x1875885971406848:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788986764.720875:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986764.720892:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549cf3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1560 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.721451:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549cfa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.721467:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549cfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.721477:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549cfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.721491:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549d01 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.721498:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.721509:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788986764.722388:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1788986764.722642:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549d08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.722653:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.722662:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549d08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.722693:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549cfa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.722700:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549cfa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.722707:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549cfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.722713:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986764.722717:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549cfa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.722725:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549cfa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.722735:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:1.0:1788986764.722738:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986764.722744:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549cfa lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.722750:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549cfa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986764.722762:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b928d880 reply state 00000000c59c65b3 transno 4294967701 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986764.722770:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986764.722798:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf549cf3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1560 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.722812:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549d08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1560 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.722819:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:1.0:1788986764.722821:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986764.722823:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788986764.722891:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943859f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:56002:x1875885971406848:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 2036us (2231us total) trans 4294967701 rc 0/0 00000100:00100000:1.0:1788986764.722899:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1071 00010000:00010000:3.0:1788986764.725960:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549d01 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.725977:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549d01 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.725985:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549d01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.725992:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986764.725996:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549d01 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.726004:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549d01 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.726023:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a45316500) 00010000:00010000:3.0:1788986764.726026:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986764.726030:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549d01 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.726037:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549d01 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986764.729469:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986764.729835:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971407104 00000100:00100000:2.0:1788986764.729845:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971407104 00000100:00100000:2.0:1788986764.729985:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1072 00000100:00100000:2.0:1788986764.729995:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094385b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:56002:x1875885971407104:12345-192.168.206.21@tcp:36:touch.60003 00010000:00010000:2.0:1788986764.730048:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986764.730083:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549d08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1560 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.730187:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:2.0:1788986764.730198:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986764.730247:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549d16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.730259:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549d16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.730269:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549d16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986764.730466:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000018f033d4 reply state 00000000c71c11d9 transno 4294967702 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549d16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986764.730480:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986764.730576:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094385b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:56002:x1875885971407104:12345-192.168.206.21@tcp:36:touch.60003 Request processed in 581us (1114us total) trans 4294967702 rc 0/0 00000100:00100000:2.0:1788986764.730583:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1072 00010000:00010000:3.0:1788986764.733435:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549d16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.733452:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549d16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.733461:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549d16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.733467:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986764.733472:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549d16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.733480:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549d16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.733495:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:3.0:1788986764.733498:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986764.733503:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549d16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.733509:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf549d16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986764.734689:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986764.734963:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971407232 00000100:00100000:2.0:1788986764.734973:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971407232 00000100:00100000:2.0:1788986764.735032:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1073 00000100:00100000:2.0:1788986764.735042:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:56002:x1875885971407232:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986764.735066:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986764.735120:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549d1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1567 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.735175:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549d1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x58:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1567 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.735187:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549d1d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x58:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1567 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.735218:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986764.735221:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788986764.735225:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1600, rc 0) 00000100:00100000:2.0:1788986764.735441:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943859500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:56002:x1875885971407232:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 400us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986764.735449:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1073 00000100:00100000:1.0:1788986764.738970:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986764.742444:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971407360 00000100:00100000:0.0:1788986764.742458:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971407360 00000100:00100000:0.0:1788986764.742612:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 586 00000100:00100000:0.0:1788986764.742623:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971407360:12345-192.168.206.21@tcp:2:touch.60003 00000100:00100000:0.0:1788986764.742934:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943858000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971407360:12345-192.168.206.21@tcp:2:touch.60003 Request processed in 312us (3971us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1788986764.742942:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 586 00000100:00080000:2.0:1788986764.744528:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986764.745939:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986764.746009:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971407616 00000100:00100000:3.0:1788986764.746017:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971407616 00000100:00100000:3.0:1788986764.746067:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 106 00000100:00100000:3.0:1788986764.746078:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:56002:x1875885971407616:12345-192.168.206.21@tcp:35:touch.60003 00000100:00100000:3.0:1788986764.746423:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:56002:x1875885971407616:12345-192.168.206.21@tcp:35:touch.60003 Request processed in 347us (490us total) trans 4294967703 rc 0/0 00000100:00100000:3.0:1788986764.746431:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 106 00000100:00100000:0.0:1788986764.801598:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986764.801686:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971407744 00000100:00100000:1.0:1788986764.801695:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971407744 00000100:00100000:1.0:1788986764.801788:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1074 00000100:00100000:1.0:1788986764.801797:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:56006:x1875885971407744:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:1.0:1788986764.801823:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986764.801841:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549d24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d156e expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.801905:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549d2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.801927:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.801938:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.801951:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549d32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.801957:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.801964:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802037:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549d39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802045:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802051:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986764.802080:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x58:0x0]: returning size 0 00000004:00200000:1.0:1788986764.802084:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986764.802146:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802158:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549d39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802167:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549d2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802173:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549d2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802180:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802186:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986764.802190:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549d2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802197:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549d2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802220:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:1.0:1788986764.802223:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986764.802228:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549d2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802234:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549d2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802249:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549d32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802260:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549d32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802265:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802270:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986764.802273:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549d32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802278:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549d32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802285:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a45316d00) 00010000:00010000:1.0:1788986764.802288:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986764.802290:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549d32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802401:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549d32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802433:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf549d24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d156e expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802445:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549d39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d156e expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.802453:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:1.0:1788986764.802455:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986764.802458:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788986764.802510:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:56006:x1875885971407744:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 715us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986764.802517:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1074 00000100:00100000:0.0:1788986764.806842:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986764.807375:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971407872 00000100:00100000:1.0:1788986764.807384:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971407872 00000100:00100000:1.0:1788986764.807477:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 587 00000100:00100000:1.0:1788986764.807488:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971407872:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:1.0:1788986764.807505:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986764.807525:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf549d40 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1575 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788986764.807550:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6aa1c58c, atime: 0x6aa1c58c, ctime: 0x6aa1c58c, blocks: 0x1 00010000:00010000:1.0:1788986764.807568:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=2548s v=(0 0) 00010000:00010000:1.0:1788986764.807573:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986764.807582:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf549d40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1575 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.807600:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf549d40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1575 expref: 7 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.807612:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788986764.807667:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971407872:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 181us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986764.807684:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 587 00000100:00100000:0.0:1788986764.814165:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986764.814389:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971408128 00000100:00100000:2.0:1788986764.814399:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971408128 00000100:00100000:2.0:1788986764.814462:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1075 00000100:00100000:2.0:1788986764.814473:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:56006:x1875885971408128:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:2.0:1788986764.814530:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986764.814559:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549d39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x58:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d156e expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.814582:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf549d1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x58:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1567 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.814593:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff9b0a45aca800) 00010000:00010000:2.0:1788986764.814605:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986764.814627:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549d47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.814640:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549d47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.814648:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549d47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.814662:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549d4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.814680:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549d4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.814696:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549d4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.814786:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549d55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.814795:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549d55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.814802:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549d55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986764.816384:0:15241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].34, 64 off10368 00000004:00080000:2.0:1788986764.816398:0:15241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2548719308546ns, next at 2549719305474ns, rc = 0 00010000:00010000:2.0:1788986764.816462:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549d5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816474:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816484:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549d5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816491:0:15241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549d5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816498:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549d5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816503:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816524:0:15241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986764.816546:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549d55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816552:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549d55 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816559:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549d55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816566:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986764.816570:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549d55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816579:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549d55 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816591:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986764.816594:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986764.816600:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549d55 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816607:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf549d55 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x58:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816626:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549d47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816633:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549d47 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816640:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549d47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816645:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986764.816648:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549d47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816659:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549d47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.816667:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:2.0:1788986764.817395:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986764.817400:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549d47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986764.817407:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf549d47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986764.817419:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006c6e1073 reply state 00000000b6ebab56 transno 4294967704 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549d4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986764.817428:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986764.817525:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:56006:x1875885971408128:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 3050us (3365us total) trans 4294967704 rc 0/0 00000100:00100000:2.0:1788986764.817534:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1075 00010000:00010000:1.0:1788986764.817969:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986764.817976:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549d5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.817983:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986764.817986:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549d5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.817994:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549d5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.818004:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x58:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:1.0:1788986764.818007:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788986764.818010:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549d5c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.818016:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf549d5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x58:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986764.818032:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986764.818034:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986764.818036:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986764.820425:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549d4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.820441:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549d4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.820461:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549d4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.820468:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986764.820472:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549d4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.820480:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549d4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.820493:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a45acaf00) 00010000:00010000:3.0:1788986764.820496:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986764.820500:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549d4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986764.820507:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf549d4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986765.313294:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993613440:0@lo:400:kworker.0 00000100:00100000:0.0:1788986765.313357:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986765.313408:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986765.313414:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993613568:0@lo:400:kworker.0 00000100:00100000:0.0:1788986765.313440:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986765.313473:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993613440 00000100:00100000:0.0:1788986765.313480:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993613440 00000100:00100000:0.0:1788986765.313527:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1816 00000100:00100000:0.0:1788986765.313536:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993613440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986765.313597:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993613440:12345-0@lo:400:kworker.0 Request processed in 62us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986765.313604:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1816 00000100:00100000:0.0:1788986765.313638:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993613568 00000100:00100000:0.0:1788986765.313642:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993613568 00000100:00100000:0.0:1788986765.313678:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1369 00000100:00100000:0.0:1788986765.313686:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993613568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986765.313715:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993613568:12345-0@lo:400:kworker.0 Request processed in 31us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986765.313722:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1369 00000100:00080000:0.0:1788986765.313737:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986765.313766:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993613568:0@lo:400:kworker.0 00000100:00100000:0.0:1788986765.313775:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993613440:0@lo:400:kworker.0 00000100:00100000:1.0:1788986765.313984:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993613184:0@lo:400:kworker.0 00000100:00100000:1.0:1788986765.314020:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986765.314043:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993613696:0@lo:400:kworker.0 00000100:00100000:1.0:1788986765.314062:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986765.314080:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788986765.314085:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993613312:0@lo:400:kworker.0 00000100:00100000:1.0:1788986765.314123:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986765.314136:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993613824:0@lo:400:kworker.0 00000100:00100000:1.0:1788986765.314154:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986765.314175:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993613696 00000100:00100000:1.0:1788986765.314178:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993613696 00000100:00100000:1.0:1788986765.314219:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993613312 00000100:00100000:1.0:1788986765.314223:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993613312 00000100:00100000:1.0:1788986765.314242:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1817 00000100:00100000:1.0:1788986765.314248:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094385a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993613696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986765.314283:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094385a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993613696:12345-0@lo:400:kworker.0 Request processed in 35us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986765.314288:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1817 00000100:00100000:1.0:1788986765.314302:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1818 00000100:00100000:1.0:1788986765.314308:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993613312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986765.314335:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943858e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993613312:12345-0@lo:400:kworker.0 Request processed in 28us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986765.314341:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1818 00000100:00080000:1.0:1788986765.314358:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986765.314376:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993613312:0@lo:400:kworker.0 00000100:00100000:1.0:1788986765.314386:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993613696:0@lo:400:kworker.0 00000100:00100000:3.0:1788986765.314474:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993613824 00000100:00100000:3.0:1788986765.314479:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993613824 00000100:00100000:3.0:1788986765.314522:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1370 00000100:00100000:3.0:1788986765.314529:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993613824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986765.314568:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943859880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993613824:12345-0@lo:400:kworker.0 Request processed in 39us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986765.314573:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1370 00010000:00010000:3.0:1788986765.314624:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986765.314642:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993613824:0@lo:400:kworker.0 00000100:00080000:1.0:1788986765.315120:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986765.315188:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993613184 00000100:00100000:0.0:1788986765.315193:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993613184 00000100:00100000:0.0:1788986765.315233:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:0.0:1788986765.315240:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993613184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986765.315280:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993613184:12345-0@lo:400:kworker.0 Request processed in 40us (1260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986765.315286:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1788986765.315405:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993613184:0@lo:400:kworker.0 00000100:00100000:3.0:1788986765.824505:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993613952:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986765.824570:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986765.834148:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993613952 00000100:00100000:3.0:1788986765.834159:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993613952 00000100:00100000:3.0:1788986765.834219:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1788986765.834229:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993613952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986765.834261:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986765.834465:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993613952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 237us (9894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986765.834473:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 923 00000100:00100000:3.0:1788986765.834536:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993613952:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788986765.904273:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967701 is committed 00000001:00080000:1.0:1788986765.910982:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967704 is committed 00000004:00080000:1.0:1788986765.910996:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 92 committed 00000100:00100000:0.0:1788986765.913775:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993614080:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788986765.913842:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986765.913929:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993614080 00000100:00100000:0.0:1788986765.913936:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993614080 00000100:00100000:0.0:1788986765.913984:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00000100:00100000:0.0:1788986765.913995:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993614080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788986765.914022:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:34 count 1 00010000:00010000:0.0:1788986765.914045:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986765.914078:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf549d40 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1575 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986765.914106:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788986765.914112:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986765.914117:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986765.914147:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf549d40 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1575 expref: 6 pid: 6695 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986765.914162:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf549d40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1575 expref: 6 pid: 6695 timeout: 2649 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986765.914175:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875885993614208:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986765.914241:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76582e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788986765.937717:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986765.937746:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971408256 00000100:00100000:0.0:1788986765.937754:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971408256 00010000:00010000:0.0:1788986765.937792:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf549d40 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1575 expref: 7 pid: 6695 timeout: 2649 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986765.937834:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 442 00000100:00100000:0.0:1788986765.937845:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971408256:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986765.937859:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986765.937865:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf549d40 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1575 expref: 7 pid: 6695 timeout: 2649 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986765.937879:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf549d40 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1575 expref: 7 pid: 6695 timeout: 2649 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986765.937902:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986765.937906:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986765.937912:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986765.937923:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986765.937943:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986765.937989:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971408256:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 145us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986765.937996:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 442 00010000:00010000:1.0:1788986765.944060:0:6695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048d99ca4/0xc20d828fcf549d40 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1575 expref: 6 pid: 6695 timeout: 2649 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986765.944084:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe15500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6695:1875885993614208:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788986765.944394:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986765.944412:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986765.944420:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986765.944431:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986765.944439:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986765.944456:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788986765.944934:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993614080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 30941us (31091us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788986765.944943:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00010000:00010000:1.0:1788986765.944975:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986765.944982:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986765.944990:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986765.944994:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986765.945004:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986765.945022:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986765.945029:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ad6f6dc/0xc20d828fcf549d63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986765.945047:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986765.945049:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986765.945051:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788986765.946166:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7fe14380/2, rc 0, transno 4294967365 00000100:00100000:2.0:1788986765.946176:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993614080:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788986766.336228:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986766.542031:0:95798:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff3de7cab0 20000000:00000080:2.0:1788986766.542049:0:95798:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a79743800 uarg=0000000000000000 00010000:00010000:2.0:1788986766.542541:0:95798:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788986766.542587:0:95798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:2.0:1788986766.542591:0:95798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986766.542600:0:95798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf549cec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1559 expref: 5 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986766.542626:0:95798:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:2.0:1788986766.542640:0:95798:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986766.542653:0:95798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986766.544207:0:95798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549cd0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549cc9 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986766.544220:0:95798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986766.544263:0:95798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549cd0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549cc9 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986766.544278:0:95798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549cd0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549cc9 expref: 18 pid: 5849 timeout: 2650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986766.544291:0:95798:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95798:1875885993614336:0@lo:104: 00000100:00100000:2.0:1788986766.544347:0:95798:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986766.544402:0:95798:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f89e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788986766.545164:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993614336 00000100:00100000:1.0:1788986766.545172:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993614336 00000100:00100000:1.0:1788986766.545231:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:1.0:1788986766.545241:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:95798:x1875885993614336:12345-0@lo:104: 00010000:00010000:1.0:1788986766.545253:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549cd0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986766.545316:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986766.545322:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:95798:x1875885993614336:12345-0@lo:104: Request processed in 84us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986766.545328:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00010000:00010000:1.0:1788986766.545348:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986766.545353:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549cd0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986766.545360:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986766.545364:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549cd0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986766.545373:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549cd0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986766.545380:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549cd0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986766.545386:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986766.545413:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549cd0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986766.545420:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788986766.545433:0:95798:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95798:1875885993614336:0@lo:104: 00010000:00010000:1.0:1788986766.545438:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549cd0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986766.545444:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508efa00/0xc20d828fcf549cc9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549cd0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986766.545449:0:95798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986766.545458:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986766.545459:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986766.545461:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986766.545474:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986766.545484:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094385ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993614464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986766.545518:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986766.546202:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993614464 00000100:00100000:2.0:1788986766.546208:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993614464 00010000:00010000:2.0:1788986766.546233:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549cd0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549cc9 expref: 19 pid: 5849 timeout: 2650 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986766.546284:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 443 00000100:00100000:0.0:1788986766.546294:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993614464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986766.546305:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986766.546312:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549cd0 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549cc9 expref: 19 pid: 5849 timeout: 2650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986766.546322:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549cd0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549cc9 expref: 19 pid: 5849 timeout: 2650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986766.546336:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549cd0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549cc9 expref: 19 pid: 5849 timeout: 2650 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986766.546348:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986766.546357:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986766.546371:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986766.546379:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986766.546386:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986766.546392:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986766.546399:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986766.546402:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986766.546410:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986766.546433:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986766.546444:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986766.546485:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094385bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993614464:12345-0@lo:103:ldlm_bl.0 Request processed in 194us (966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986766.546492:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 443 00000100:00100000:1.0:1788986766.546555:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094385ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993614464:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986766.546611:0:95798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986766.546620:0:95798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986766.546627:0:95798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549d6a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986767.360231:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986767.488200:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986767.488240:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986767.488262:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986767.488288:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971408512 00000100:00100000:1.0:1788986767.488296:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971408512 00000100:00100000:1.0:1788986767.488354:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1819 00000100:00100000:1.0:1788986767.488364:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971408512:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986767.488433:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943859180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971408512:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 70us (169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986767.488441:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1819 00000100:00080000:1.0:1788986767.488462:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986767.488502:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986767.488537:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971408640 00000100:00100000:1.0:1788986767.488541:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971408640 00000100:00100000:1.0:1788986767.488581:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971408768 00000100:00100000:1.0:1788986767.488584:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971408768 00000100:00100000:1.0:1788986767.488608:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1371 00000100:00100000:1.0:1788986767.488615:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971408640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986767.488642:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094385ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971408640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986767.488648:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1371 00000100:00100000:1.0:1788986767.488662:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1372 00000100:00100000:1.0:1788986767.488668:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971408768:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986767.488692:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971408768:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986767.488697:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1372 00000100:00080000:1.0:1788986767.488712:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986767.488715:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986767.488898:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971408384 00000100:00100000:2.0:1788986767.488904:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971408384 00000100:00100000:2.0:1788986767.488930:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1401 00000100:00100000:2.0:1788986767.488937:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971408384:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986767.488966:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971408384:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986767.488973:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1401 10000000:01000000:0.0:1788986767.809609:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986767.809616:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986767.809621:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986767.809664:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986767.809674:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986767.809684:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986767.809706:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993614592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986767.809769:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986767.809850:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76582780 going to sleep for 11 seconds 00000100:00100000:3.0:1788986767.811865:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993614592 00000100:00100000:3.0:1788986767.811876:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993614592 00000100:00100000:3.0:1788986767.811929:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1402 00000100:00100000:3.0:1788986767.811937:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993614592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986767.811952:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986767.811968:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549d78 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549d71 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986767.811993:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549d78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549d71 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986767.812002:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549d78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549d71 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986767.812010:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986767.812071:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993614592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986767.812077:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1402 00000100:00100000:1.0:1788986767.812656:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe15500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993614592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986767.812675:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986767.812686:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986767.812704:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986767.812710:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986767.812718:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986768.384462:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788986768.498327:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967364 is committed 00000001:00080000:2.0:1788986768.498347:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967365 is committed 00010000:00010000:3.0:1788986769.411719:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986769.412419:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986769.412440:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993614720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986769.412501:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986769.412660:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993614720 00000100:00100000:2.0:1788986769.412668:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993614720 00000100:00080000:1.0:1788986769.412783:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986769.412829:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 924 00000100:00100000:2.0:1788986769.412839:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993614720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986769.412871:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986769.412976:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993614720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986769.412984:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 924 00000100:00100000:0.0:1788986769.413865:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967365 gen 2 00000004:00080000:0.0:1788986769.413872:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7fe14380, transno 4294967365 00000100:00100000:0.0:1788986769.413934:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993614720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986769.766739:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986769.767172:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971408896 00000100:00100000:3.0:1788986769.767194:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971408896 00000100:00100000:3.0:1788986769.767262:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1076 00000100:00100000:3.0:1788986769.767271:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56094:x1875885971408896:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986769.767289:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986769.767310:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549d7f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d157c expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.767375:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549d86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.767389:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.767401:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788986769.767489:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1788986769.767552:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:3.0:1788986769.767557:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986769.767575:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549d86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.767600:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549d7f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d157c expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.767620:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549d86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d157c expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.767629:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986769.767632:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986769.767635:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2800, rc 0) 00000100:00100000:3.0:1788986769.767702:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56094:x1875885971408896:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 431us (972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986769.767709:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1076 00000100:00100000:3.0:1788986769.781709:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986769.781743:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971409152 00000100:00100000:3.0:1788986769.781752:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971409152 00000100:00100000:3.0:1788986769.781801:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1077 00000100:00100000:3.0:1788986769.781810:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56094:x1875885971409152:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986769.781856:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986769.781881:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549d86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d157c expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.781895:0:5856:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf549cec) 00010000:00010000:3.0:1788986769.781899:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986769.781909:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986769.781932:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549d8d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.781944:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549d8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.781954:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549d8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788986769.841450:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967705 is committed 00000004:00010000:3.0:1788986769.841896:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000578b0963 reply state 00000000ec6eeba1 transno 4294967705 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549d8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986769.841909:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986769.841924:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00010000:00080000:3.0:1788986769.842018:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788986769.842035:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56094:x1875885971409152:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 60223us (60329us total) trans 4294967705 rc 0/0 00000100:00100000:3.0:1788986769.842043:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1077 00010000:00010000:3.0:1788986769.842077:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549d8d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.842109:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549d8d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.842117:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549d8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.842124:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986769.842128:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549d8d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.842136:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549d8d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.842151:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:3.0:1788986769.842153:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986769.842158:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549d8d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986769.842164:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549d8d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986770.437473:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993614848:0@lo:400:kworker.0 00000100:00100000:3.0:1788986770.437543:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986770.437585:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993615360:0@lo:400:kworker.0 00000100:00100000:3.0:1788986770.437613:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986770.437637:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788986770.437657:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993614976:0@lo:400:kworker.0 00000100:00100000:3.0:1788986770.437681:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986770.437699:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993615488:0@lo:400:kworker.0 00000100:00100000:3.0:1788986770.437722:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986770.437747:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993615104:0@lo:400:kworker.0 00000100:00100000:3.0:1788986770.437768:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986770.437786:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986770.437791:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993615232:0@lo:400:kworker.0 00000100:00100000:3.0:1788986770.437813:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986770.437839:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993615360 00000100:00100000:3.0:1788986770.437846:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993615360 00000100:00100000:3.0:1788986770.438269:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993614976 00000100:00100000:3.0:1788986770.438274:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993614976 00000100:00100000:3.0:1788986770.438291:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993615104 00000100:00100000:3.0:1788986770.438294:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993615104 00000100:00100000:3.0:1788986770.438311:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1820 00000100:00100000:3.0:1788986770.438319:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993615360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986770.438370:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993615360:12345-0@lo:400:kworker.0 Request processed in 52us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986770.438378:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1820 00000100:00100000:3.0:1788986770.438393:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1821 00000100:00100000:3.0:1788986770.438399:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993614976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986770.438424:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993614976:12345-0@lo:400:kworker.0 Request processed in 25us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986770.438430:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1821 00000100:00100000:3.0:1788986770.438441:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1822 00000100:00100000:3.0:1788986770.438447:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993615104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986770.438478:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993615104:12345-0@lo:400:kworker.0 Request processed in 31us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986770.438487:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1822 00000100:00100000:3.0:1788986770.438556:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993615104:0@lo:400:kworker.0 00000100:00100000:3.0:1788986770.438580:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993614976:0@lo:400:kworker.0 00000100:00100000:3.0:1788986770.438589:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993615360:0@lo:400:kworker.0 00000100:00080000:2.0:1788986770.438658:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986770.438668:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986770.441231:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993614848 00000100:00100000:1.0:1788986770.441241:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993614848 00000100:00100000:1.0:1788986770.441281:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1788986770.441289:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993614848:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986770.443791:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993614848:12345-0@lo:400:kworker.0 Request processed in 2493us (6238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986770.443803:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00100000:1.0:1788986770.443863:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993615488 00000100:00100000:1.0:1788986770.443870:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993615488 00000100:00100000:1.0:1788986770.443913:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993615232 00000100:00100000:1.0:1788986770.443916:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993615232 00000100:00100000:1.0:1788986770.443936:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1373 00000100:00100000:1.0:1788986770.443943:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993615488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986770.444001:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993615488:12345-0@lo:400:kworker.0 Request processed in 58us (6278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986770.444006:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1373 00000100:00100000:1.0:1788986770.444019:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1788986770.444026:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993615232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986770.444060:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993615232:12345-0@lo:400:kworker.0 Request processed in 34us (6247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986770.444066:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1374 00000100:00100000:1.0:1788986770.444127:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993615232:0@lo:400:kworker.0 00000100:00080000:3.0:1788986770.446244:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986770.446842:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993614848:0@lo:400:kworker.0 00000100:00100000:2.0:1788986770.447575:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993615488:0@lo:400:kworker.0 00000020:00000080:0.0:1788986770.594033:0:95994:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc85267b30 20000000:00000080:0.0:1788986770.594739:0:95994:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094295f400 uarg=0000000000000000 00010000:00010000:0.0:1788986770.595932:0:95994:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986770.595949:0:95994:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986770.595963:0:95994:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986770.595981:0:95994:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986770.595997:0:95994:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549d78 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549d71 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986770.596006:0:95994:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986770.596728:0:95994:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549d78 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549d71 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986770.596747:0:95994:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549d78 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549d71 expref: 18 pid: 5849 timeout: 2654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986770.596762:0:95994:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95994:1875885993615616:0@lo:104: 00000100:00100000:0.0:1788986770.596824:0:95994:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986770.596912:0:95994:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76582480 going to sleep for 11 seconds 00000100:00100000:2.0:1788986770.599508:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993615616 00000100:00100000:2.0:1788986770.599520:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993615616 00000100:00100000:0.0:1788986770.600120:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 379 00000100:00100000:0.0:1788986770.600131:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:95994:x1875885993615616:12345-0@lo:104: 00010000:00010000:0.0:1788986770.600148:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986770.600305:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986770.600311:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:95994:x1875885993615616:12345-0@lo:104: Request processed in 182us (3487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986770.600321:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 379 00010000:00010000:2.0:1788986770.600421:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986770.600427:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600435:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986770.600440:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600448:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986770.600456:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986770.600461:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986770.600498:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600505:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986770.600530:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600537:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549d71 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549d78 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600556:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986770.600558:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986770.600559:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986770.600598:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986770.600611:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993615744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986770.600659:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986770.600781:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993615744 00000100:00100000:2.0:1788986770.600786:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993615744 00010000:00010000:2.0:1788986770.600806:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549d78 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549d71 expref: 19 pid: 5849 timeout: 2654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986770.600835:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 444 00000100:00100000:2.0:1788986770.600842:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45613450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993615744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986770.600852:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986770.600857:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549d78 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549d71 expref: 19 pid: 5849 timeout: 2654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600868:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549d78 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549d71 expref: 19 pid: 5849 timeout: 2654 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600884:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600893:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600908:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600917:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600924:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600931:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600937:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986770.600942:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600949:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600957:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986770.600966:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986770.601000:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45613450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993615744:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986770.601007:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 444 00000100:00100000:1.0:1788986770.601120:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993615744:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986770.601743:0:95994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549d78 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549d71 expref: 18 pid: 5849 timeout: 2654 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986770.601756:0:95994:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:95994:1875885993615616:0@lo:104: 00010000:00010000:3.0:1788986770.601771:0:95994:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986770.601779:0:95994:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986770.601785:0:95994:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986770.601791:0:95994:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549d94 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 95994 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986770.947782:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993615872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986770.947847:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986770.947926:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993615872 00000100:00100000:2.0:1788986770.947934:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993615872 00000100:00100000:2.0:1788986770.947976:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 925 00000100:00100000:2.0:1788986770.947984:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993615872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986770.948015:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986770.948076:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993615872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986770.948083:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 925 00000100:00100000:2.0:1788986770.948233:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993615872:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986771.457412:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986772.480488:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986772.594704:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986772.594748:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986772.594786:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986772.594812:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986772.594883:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971409408 00000100:00100000:1.0:1788986772.594891:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971409408 00000100:00100000:1.0:1788986772.594956:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1823 00000100:00100000:1.0:1788986772.594968:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971409408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986772.595048:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971409408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 83us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986772.595056:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1823 00000100:00100000:1.0:1788986772.595081:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971409664 00000100:00100000:1.0:1788986772.595085:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971409664 00000100:00100000:1.0:1788986772.595129:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971409536 00000100:00100000:1.0:1788986772.595132:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971409536 00000100:00100000:1.0:1788986772.595151:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1375 00000100:00100000:1.0:1788986772.595166:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971409664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986772.595193:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971409664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (445us total) trans 0 rc 0/0 00000100:00080000:3.0:1788986772.595294:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986772.595298:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986772.595300:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986772.595328:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1375 00000100:00100000:1.0:1788986772.595344:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1376 00000100:00100000:1.0:1788986772.595352:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971409536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986772.595391:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971409536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986772.595397:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1376 00000100:00100000:3.0:1788986772.596302:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971409280 00000100:00100000:3.0:1788986772.596308:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971409280 00000100:00100000:3.0:1788986772.596351:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1404 00000100:00100000:3.0:1788986772.596367:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971409280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986772.596407:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971409280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 49us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986772.596414:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1404 10000000:01000000:1.0:1788986772.608191:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986772.608198:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986772.608203:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986772.608248:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986772.608260:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986772.608271:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986772.608296:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943859c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993616000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986772.608371:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986772.608424:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76058900 going to sleep for 11 seconds 00000100:00100000:3.0:1788986772.608555:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993616000 00000100:00100000:3.0:1788986772.608563:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993616000 00000100:00100000:3.0:1788986772.608613:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1405 00000100:00100000:3.0:1788986772.608622:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993616000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986772.608645:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986772.608660:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549da2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549d9b expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986772.608683:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549da2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549d9b expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986772.608692:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549da2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549d9b expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986772.608700:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986772.608741:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993616000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986772.608747:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1405 00000100:00100000:3.0:1788986772.608792:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943859c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993616000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986772.608806:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986772.608814:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986772.608831:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986772.608835:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986772.608842:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986773.510249:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986774.074169:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986774.074418:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971409792 00000100:00100000:3.0:1788986774.074428:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971409792 00000100:00100000:3.0:1788986774.074490:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1078 00000100:00100000:3.0:1788986774.074500:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56170:x1875885971409792:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:3.0:1788986774.074517:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986774.074538:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549da9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1583 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.074597:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549db0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.074611:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549db0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.074635:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549db0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.074648:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549db7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.074655:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549db7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.074661:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549db7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.074965:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549dbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.074975:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.074983:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986774.075003:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:3.0:1788986774.075006:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986774.075022:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549dbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075033:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549db0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075040:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549db0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075046:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549db0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075052:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986774.075057:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549db0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075065:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549db0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075075:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:3.0:1788986774.075078:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986774.075082:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549db0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075109:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549db0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075120:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549db7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075127:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549db7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075133:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549db7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075138:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986774.075141:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549db7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075146:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549db7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075163:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a55745c00) 00010000:00010000:3.0:1788986774.075165:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986774.075168:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549db7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075179:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549db7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075203:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549da9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1583 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986774.075217:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549dbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1583 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788986774.075424:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986774.075454:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986774.075457:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986774.075459:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3800, rc 0) 00000100:00100000:3.0:1788986774.077084:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56170:x1875885971409792:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 2579us (2928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986774.077116:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1078 00000100:00100000:3.0:1788986774.528944:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993616128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986774.529008:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986774.529125:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993616128 00000100:00100000:1.0:1788986774.529133:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993616128 00000100:00100000:1.0:1788986774.529196:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 926 00000100:00100000:1.0:1788986774.529205:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993616128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986774.529236:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986774.529794:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993616128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 589us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986774.529803:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 926 00000100:00080000:1.0:1788986774.529824:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986774.529880:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993616128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986774.533673:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986775.554770:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986775.554890:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986775.554908:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993616256:0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.554976:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986775.555025:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993616256 00000100:00100000:1.0:1788986775.555032:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993616256 00000100:00100000:1.0:1788986775.555069:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1788986775.555078:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993616256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555168:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993616256:12345-0@lo:400:kworker.0 Request processed in 91us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986775.555175:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1406 00000100:00100000:1.0:1788986775.555220:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993616256:0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555270:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993616384:0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555296:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986775.555329:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993616384 00000100:00100000:1.0:1788986775.555333:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993616384 00000100:00100000:1.0:1788986775.555360:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1824 00000100:00100000:1.0:1788986775.555367:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094385bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993616384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555402:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094385bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993616384:12345-0@lo:400:kworker.0 Request processed in 35us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986775.555407:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1824 00000100:00100000:1.0:1788986775.555436:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993616384:0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555466:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993616512:0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555490:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986775.555515:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993616512 00000100:00100000:1.0:1788986775.555519:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993616512 00000100:00100000:1.0:1788986775.555547:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1825 00000100:00100000:1.0:1788986775.555553:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094385b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993616512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555583:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094385b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993616512:12345-0@lo:400:kworker.0 Request processed in 30us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986775.555589:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1825 00000100:00080000:1.0:1788986775.555603:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986775.555620:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993616512:0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555650:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993616640:0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555673:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986775.555717:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986775.555722:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993616768:0@lo:400:kworker.0 00000100:00100000:2.0:1788986775.555746:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993616640 00000100:00100000:2.0:1788986775.555752:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993616640 00000100:00100000:1.0:1788986775.555758:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986775.555790:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1788986775.555790:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993616768 00000100:00100000:1.0:1788986775.555796:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993616768 00000100:00100000:2.0:1788986775.555800:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993616640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555828:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1826 00000100:00100000:1.0:1788986775.555836:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993616768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986775.555857:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943858700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993616640:12345-0@lo:400:kworker.0 Request processed in 58us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986775.555865:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1377 00000100:00100000:1.0:1788986775.555872:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993616768:12345-0@lo:400:kworker.0 Request processed in 36us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986775.555879:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1826 00000100:00080000:1.0:1788986775.555900:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986775.555916:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993616768:0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555924:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943859c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993616640:0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555965:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986775.555970:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993616896:0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.555992:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986775.556014:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993616896 00000100:00100000:1.0:1788986775.556017:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993616896 00000100:00100000:1.0:1788986775.556041:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1378 00000100:00100000:1.0:1788986775.556047:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993616896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986775.556079:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993616896:12345-0@lo:400:kworker.0 Request processed in 32us (86us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986775.556085:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1378 00000100:00080000:1.0:1788986775.556124:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986775.556139:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993616896:0@lo:400:kworker.0 00000020:00000080:1.0:1788986775.877801:0:96241:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd0522fdf0 20000000:00000080:1.0:1788986775.877819:0:96241:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a498c5c00 uarg=0000000000000000 00010000:00010000:1.0:1788986775.881783:0:96241:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788986775.881820:0:96241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:1.0:1788986775.881824:0:96241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986775.881834:0:96241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf549dbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1583 expref: 5 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986775.881858:0:96241:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 10000000:01000000:1.0:1788986775.881874:0:96241:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986775.881887:0:96241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986775.881900:0:96241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549da2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549d9b expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986775.881913:0:96241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986775.881945:0:96241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549da2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549d9b expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986775.881959:0:96241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549da2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549d9b expref: 18 pid: 5848 timeout: 2659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986775.881971:0:96241:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96241:1875885993617024:0@lo:104: 00000100:00100000:1.0:1788986775.882024:0:96241:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986775.882071:0:96241:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42bca840 going to sleep for 11 seconds 00000100:00100000:0.0:1788986775.883699:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993617024 00000100:00100000:0.0:1788986775.883709:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993617024 00000100:00100000:0.0:1788986775.883787:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:0.0:1788986775.883799:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:96241:x1875885993617024:12345-0@lo:104: 00010000:00010000:0.0:1788986775.883816:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986775.883918:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986775.883926:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:96241:x1875885993617024:12345-0@lo:104: Request processed in 129us (1900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986775.883935:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00010000:00010000:3.0:1788986775.884080:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986775.884123:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884133:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986775.884138:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884160:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986775.884168:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986775.884174:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986775.884207:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884214:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986775.884233:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884239:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549d9b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549da2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884254:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986775.884256:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986775.884257:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986775.884270:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993617152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986775.884306:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986775.884349:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993617152 00000100:00100000:3.0:1788986775.884353:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993617152 00010000:00010000:3.0:1788986775.884373:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549da2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549d9b expref: 19 pid: 5848 timeout: 2659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986775.884394:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1788986775.884401:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993617152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986775.884411:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986775.884416:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549da2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549d9b expref: 19 pid: 5848 timeout: 2659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884425:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549da2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549d9b expref: 19 pid: 5848 timeout: 2659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884440:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884449:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884464:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884471:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884479:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884485:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884490:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986775.884494:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884501:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884514:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986775.884523:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986775.884549:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993617152:12345-0@lo:103:ldlm_bl.0 Request processed in 149us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986775.884556:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 445 00000100:00100000:3.0:1788986775.884604:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993617152:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986775.884818:0:96241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf549da2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549d9b expref: 18 pid: 5848 timeout: 2659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986775.884832:0:96241:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96241:1875885993617024:0@lo:104: 00010000:00010000:1.0:1788986775.884849:0:96241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986775.884858:0:96241:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986775.884864:0:96241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986775.884870:0:96241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf549dc5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986776.069982:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986776.070025:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993617280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986776.070184:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986776.070682:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993617280 00000100:00100000:1.0:1788986776.070694:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993617280 00000100:00100000:1.0:1788986776.070969:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 927 00000100:00100000:1.0:1788986776.070982:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993617280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986776.071040:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986776.071288:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993617280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 309us (1110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986776.071297:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 927 00000100:00100000:1.0:1788986776.071573:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993617280:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986776.577438:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788986777.538224:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986777.538231:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986777.538236:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986777.538276:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986777.538288:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986777.538298:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986777.538322:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993617408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986777.538389:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986777.538434:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a765823c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986777.538600:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993617408 00000100:00100000:1.0:1788986777.538609:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993617408 00000100:00100000:1.0:1788986777.538669:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:1.0:1788986777.538679:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993617408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986777.538691:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986777.538704:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549dd3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549dcc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986777.538725:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549dd3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549dcc expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986777.538736:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549dd3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549dcc expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986777.538745:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788986777.538791:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993617408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986777.538798:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1788986777.538816:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe14700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993617408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986777.538831:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986777.538840:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986777.538856:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986777.538874:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986777.538882:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986777.600368:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986777.716083:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986777.716391:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971410304 00000100:00100000:0.0:1788986777.716401:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971410304 00000100:00100000:0.0:1788986777.716474:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 589 00000100:00100000:0.0:1788986777.716486:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971410304:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:0.0:1788986777.716515:0:8478:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf549c28 00000100:00080000:0.0:1788986777.716526:0:8478:0:(import.c:65:import_set_state_nolock()) ffff9b0a489e9800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788986777.716567:0:8478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967363 00000100:00100000:0.0:1788986777.716834:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971410304:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 350us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986777.716842:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 589 00000100:00080000:0.0:1788986777.716861:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788986777.716868:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986777.725237:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986777.725267:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986777.725299:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986777.725325:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971409920 00000100:00100000:0.0:1788986777.725334:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971409920 00000100:00100000:0.0:1788986777.725376:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1408 00000100:00100000:0.0:1788986777.725386:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971409920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986777.725445:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971409920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 60us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986777.725452:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1408 00000100:00100000:1.0:1788986777.725477:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971410176 00000100:00100000:0.0:1788986777.725479:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971410048 00000100:00100000:1.0:1788986777.725482:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971410176 00000100:00100000:0.0:1788986777.725482:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971410048 00000100:00100000:1.0:1788986777.725523:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1379 00000100:00100000:1.0:1788986777.725530:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971410176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986777.725559:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe17100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971410176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986777.725565:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1379 00000100:00080000:0.0:1788986777.731644:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986777.731653:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986777.731899:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1827 00000100:00100000:0.0:1788986777.731912:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971410048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986777.731976:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971410048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (6676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986777.731983:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1827 00000100:00100000:0.0:1788986778.422434:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986778.422529:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971410432 00000100:00100000:3.0:1788986778.422542:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971410432 00000100:00100000:3.0:1788986778.422616:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1079 00000100:00100000:3.0:1788986778.422629:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56257:x1875885971410432:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986778.422657:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986778.422687:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549dda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d158a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986778.422772:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549de1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986778.422788:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986778.422803:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986778.422848:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:3.0:1788986778.422852:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986778.422876:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549de1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986778.422905:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549dda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d158a expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986778.422932:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549de1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d158a expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986778.422941:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:3.0:1788986778.422944:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986778.422949:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2600, rc 0) 00000100:00100000:3.0:1788986778.423022:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56257:x1875885971410432:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 396us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986778.423030:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1079 00000100:00100000:2.0:1788986778.426144:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986778.426247:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971410688 00000100:00100000:3.0:1788986778.426258:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971410688 00000100:00100000:3.0:1788986778.426320:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1080 00000100:00100000:3.0:1788986778.426339:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56257:x1875885971410688:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986778.426389:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986778.426413:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549de1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d158a expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986778.426431:0:15241:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf549dbe) 00010000:00010000:3.0:1788986778.426436:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:3.0:1788986778.426453:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986778.426480:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549de8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986778.426494:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986778.426504:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986778.426854:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006bf2c797 reply state 0000000023a8e29d transno 4294967706 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986778.426865:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986778.426874:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000100:00100000:3.0:1788986778.426955:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56257:x1875885971410688:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 625us (870us total) trans 4294967706 rc 0/0 00000100:00100000:3.0:1788986778.426962:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1080 00010000:00010000:0.0:1788986778.436729:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549de8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986778.436751:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549de8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986778.436765:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549de8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986778.436773:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986778.436778:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549de8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986778.436787:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549de8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986778.436807:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:0.0:1788986778.436810:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788986778.436816:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549de8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986778.436823:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549de8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986778.634165:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788986778.683438:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788986778.683451:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b0a489ef000/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:0.0:1788986778.683558:0:94116:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a489ef000/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0001 00000020:00000080:0.0:1788986778.683734:0:94116:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a489e9800 for lustre-OST0001 00000020:00000080:0.0:1788986779.377783:0:96439:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe17c661f0 20000000:00000080:0.0:1788986779.377804:0:96439:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76061000 uarg=0000000000000000 00010000:00010000:0.0:1788986779.378059:0:96439:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986779.378074:0:96439:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986779.378247:0:96439:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986779.378271:0:96439:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986779.378292:0:96439:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549dd3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549dcc expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986779.378300:0:96439:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986779.378345:0:96439:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549dd3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549dcc expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986779.378361:0:96439:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549dd3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549dcc expref: 18 pid: 5846 timeout: 2663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986779.378377:0:96439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe14380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96439:1875885993617536:0@lo:104: 00000100:00100000:0.0:1788986779.378453:0:96439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986779.378511:0:96439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a45664540 going to sleep for 11 seconds 00000100:00100000:1.0:1788986779.379269:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993617536 00000100:00100000:1.0:1788986779.379281:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993617536 00000100:00100000:1.0:1788986779.379351:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 381 00000100:00100000:1.0:1788986779.379363:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:96439:x1875885993617536:12345-0@lo:104: 00010000:00010000:1.0:1788986779.379381:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986779.379465:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986779.379471:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:96439:x1875885993617536:12345-0@lo:104: Request processed in 111us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986779.379479:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 381 00010000:00010000:1.0:1788986779.379503:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986779.379510:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986779.379528:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986779.379534:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986779.379543:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986779.379555:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986779.379561:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986779.379598:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986779.379605:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986779.379627:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986779.379634:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf549dcc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549dd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986779.379651:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986779.379653:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986779.379655:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986779.379678:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993617664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986779.379719:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986779.379922:0:96439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe14380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:96439:1875885993617536:0@lo:104: 00010000:00010000:3.0:1788986779.379946:0:96439:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986779.379987:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993617664 00000100:00100000:3.0:1788986779.379991:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993617664 00010000:00010000:3.0:1788986779.380016:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549dd3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549dcc expref: 19 pid: 5846 timeout: 2663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986779.380051:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 446 00000100:00100000:3.0:1788986779.380059:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993617664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986779.380074:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986779.380080:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549dd3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549dcc expref: 19 pid: 5846 timeout: 2663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380134:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549dd3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549dcc expref: 19 pid: 5846 timeout: 2663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380151:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf549dd3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549dcc expref: 19 pid: 5846 timeout: 2663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380168:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380177:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380195:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380203:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380210:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380217:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380224:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986779.380228:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380241:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380254:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380264:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986779.380297:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993617664:12345-0@lo:103:ldlm_bl.0 Request processed in 239us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986779.380304:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 446 00010000:00010000:3.0:1788986779.380326:0:96439:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380334:0:96439:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986779.380341:0:96439:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef800/0xc20d828fcf549def lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 96439 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986779.381315:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993617664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986779.649641:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993617792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986779.649702:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788986779.649853:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986779.649867:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993617792 00000100:00100000:1.0:1788986779.649874:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993617792 00000100:00100000:1.0:1788986779.649972:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 928 00000100:00100000:1.0:1788986779.649982:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993617792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986779.650012:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986779.650071:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993617792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986779.650079:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 928 00000100:00080000:2.0:1788986779.653054:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986779.653492:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993617792:0@lo:13:osp-pre-0-0.0 00000001:00080000:2.0:1788986780.230454:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967706 is committed 00000100:00100000:3.0:1788986780.681569:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993617920:0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.681675:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986780.681729:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993618432:0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.681759:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986780.681796:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986780.681801:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993618304:0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.681826:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986780.681857:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993618048:0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.681882:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986780.681899:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993618560:0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.681920:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986780.681938:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986780.681944:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993618176:0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.681966:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986780.681999:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993617920 00000100:00100000:3.0:1788986780.682007:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993617920 00000100:00100000:3.0:1788986780.682054:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1788986780.682063:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993617920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.682148:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993617920:12345-0@lo:400:kworker.0 Request processed in 85us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986780.682156:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1409 00000100:00100000:3.0:1788986780.682193:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993618304 00000100:00100000:3.0:1788986780.682197:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993618304 00000100:00100000:3.0:1788986780.682235:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993618560 00000100:00100000:3.0:1788986780.682238:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993618560 00000100:00100000:3.0:1788986780.682271:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1788986780.682278:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993618304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.682311:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993618304:12345-0@lo:400:kworker.0 Request processed in 34us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986780.682317:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1380 00000100:00100000:3.0:1788986780.682327:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1788986780.682333:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993618560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.682359:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993618560:12345-0@lo:400:kworker.0 Request processed in 27us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986780.682368:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1381 00000100:00100000:3.0:1788986780.682384:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993618432 00000100:00100000:3.0:1788986780.682388:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993618432 00000100:00100000:3.0:1788986780.682415:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993618048 00000100:00100000:3.0:1788986780.682418:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993618048 00000100:00100000:3.0:1788986780.682435:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993618176 00000100:00100000:3.0:1788986780.682438:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993618176 00000100:00100000:3.0:1788986780.682452:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1828 00000100:00100000:3.0:1788986780.682458:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993618432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.682488:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993618432:12345-0@lo:400:kworker.0 Request processed in 30us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986780.682494:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1828 00000100:00100000:3.0:1788986780.682507:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1829 00000100:00100000:3.0:1788986780.682512:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993618048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.682538:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993618048:12345-0@lo:400:kworker.0 Request processed in 26us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986780.682543:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1829 00000100:00100000:3.0:1788986780.682554:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1830 00000100:00100000:3.0:1788986780.682560:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993618176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.682585:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993618176:12345-0@lo:400:kworker.0 Request processed in 25us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986780.682590:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1830 00000100:00080000:3.0:1788986780.682620:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986780.682626:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788986780.682678:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986780.682709:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993618176:0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.682722:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993618048:0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.682730:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993618560:0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.682760:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993618304:0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.682768:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993617920:0@lo:400:kworker.0 00000100:00100000:3.0:1788986780.682776:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993618432:0@lo:400:kworker.0 10000000:01000000:1.0:1788986780.736157:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986780.736168:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986780.736174:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986780.736233:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986780.736246:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986780.736261:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986780.736292:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993618688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986780.736381:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986780.736441:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5a96c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788986780.739416:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993618688 00000100:00100000:2.0:1788986780.739437:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993618688 00000100:00100000:2.0:1788986780.739507:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1410 00000100:00100000:2.0:1788986780.739519:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993618688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986780.739540:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986780.739565:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf549dfd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549df6 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986780.739600:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf549dfd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549df6 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986780.739623:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf549dfd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549df6 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986780.739634:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0200, rc 0) 00000100:00100000:2.0:1788986780.739743:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993618688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 226us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986780.739751:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1410 00000100:00100000:0.0:1788986780.741885:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993618688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986780.741931:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986780.741945:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986780.741974:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986780.741980:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986780.741988:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986781.186072:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993618816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986781.186187:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986781.186290:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993618816 00000100:00100000:2.0:1788986781.186299:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993618816 00000100:00100000:2.0:1788986781.186369:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 929 00000100:00100000:2.0:1788986781.186380:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993618816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986781.186427:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986781.186483:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993618816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986781.186491:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 929 00000100:00100000:2.0:1788986781.189759:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993618816:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986781.699765:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986782.509063:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986782.509163:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971410816 00000100:00100000:3.0:1788986782.509173:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971410816 00000100:00080000:2.0:1788986782.509287:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986782.509677:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1081 00000100:00100000:3.0:1788986782.509689:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56341:x1875885971410816:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986782.509796:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56341:x1875885971410816:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 109us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986782.509803:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1081 00000100:00100000:1.0:1788986782.516968:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986782.517652:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971410944 00000100:00100000:3.0:1788986782.517662:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971410944 00000100:00100000:3.0:1788986782.517727:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 590 00000100:00100000:3.0:1788986782.517737:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56341:x1875885971410944:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986782.518062:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56341:x1875885971410944:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 325us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986782.518070:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 590 00000100:00080000:1.0:1788986782.518250:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986782.526009:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986782.526130:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971411072 00000100:00100000:3.0:1788986782.526139:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971411072 00000100:00100000:3.0:1788986782.526181:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 591 00000100:00100000:3.0:1788986782.526190:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2345:x1875885971411072:12345-192.168.206.21@tcp:8:lfs.60003 00010000:00080000:3.0:1788986782.526221:0:6698:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 2566 last 0 00000020:00000080:3.0:1788986782.526248:0:6698:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf549e04 00002000:00100000:3.0:1788986782.526260:0:6698:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b0a7f56b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788986782.526270:0:6698:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788986782.526488:0:6698:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788986782.526514:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f56c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788986782.526682:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971411072:12345-192.168.206.21@tcp:8:lfs.60003 Request processed in 491us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986782.526690:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 591 00000100:00100000:2.0:1788986782.530476:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986782.530666:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971411200 00000100:00100000:3.0:1788986782.530677:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971411200 00000100:00100000:3.0:1788986782.530751:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 592 00000100:00100000:3.0:1788986782.530761:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56341:x1875885971411200:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986782.531136:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56341:x1875885971411200:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 376us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986782.531144:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 592 00000100:00080000:2.0:1788986782.531219:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986782.541184:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986782.541313:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971411328 00000100:00100000:3.0:1788986782.541323:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971411328 00000100:00100000:3.0:1788986782.541383:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1082 00000100:00100000:3.0:1788986782.541393:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56341:x1875885971411328:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986782.541817:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56341:x1875885971411328:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 424us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986782.541826:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1082 00000100:00100000:2.0:1788986782.551664:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986782.551784:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971411456 00000100:00100000:3.0:1788986782.551793:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971411456 00000100:00100000:3.0:1788986782.551847:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1083 00000100:00100000:3.0:1788986782.551856:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56341:x1875885971411456:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986782.551953:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56341:x1875885971411456:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 98us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986782.551960:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1083 00000100:00100000:2.0:1788986782.554570:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986782.554660:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971411584 00000100:00100000:0.0:1788986782.554669:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971411584 00000100:00100000:0.0:1788986782.554719:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 593 00000100:00100000:0.0:1788986782.554730:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56341:x1875885971411584:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986782.555119:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56341:x1875885971411584:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 357us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986782.555127:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 593 00000100:00100000:0.0:1788986782.557223:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986782.557292:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971411712 00000100:00100000:3.0:1788986782.557301:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971411712 00000100:00100000:3.0:1788986782.557356:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 594 00000100:00100000:3.0:1788986782.557367:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56341:x1875885971411712:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986782.557750:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56341:x1875885971411712:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 383us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986782.557758:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 594 00000100:00100000:0.0:1788986782.576860:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986782.580269:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971411840 00000100:00100000:3.0:1788986782.580284:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971411840 00000100:00100000:2.0:1788986782.584317:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1084 00000100:00100000:2.0:1788986782.584330:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56341:x1875885971411840:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986782.586377:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56341:x1875885971411840:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 2039us (9518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986782.586391:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1084 00000100:00100000:2.0:1788986782.656918:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986782.657017:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971411968 00000100:00100000:1.0:1788986782.657028:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971411968 00000100:00100000:1.0:1788986782.657125:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1085 00000100:00100000:1.0:1788986782.657137:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56345:x1875885971411968:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:1.0:1788986782.657158:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986782.657181:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549e0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1591 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657246:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549e12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657259:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549e12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657271:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549e12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657291:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549e19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657298:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657304:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657595:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549e20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657605:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657612:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986782.657633:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:1.0:1788986782.657637:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986782.657656:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549e20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657672:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549e12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657678:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549e12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657684:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549e12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657689:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986782.657693:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549e12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657700:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549e12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657712:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788986782.657715:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986782.657719:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549e12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657725:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf549e12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657738:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549e19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657744:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549e19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657750:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549e19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657756:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986782.657758:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549e19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657764:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549e19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657772:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a45316900) 00010000:00010000:1.0:1788986782.657774:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986782.657777:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549e19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657783:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf549e19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657812:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf549e0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1591 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657827:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549e20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1591 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.657834:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:1.0:1788986782.657836:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986782.657839:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00100000:1.0:1788986782.657885:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56345:x1875885971411968:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 750us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986782.657892:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1085 00000100:00100000:2.0:1788986782.662141:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986782.662253:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971412224 00000100:00100000:1.0:1788986782.662262:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971412224 00000100:00100000:1.0:1788986782.662349:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1086 00000100:00100000:1.0:1788986782.662358:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56345:x1875885971412224:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:1.0:1788986782.662376:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986782.662393:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549e27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1598 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.662643:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549e2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.662657:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549e2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.662668:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549e2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.662681:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549e35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.662688:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.662695:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788986782.663381:0:5856:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1788986782.663620:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf549e3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.663631:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf549e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.663643:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf549e3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.663676:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549e2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.663683:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549e2e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.663689:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549e2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.663695:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986782.663699:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549e2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.663707:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549e2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.663718:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:1.0:1788986782.663720:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986782.663724:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549e2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.663730:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf549e2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986782.663743:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000048f04ab9 reply state 00000000d8782839 transno 4294967707 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986782.663751:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986782.663779:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf549e27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1598 expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.663795:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf549e3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1598 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986782.663802:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:1.0:1788986782.663804:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986782.663806:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d49a00, rc 0) 00000100:00100000:1.0:1788986782.663867:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:56345:x1875885971412224:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 1510us (1777us total) trans 4294967707 rc 0/0 00000100:00100000:1.0:1788986782.663874:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1086 00000100:00100000:0.0:1788986782.670556:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:3.0:1788986782.670741:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549e35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986782.670753:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549e35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986782.670761:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549e35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986782.670766:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986782.670770:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549e35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986782.670776:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549e35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986782.670789:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a45316800) 00010000:00010000:3.0:1788986782.670792:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986782.670797:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549e35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986782.670803:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf549e35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986782.670914:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971412352 00000100:00100000:3.0:1788986782.670921:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971412352 00000100:00100000:3.0:1788986782.670974:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 595 00000100:00100000:3.0:1788986782.670984:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56345:x1875885971412352:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:3.0:1788986782.670999:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986782.671015:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf549e4a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d159f expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788986782.671038:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788986782.671057:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=2566s v=(0 0) 00010000:00010000:3.0:1788986782.671062:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986782.671070:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf549e4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d159f expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986782.671301:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf549e4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d159f expref: 7 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986782.671316:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:0.0:1788986782.671473:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56345:x1875885971412352:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 488us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986782.671481:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 595 00000100:00100000:2.0:1788986782.704384:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986782.707444:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971412480 00000100:00100000:3.0:1788986782.707458:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971412480 00002000:00100000:3.0:1788986782.707536:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->1048575) req@ffff9b0a7fe82300 x1875885971412480/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:703/0 lens 488/0 e 0 to 0 dl 1788986793 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:3.0:1788986782.707547:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a7fe82300 with x1875885971412480 ext(0->1048575) 00002000:00010000:3.0:1788986782.707553:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a7fe82300 00000100:00100000:3.0:1788986782.707579:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 27 00000100:00100000:3.0:1788986782.707588:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971412480:12345-192.168.206.21@tcp:4:dd.60003 00010000:00010000:3.0:1788986782.720758:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788986782.758268:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:2.0:1788986782.770433:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971412480:12345-192.168.206.21@tcp:4:dd.60003 Request processed in 62829us (66047us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788986782.770451:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 27 00002000:00100000:2.0:1788986782.770468:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x22:0x0] (0->1048575) req@ffff9b0a7fe82300 x1875885971412480/t4294967364(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:703/0 lens 488/448 e 0 to 0 dl 1788986793 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1788986782.770480:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a7fe82300 with x1875885971412480 ext(0->1048575) 00002000:00010000:2.0:1788986782.770488:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a7fe82300 00000100:00100000:0.0:1788986782.774472:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986782.774579:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971412608 00000100:00100000:2.0:1788986782.774592:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971412608 00000100:00100000:2.0:1788986782.774664:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1087 00000100:00100000:2.0:1788986782.774677:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:56345:x1875885971412608:12345-192.168.206.21@tcp:44:dd.60003 00000001:00080000:0.0:1788986782.806713:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967707 is committed 00000100:00100000:2.0:1788986782.807307:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56345:x1875885971412608:12345-192.168.206.21@tcp:44:dd.60003 Request processed in 32624us (32841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986782.807322:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1087 00000100:00100000:0.0:1788986782.809354:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986782.809483:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971412736 00000100:00100000:2.0:1788986782.809495:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971412736 00000100:00100000:2.0:1788986782.809564:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 596 00000100:00100000:2.0:1788986782.809638:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971412736:12345-192.168.206.21@tcp:16:dd.60003 00000100:00100000:0.0:1788986782.834389:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986782.834475:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986782.834560:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971412864 00000100:00100000:3.0:1788986782.834570:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971412864 00000100:00100000:3.0:1788986782.834621:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1411 00000100:00100000:3.0:1788986782.834631:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971412864:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986782.834697:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971412864:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986782.834705:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1411 00000100:00100000:2.0:1788986782.835386:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971412992 00000100:00100000:2.0:1788986782.835392:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971412992 00000100:00100000:2.0:1788986782.835440:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1382 00000100:00100000:2.0:1788986782.835451:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971412992:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986782.835504:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971412992:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 56us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986782.835512:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1382 00000001:00080000:0.0:1788986782.856563:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967364 is committed 00000100:00100000:2.0:1788986782.856922:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971412736:12345-192.168.206.21@tcp:16:dd.60003 Request processed in 47342us (47575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986782.856934:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 596 00000100:00100000:3.0:1788986782.858732:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986782.859162:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971413248 00000100:00100000:1.0:1788986782.859170:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971413248 00000100:00100000:1.0:1788986782.859224:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 107 00000100:00100000:1.0:1788986782.859234:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56345:x1875885971413248:12345-192.168.206.21@tcp:35:dd.60003 00000100:00100000:1.0:1788986782.859650:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:56345:x1875885971413248:12345-192.168.206.21@tcp:35:dd.60003 Request processed in 416us (922us total) trans 4294967708 rc 0/0 00000100:00100000:1.0:1788986782.859658:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 107 00010000:00010000:1.0:1788986783.748031:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986784.097339:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967708 is committed 00000100:00100000:0.0:1788986784.768364:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986784.768386:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993618944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986784.768451:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986784.768648:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993618944 00000100:00100000:2.0:1788986784.768656:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993618944 00000100:00100000:2.0:1788986784.768722:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 930 00000100:00100000:2.0:1788986784.768733:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993618944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986784.768763:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986784.768816:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80b43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993618944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986784.768823:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 930 00000100:00100000:2.0:1788986784.768875:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993618944:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986784.769082:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986784.769205:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986785.693076:0:96686:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2569595984379ns, next at 2549719305474ns, rc = 0 00000004:00080000:3.0:1788986785.693341:0:96686:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2569596251342ns, next at 2525127121379ns, rc = 0 00000004:00080000:0.0:1788986785.697991:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 94 committed 00000004:00080000:0.0:1788986785.698016:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 93 committed 00010000:00010000:3.0:1788986785.797292:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986785.797566:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993619456:0@lo:400:kworker.0 00000100:00100000:0.0:1788986785.797626:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986785.797711:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788986785.797718:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993619072:0@lo:400:kworker.0 00000100:00100000:0.0:1788986785.797746:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986785.797767:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993619584:0@lo:400:kworker.0 00000100:00100000:0.0:1788986785.797805:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986785.797832:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993619456 00000100:00100000:0.0:1788986785.797839:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993619456 00000100:00100000:0.0:1788986785.797884:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1788986785.797892:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993619456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986785.797935:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993619456:12345-0@lo:400:kworker.0 Request processed in 43us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986785.797942:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1383 00000100:00100000:0.0:1788986785.797975:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993619072 00000100:00100000:0.0:1788986785.797979:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993619072 00000100:00100000:0.0:1788986785.798001:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:0.0:1788986785.798007:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993619072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986785.798034:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993619072:12345-0@lo:400:kworker.0 Request processed in 27us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986785.798039:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:0.0:1788986785.798061:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993619584 00000100:00100000:0.0:1788986785.798065:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993619584 00000100:00100000:0.0:1788986785.798124:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1831 00000100:00100000:0.0:1788986785.798131:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993619584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986785.798160:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993619584:12345-0@lo:400:kworker.0 Request processed in 29us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986785.798166:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1831 00000100:00100000:0.0:1788986785.798195:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993619072:0@lo:400:kworker.0 00000100:00100000:0.0:1788986785.798206:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993619584:0@lo:400:kworker.0 00000100:00100000:0.0:1788986785.798215:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993619456:0@lo:400:kworker.0 00000100:00080000:0.0:1788986785.798236:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986785.798396:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993619200:0@lo:400:kworker.0 00000100:00100000:2.0:1788986785.798424:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986785.798455:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993619712:0@lo:400:kworker.0 00000100:00100000:2.0:1788986785.798475:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986785.798492:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986785.798498:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993619328:0@lo:400:kworker.0 00000100:00100000:2.0:1788986785.798517:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986785.798544:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993619712 00000100:00100000:2.0:1788986785.798548:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993619712 00000100:00100000:2.0:1788986785.798578:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1384 00000100:00100000:2.0:1788986785.798584:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993619712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986785.798615:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993619712:12345-0@lo:400:kworker.0 Request processed in 32us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986785.798622:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1384 00000100:00100000:2.0:1788986785.798638:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993619200 00000100:00100000:2.0:1788986785.798642:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993619200 00000100:00100000:2.0:1788986785.798658:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993619328 00000100:00100000:2.0:1788986785.798661:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993619328 00000100:00100000:2.0:1788986785.798677:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1832 00000100:00100000:2.0:1788986785.798682:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993619200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986785.798710:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993619200:12345-0@lo:400:kworker.0 Request processed in 27us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986785.798715:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1832 00000100:00100000:2.0:1788986785.798725:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1833 00000100:00100000:2.0:1788986785.798731:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993619328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986785.798753:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993619328:12345-0@lo:400:kworker.0 Request processed in 23us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986785.798759:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1833 00000100:00080000:2.0:1788986785.798770:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986785.798773:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986785.798791:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993619328:0@lo:400:kworker.0 00000100:00100000:2.0:1788986785.798802:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993619200:0@lo:400:kworker.0 00000100:00100000:2.0:1788986785.798810:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993619712:0@lo:400:kworker.0 00000100:00100000:0.0:1788986786.304471:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993619840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986786.304547:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986786.304760:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993619840 00000100:00100000:2.0:1788986786.304768:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993619840 00000100:00100000:2.0:1788986786.304816:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 931 00000100:00100000:2.0:1788986786.304824:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993619840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986786.304854:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:2.0:1788986786.304928:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993619840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986786.304935:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 931 00000100:00100000:1.0:1788986786.305015:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993619840:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986786.816230:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986787.594601:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986787.597368:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971413376 00000100:00100000:3.0:1788986787.597381:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971413376 00000100:00100000:3.0:1788986787.598449:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1088 00000100:00100000:3.0:1788986787.598459:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56538:x1875885971413376:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986787.598554:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56538:x1875885971413376:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 96us (3960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986787.598562:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1088 00000100:00080000:0.0:1788986787.604916:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986787.612445:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986787.612539:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971413504 00000100:00100000:3.0:1788986787.612549:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971413504 00000100:00100000:3.0:1788986787.612615:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 597 00000100:00100000:3.0:1788986787.612625:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56538:x1875885971413504:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986787.612931:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56538:x1875885971413504:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 307us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986787.612940:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 597 00000100:00080000:1.0:1788986787.612995:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986787.621349:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986787.624126:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971413632 00000100:00100000:3.0:1788986787.624138:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971413632 00000100:00100000:3.0:1788986787.624205:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 598 00000100:00100000:3.0:1788986787.624216:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56538:x1875885971413632:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986787.624544:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56538:x1875885971413632:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 329us (3202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986787.624552:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 598 00000100:00080000:2.0:1788986787.625470:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986787.640703:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986787.640818:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971413760 00000100:00100000:2.0:1788986787.640827:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971413760 00000100:00100000:2.0:1788986787.640884:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1089 00000100:00100000:2.0:1788986787.640893:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56538:x1875885971413760:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986787.641255:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943859c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56538:x1875885971413760:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 362us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986787.641263:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1089 00000100:00100000:2.0:1788986787.646684:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986787.647129:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971413888 00000100:00100000:3.0:1788986787.647138:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971413888 00000100:00100000:3.0:1788986787.647190:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1090 00000100:00100000:3.0:1788986787.647200:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56538:x1875885971413888:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986787.647286:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56538:x1875885971413888:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 88us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986787.647294:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1090 00000100:00100000:2.0:1788986787.649649:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986787.649784:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971414016 00000100:00100000:3.0:1788986787.649790:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971414016 00000100:00100000:3.0:1788986787.649836:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 599 00000100:00100000:3.0:1788986787.649846:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56538:x1875885971414016:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986787.650191:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56538:x1875885971414016:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 345us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986787.650199:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 599 00000100:00100000:2.0:1788986787.653315:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986787.653423:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971414144 00000100:00100000:3.0:1788986787.653431:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971414144 00000100:00100000:3.0:1788986787.653480:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 600 00000100:00100000:3.0:1788986787.653490:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56538:x1875885971414144:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986787.653976:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56538:x1875885971414144:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 485us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986787.653984:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 600 00000100:00100000:0.0:1788986787.692859:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986787.692895:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971414272 00000100:00100000:0.0:1788986787.692902:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971414272 00000100:00100000:0.0:1788986787.692959:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1091 00000100:00100000:0.0:1788986787.692969:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56538:x1875885971414272:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986787.693382:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56538:x1875885971414272:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 414us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986787.693391:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1091 00000100:00100000:2.0:1788986787.803430:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986787.803528:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971414528 00000100:00100000:1.0:1788986787.803556:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971414528 00000100:00100000:1.0:1788986787.803610:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1092 00000100:00100000:1.0:1788986787.803619:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56542:x1875885971414528:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:1.0:1788986787.803668:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986787.803734:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf549e3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x59:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1598 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.803754:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:1.0:1788986787.803763:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986787.803783:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549e51 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.803795:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549e51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.803805:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549e51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.803818:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.803825:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.803832:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.804165:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf549e5f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.804176:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf549e5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.804189:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf549e5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986787.804914:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].34, 64 off10368 00000004:00080000:1.0:1788986787.804923:0:7899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2571707833489ns, next at 2572707831532ns, rc = 0 00010000:00010000:1.0:1788986787.805006:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e66 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805018:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805026:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e66 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805034:0:7899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e66 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805041:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e66 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805048:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805065:0:7899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986787.805118:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf549e5f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805126:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf549e5f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805133:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf549e5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805140:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d49200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986787.805145:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf549e5f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805153:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf549e5f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805163:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff9b0a45316400) 00010000:00010000:1.0:1788986787.805166:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986787.805171:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf549e5f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805178:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf549e5f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x59:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805192:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549e51 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805198:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549e51 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805205:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549e51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805209:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986787.805212:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549e51 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805218:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549e51 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805230:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:1.0:1788986787.805232:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986787.805235:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549e51 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986787.805242:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549e51 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x54:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986787.805251:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b8865127 reply state 00000000c9781608 transno 4294967709 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986787.805259:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986787.805322:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:56542:x1875885971414528:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 1702us (1898us total) trans 4294967709 rc 0/0 00000100:00100000:1.0:1788986787.805330:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1092 00010000:00010000:0.0:1788986787.805521:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986787.805527:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986787.805534:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d49800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986787.805536:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e66 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986787.805553:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e66 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986787.805562:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x59:0x0].0x0 (ffff9b0a45316400) 00010000:00010000:0.0:1788986787.805564:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788986787.805567:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e66 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986787.805572:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e66 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x59:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986787.805584:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986787.805586:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986787.805587:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986787.811933:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986787.811948:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e58 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986787.811956:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986787.811962:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986787.811967:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986787.811975:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e58 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986787.811990:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0xecba81fd (ffff9b0a45316900) 00010000:00010000:3.0:1788986787.811994:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986787.811998:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e58 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986787.812006:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x54:0x0].0xecba81fd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986787.840517:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986787.958537:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986787.958629:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971414656 00000100:00100000:0.0:1788986787.958639:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971414656 00000100:00100000:0.0:1788986787.958689:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1413 00000100:00100000:0.0:1788986787.958700:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971414656:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986787.958774:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971414656:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 75us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986787.958781:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1413 00010000:00010000:0.0:1788986788.866504:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986789.888371:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993619968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986789.888435:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788986789.888520:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986789.888691:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993619968 00000100:00100000:2.0:1788986789.888700:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993619968 00000100:00100000:2.0:1788986789.888764:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 932 00000100:00100000:2.0:1788986789.888773:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993619968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986789.888804:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986789.888851:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942cc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993619968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986789.888858:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 932 00000100:00080000:1.0:1788986789.888916:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986789.889124:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993619968:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788986789.921078:0:96831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2573823985536ns, next at 2549719305474ns, rc = 0 00000004:00080000:1.0:1788986789.921413:0:96831:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2573824323022ns, next at 2572707831532ns, rc = 0 00000004:00080000:1.0:1788986789.947838:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 96 committed 00000004:00080000:1.0:1788986789.947891:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 94 committed 00000001:00080000:1.0:1788986789.947913:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967709 is committed 00000004:00080000:1.0:1788986789.947918:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 95 committed 00000100:00100000:3.0:1788986789.948139:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993620096:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788986789.948201:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986789.948415:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993620096 00000100:00100000:0.0:1788986789.948422:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993620096 00000100:00100000:0.0:1788986789.948473:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1788986789.948482:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993620096:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788986789.948506:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:34 count 1 00010000:00010000:0.0:1788986789.948528:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986789.948569:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf549e4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d159f expref: 5 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986789.948579:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1788986789.948584:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986789.948589:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986789.948615:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf549e4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d159f expref: 5 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986789.948629:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf549e4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d159f expref: 5 pid: 6697 timeout: 2673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986789.948641:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993620224:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986789.948696:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7feff840 going to sleep for 11 seconds 00000100:00080000:1.0:1788986789.949489:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986789.958255:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986789.958355:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971414784 00000100:00100000:1.0:1788986789.958364:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971414784 00010000:00010000:1.0:1788986789.958419:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf549e4a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d159f expref: 6 pid: 6697 timeout: 2673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986789.958458:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 447 00000100:00100000:1.0:1788986789.958468:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971414784:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986789.958481:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986789.958487:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf549e4a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d159f expref: 6 pid: 6697 timeout: 2673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986789.958499:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf549e4a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d159f expref: 6 pid: 6697 timeout: 2673 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986789.958521:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986789.958525:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986789.958532:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986789.958541:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986789.958567:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986789.958610:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971414784:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 143us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986789.958618:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 447 00000100:00080000:0.0:1788986789.958881:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788986789.959078:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d6dd58b/0xc20d828fcf549e4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d159f expref: 5 pid: 6697 timeout: 2673 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986789.959109:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993620224:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788986789.959126:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986789.959135:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986789.959141:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986789.959155:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986789.959162:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986789.959175:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788986789.959409:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986789.959416:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986789.959424:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986789.959429:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986789.959438:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986789.959452:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986789.959463:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082e40c83/0xc20d828fcf549e6d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986789.959481:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986789.959482:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986789.959484:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986789.961424:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993620096:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12920us (13199us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788986789.961454:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000004:00080000:0.0:1788986789.962229:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a797e1500/2, rc 0, transno 4294967365 00000100:00100000:0.0:1788986789.962257:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993620096:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788986790.912731:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993620608:0@lo:400:kworker.0 00000100:00100000:0.0:1788986790.912796:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986790.912902:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993620352:0@lo:400:kworker.0 00000100:00100000:3.0:1788986790.912949:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986790.912979:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986790.912986:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993620480:0@lo:400:kworker.0 00000100:00100000:3.0:1788986790.913009:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788986790.913069:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986790.913111:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993620608 00000100:00100000:3.0:1788986790.913118:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993620608 00000100:00100000:3.0:1788986790.913164:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993620480 00000100:00100000:3.0:1788986790.913168:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993620480 00000100:00100000:3.0:1788986790.913191:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1834 00000100:00100000:3.0:1788986790.913199:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993620608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986790.914673:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993620736:0@lo:400:kworker.0 00000100:00100000:1.0:1788986790.914746:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986790.920315:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1835 00000100:00100000:1.0:1788986790.920341:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993620480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986790.920451:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993620480:12345-0@lo:400:kworker.0 Request processed in 122us (7440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986790.920462:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1835 00000100:00100000:1.0:1788986790.920494:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993620352 00000100:00100000:1.0:1788986790.920501:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993620352 00000100:00100000:1.0:1788986790.920549:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1788986790.920557:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993620352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986790.920589:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993620352:12345-0@lo:400:kworker.0 Request processed in 34us (7640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986790.920595:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1788986790.920647:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993620480:0@lo:400:kworker.0 00000100:00100000:1.0:1788986790.920658:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993620352:0@lo:400:kworker.0 00000100:00100000:3.0:1788986790.921157:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993620608:12345-0@lo:400:kworker.0 Request processed in 7956us (8358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986790.921165:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1834 00000100:00100000:3.0:1788986790.921209:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993620736 00000100:00100000:3.0:1788986790.921214:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993620736 00000100:00100000:3.0:1788986790.921258:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1385 00000100:00100000:3.0:1788986790.921265:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993620736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986790.921304:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993620736:12345-0@lo:400:kworker.0 Request processed in 40us (6558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986790.921309:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1385 00000100:00080000:3.0:1788986790.921335:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986790.921469:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993620736:0@lo:400:kworker.0 00000100:00100000:0.0:1788986790.922657:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993620608:0@lo:400:kworker.0 00000100:00100000:3.0:1788986790.933240:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986790.933261:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993620864:0@lo:400:kworker.0 00000100:00100000:3.0:1788986790.933325:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986790.933370:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993620864 00000100:00100000:3.0:1788986790.933377:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993620864 00000100:00100000:3.0:1788986790.933433:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1836 00000100:00100000:3.0:1788986790.933442:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993620864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986790.933491:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993620864:12345-0@lo:400:kworker.0 Request processed in 50us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986790.933498:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1836 00000100:00080000:3.0:1788986790.933521:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986790.933554:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993620864:0@lo:400:kworker.0 00000100:00100000:3.0:1788986790.933592:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a46e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993620992:0@lo:400:kworker.0 00000100:00100000:3.0:1788986790.933621:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986790.933651:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993620992 00000100:00100000:3.0:1788986790.933655:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993620992 00000100:00100000:3.0:1788986790.933679:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1386 00000100:00100000:3.0:1788986790.933686:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993620992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986790.933723:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993620992:12345-0@lo:400:kworker.0 Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986790.933729:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1386 00000100:00100000:3.0:1788986790.933755:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a46e1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993620992:0@lo:400:kworker.0 00000100:00100000:0.0:1788986791.424443:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993621120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986791.424512:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986791.425353:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993621120 00000100:00100000:3.0:1788986791.425361:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993621120 00000100:00100000:3.0:1788986791.425495:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 933 00000100:00100000:3.0:1788986791.425505:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993621120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986791.425544:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788986791.425603:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993621120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986791.425609:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 933 00000100:00100000:2.0:1788986791.425788:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993621120:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788986791.426138:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788986791.939952:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986792.514750:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967365 is committed 00010000:00010000:3.0:1788986792.960561:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986793.074568:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986793.078184:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971414912 00000100:00100000:3.0:1788986793.078198:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971414912 00000100:00100000:3.0:1788986793.078329:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1415 00000100:00100000:3.0:1788986793.078340:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971414912:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986793.078425:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971414912:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 86us (3867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986793.078432:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1415 00000100:00100000:2.0:1788986793.078756:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986793.078865:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986793.078887:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986793.078907:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971415168 00000100:00100000:2.0:1788986793.078911:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971415168 00000100:00100000:2.0:1788986793.078946:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971415296 00000100:00100000:2.0:1788986793.078949:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971415296 00000100:00100000:2.0:1788986793.078971:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1387 00000100:00100000:2.0:1788986793.078979:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971415168:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986793.079016:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971415168:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 38us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986793.079023:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1387 00000100:00100000:2.0:1788986793.079037:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1388 00000100:00100000:2.0:1788986793.079043:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971415296:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986793.079080:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971415296:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986793.079108:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1388 00000100:00100000:2.0:1788986793.079137:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971415040 00000100:00100000:2.0:1788986793.079142:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971415040 00000100:00100000:2.0:1788986793.079178:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1837 00000100:00100000:2.0:1788986793.079185:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971415040:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986793.079216:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971415040:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986793.079222:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1837 00000100:00080000:2.0:1788986793.079244:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986793.079248:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986793.079250:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986793.987620:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986795.009399:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986795.011465:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986795.011495:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993621248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986795.011868:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986795.012280:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993621248 00000100:00100000:3.0:1788986795.012292:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993621248 00000100:00100000:3.0:1788986795.012376:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 934 00000100:00100000:3.0:1788986795.012388:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993621248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986795.013145:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986795.013249:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993621248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 862us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986795.013261:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 934 00000100:00080000:3.0:1788986795.013299:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986795.013374:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993621248:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986796.034000:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986796.036053:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993621632:0@lo:400:kworker.0 00000100:00100000:2.0:1788986796.036140:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986796.036219:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986796.036226:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993621760:0@lo:400:kworker.0 00000100:00100000:2.0:1788986796.036253:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986796.036284:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993621760 00000100:00100000:2.0:1788986796.036291:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993621760 00000100:00100000:2.0:1788986796.036338:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1389 00000100:00100000:2.0:1788986796.036347:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993621760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986796.036392:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993621760:12345-0@lo:400:kworker.0 Request processed in 47us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986796.036398:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1389 00000100:00100000:2.0:1788986796.036442:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993621760:0@lo:400:kworker.0 00000100:00100000:0.0:1788986796.036460:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993621632 00000100:00100000:0.0:1788986796.036465:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993621632 00000100:00080000:2.0:1788986796.036489:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986796.036498:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1838 00000100:00100000:1.0:1788986796.036557:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993621376:0@lo:400:kworker.0 00000100:00100000:1.0:1788986796.036592:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986796.036624:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993621888:0@lo:400:kworker.0 00000100:00100000:0.0:1788986796.036633:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993621632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986796.036646:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986796.036662:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788986796.036667:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993621504:0@lo:400:kworker.0 00000100:00100000:0.0:1788986796.036667:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993621632:12345-0@lo:400:kworker.0 Request processed in 37us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986796.036688:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986796.036702:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993622016:0@lo:400:kworker.0 00000100:00100000:1.0:1788986796.036720:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986796.036750:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1838 00000100:00100000:0.0:1788986796.036762:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993621888 00000100:00100000:0.0:1788986796.036766:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993621888 00000100:00100000:0.0:1788986796.036803:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993621504 00000100:00100000:0.0:1788986796.036806:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993621504 00000100:00100000:3.0:1788986796.036899:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1839 00000100:00100000:3.0:1788986796.036908:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993621888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986796.036942:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993621888:12345-0@lo:400:kworker.0 Request processed in 37us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986796.036948:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1839 00000100:00100000:3.0:1788986796.036960:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1840 00000100:00100000:3.0:1788986796.036965:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993621504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986796.036987:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993621504:12345-0@lo:400:kworker.0 Request processed in 23us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986796.036993:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1840 00000100:00100000:3.0:1788986796.037049:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993621632:0@lo:400:kworker.0 00000100:00100000:3.0:1788986796.037078:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993622016 00000100:00100000:3.0:1788986796.037081:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993622016 00000100:00100000:3.0:1788986796.037130:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1390 00000100:00080000:1.0:1788986796.037134:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986796.037136:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993622016:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788986796.037138:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986796.037156:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993621504:0@lo:400:kworker.0 00000100:00100000:3.0:1788986796.037164:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993622016:12345-0@lo:400:kworker.0 Request processed in 29us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986796.037164:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967365 gen 2 00000004:00080000:1.0:1788986796.037168:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a797e1500, transno 4294967365 00000100:00100000:3.0:1788986796.037169:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1390 00000100:00100000:1.0:1788986796.037177:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993622016:0@lo:400:kworker.0 00000100:00100000:1.0:1788986796.037188:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993621888:0@lo:400:kworker.0 00000100:00100000:2.0:1788986796.039679:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993621376 00000100:00100000:2.0:1788986796.039694:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993621376 00000100:00100000:2.0:1788986796.040678:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:2.0:1788986796.040692:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993621376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986796.040777:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993621376:12345-0@lo:400:kworker.0 Request processed in 90us (4184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986796.040784:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00100000:1.0:1788986796.040881:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993621376:0@lo:400:kworker.0 00000100:00100000:0.0:1788986796.545259:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986796.545282:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993622144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986796.545347:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986796.545474:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993622144 00000100:00100000:1.0:1788986796.545481:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993622144 00000100:00100000:1.0:1788986796.545542:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 935 00000100:00100000:1.0:1788986796.545551:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993622144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986796.545584:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986796.545639:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993622144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986796.545646:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 935 00000100:00100000:0.0:1788986796.545834:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993622144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986797.057947:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986798.080295:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986798.202179:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986798.202234:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986798.202264:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986798.202309:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986798.202336:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971415680 00000100:00100000:2.0:1788986798.202344:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971415680 00000100:00100000:2.0:1788986798.202404:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971415808 00000100:00100000:2.0:1788986798.202407:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971415808 00000100:00100000:2.0:1788986798.202431:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1391 00000100:00100000:2.0:1788986798.202440:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971415680:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986798.202516:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971415680:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986798.202524:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1391 00000100:00100000:2.0:1788986798.202542:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1392 00000100:00100000:2.0:1788986798.202549:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971415808:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986798.202572:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971415808:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986798.202578:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1392 00000100:00100000:0.0:1788986798.203105:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971415552 00000100:00100000:0.0:1788986798.203110:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971415552 00000100:00100000:0.0:1788986798.203150:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1841 00000100:00100000:0.0:1788986798.203158:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971415552:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986798.203213:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971415552:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 56us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986798.203219:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1841 00000100:00100000:1.0:1788986798.203353:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971415424 00000100:00100000:1.0:1788986798.203358:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971415424 00000100:00100000:1.0:1788986798.203397:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1417 00000100:00100000:1.0:1788986798.203405:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971415424:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986798.203431:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971415424:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (1262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986798.203437:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1417 00000100:00080000:1.0:1788986798.203461:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986798.203466:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986798.203468:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986799.104509:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986800.128351:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986800.128522:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986800.128550:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993622272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986800.128616:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986800.131845:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993622272 00000100:00100000:0.0:1788986800.131862:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993622272 00000100:00100000:0.0:1788986800.131947:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 936 00000100:00100000:0.0:1788986800.131958:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993622272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986800.131994:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788986800.132429:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986800.132480:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993622272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 523us (3862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986800.132488:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 936 00000100:00100000:2.0:1788986800.136183:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993622272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986801.154397:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993622784:0@lo:400:kworker.0 00000100:00100000:0.0:1788986801.154486:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986801.154560:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986801.154567:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993622656:0@lo:400:kworker.0 00000100:00100000:0.0:1788986801.154593:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986801.154745:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993622528:0@lo:400:kworker.0 00000100:00100000:3.0:1788986801.154774:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986801.154793:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fefb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993623040:0@lo:400:kworker.0 00000100:00100000:3.0:1788986801.154821:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986801.154841:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788986801.154847:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993622400:0@lo:400:kworker.0 00000100:00100000:3.0:1788986801.154875:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986801.154903:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993622912:0@lo:400:kworker.0 00000100:00100000:3.0:1788986801.154925:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986801.154953:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993622784 00000100:00100000:3.0:1788986801.154960:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993622784 00000100:00100000:1.0:1788986801.155015:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993622400 00000100:00100000:1.0:1788986801.155021:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993622400 00000100:00100000:0.0:1788986801.155041:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993622656 00000100:00100000:0.0:1788986801.155045:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993622656 00000100:00100000:1.0:1788986801.155050:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1788986801.155057:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993622400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986801.155079:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993622528 00000100:00100000:0.0:1788986801.155082:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993622528 00000100:00100000:3.0:1788986801.160979:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993623040 00000100:00100000:3.0:1788986801.160993:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993623040 00000100:00100000:3.0:1788986801.161060:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1393 00000100:00100000:3.0:1788986801.161069:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993622784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986801.161168:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993622784:12345-0@lo:400:kworker.0 Request processed in 100us (6682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986801.161174:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1393 00000100:00100000:3.0:1788986801.161190:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1394 00000100:00100000:3.0:1788986801.161196:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993623040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986801.162395:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993622400:12345-0@lo:400:kworker.0 Request processed in 7333us (7513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986801.162407:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:0.0:1788986801.164135:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993622912 00000100:00100000:0.0:1788986801.164147:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993622912 00000100:00100000:1.0:1788986801.164287:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1842 00000100:00100000:1.0:1788986801.164299:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993622656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986801.164373:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993622656:12345-0@lo:400:kworker.0 Request processed in 77us (9779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986801.164380:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1842 00000100:00100000:1.0:1788986801.164396:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1843 00000100:00100000:1.0:1788986801.164402:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993622528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986801.171013:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993623040:12345-0@lo:400:kworker.0 Request processed in 9796us (16170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986801.171027:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1394 00000100:00100000:3.0:1788986801.171105:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1844 00000100:00100000:3.0:1788986801.171121:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993622912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986801.171193:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993622912:12345-0@lo:400:kworker.0 Request processed in 80us (16267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986801.171198:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1844 00000100:00100000:3.0:1788986801.171253:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993622400:0@lo:400:kworker.0 00000100:00100000:3.0:1788986801.171280:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fef9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993622912:0@lo:400:kworker.0 00000100:00080000:0.0:1788986801.172110:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986801.172117:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986801.172155:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993622656:0@lo:400:kworker.0 00000100:00100000:0.0:1788986801.172169:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993622784:0@lo:400:kworker.0 00000100:00100000:1.0:1788986801.180455:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993622528:12345-0@lo:400:kworker.0 Request processed in 16043us (25669us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986801.180470:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1843 00000100:00100000:3.0:1788986801.182401:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993622528:0@lo:400:kworker.0 00000100:00100000:3.0:1788986801.182548:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fefb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993623040:0@lo:400:kworker.0 00010000:00010000:2.0:1788986801.191776:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986801.664689:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993623168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986801.664752:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986801.664879:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993623168 00000100:00100000:2.0:1788986801.664887:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993623168 00000100:00100000:2.0:1788986801.664939:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 937 00000100:00100000:2.0:1788986801.664948:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993623168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986801.664980:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986801.665049:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993623168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986801.665056:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 937 00000100:00100000:3.0:1788986801.665085:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993623168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986802.243858:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986803.268407:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986803.320197:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986803.320241:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986803.320268:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986803.320301:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986803.320332:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971416192 00000100:00100000:2.0:1788986803.320341:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971416192 00000100:00100000:2.0:1788986803.320399:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971416320 00000100:00100000:2.0:1788986803.320403:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971416320 00000100:00100000:2.0:1788986803.320424:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1395 00000100:00100000:2.0:1788986803.320434:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971416192:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986803.320495:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971416192:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 63us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986803.320503:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1395 00000100:00100000:2.0:1788986803.320521:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1396 00000100:00100000:2.0:1788986803.320528:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971416320:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986803.320552:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971416320:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986803.320561:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1396 00000100:00080000:0.0:1788986803.320736:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986803.320742:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986803.322853:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971415936 00000100:00100000:3.0:1788986803.322866:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971415936 00000100:00100000:3.0:1788986803.322931:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1419 00000100:00100000:3.0:1788986803.322940:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971415936:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986803.323021:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971415936:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 81us (2832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986803.323029:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1419 00000100:00100000:1.0:1788986803.323629:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971416064 00000100:00100000:1.0:1788986803.323635:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971416064 00000100:00100000:1.0:1788986803.323694:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1845 00000100:00100000:1.0:1788986803.323702:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971416064:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986803.323760:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971416064:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 59us (3491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986803.323767:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1845 00000100:00080000:0.0:1788986803.324066:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986804.288461:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986805.249229:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986805.249259:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993623296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986805.249345:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986805.249744:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993623296 00000100:00100000:0.0:1788986805.249754:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993623296 00000100:00100000:0.0:1788986805.249832:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 938 00000100:00100000:0.0:1788986805.249843:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993623296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986805.249882:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986805.249953:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993623296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986805.249960:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 938 00000100:00080000:3.0:1788986805.250115:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986805.250161:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993623296:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986805.314239:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986806.274306:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993623808:0@lo:400:kworker.0 00000100:00100000:0.0:1788986806.274409:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986806.274497:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986806.274503:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993623680:0@lo:400:kworker.0 00000100:00100000:0.0:1788986806.274547:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986806.274583:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993623680 00000100:00100000:0.0:1788986806.274593:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993623680 00000100:00100000:0.0:1788986806.274664:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1846 00000100:00100000:0.0:1788986806.274676:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993623680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986806.274735:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993623680:12345-0@lo:400:kworker.0 Request processed in 63us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986806.274742:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1846 00000100:00100000:0.0:1788986806.274794:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fef8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993623680:0@lo:400:kworker.0 00000100:00100000:3.0:1788986806.275300:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993623552:0@lo:400:kworker.0 00000100:00100000:3.0:1788986806.275341:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986806.275382:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993624064:0@lo:400:kworker.0 00000100:00100000:3.0:1788986806.275408:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986806.275434:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788986806.275440:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993623424:0@lo:400:kworker.0 00000100:00100000:3.0:1788986806.275470:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986806.275492:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fefad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993623936:0@lo:400:kworker.0 00000100:00100000:3.0:1788986806.275516:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788986806.275544:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986806.275559:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993623808 00000100:00100000:3.0:1788986806.275564:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993623808 00000100:00100000:3.0:1788986806.275602:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993624064 00000100:00100000:3.0:1788986806.275605:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993624064 00000100:00100000:3.0:1788986806.275636:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1788986806.275643:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993623808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986806.275687:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993623808:12345-0@lo:400:kworker.0 Request processed in 45us (1279us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986806.275694:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1397 00000100:00100000:3.0:1788986806.275715:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1788986806.275721:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993624064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986806.275757:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993624064:12345-0@lo:400:kworker.0 Request processed in 36us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986806.275763:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1398 00000100:00100000:3.0:1788986806.275781:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993623552 00000100:00100000:3.0:1788986806.275784:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993623552 00000100:00100000:3.0:1788986806.275806:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993623936 00000100:00100000:3.0:1788986806.275809:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993623936 00000100:00100000:3.0:1788986806.275831:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1847 00000100:00100000:3.0:1788986806.275837:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993623552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986806.275869:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993623552:12345-0@lo:400:kworker.0 Request processed in 32us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986806.275875:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1847 00000100:00100000:3.0:1788986806.275887:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1848 00000100:00100000:3.0:1788986806.275892:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993623936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986806.275916:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993623936:12345-0@lo:400:kworker.0 Request processed in 25us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986806.275922:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1848 00000100:00080000:3.0:1788986806.275946:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986806.275950:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986806.275986:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fefad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993623936:0@lo:400:kworker.0 00000100:00100000:3.0:1788986806.275999:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993623552:0@lo:400:kworker.0 00000100:00100000:3.0:1788986806.276008:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993624064:0@lo:400:kworker.0 00000100:00100000:3.0:1788986806.276041:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993623808:0@lo:400:kworker.0 00000100:00100000:0.0:1788986806.276138:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993623424 00000100:00100000:0.0:1788986806.276143:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993623424 00000100:00100000:0.0:1788986806.276179:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1788986806.276186:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993623424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986806.276224:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993623424:12345-0@lo:400:kworker.0 Request processed in 39us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986806.276230:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:3.0:1788986806.276869:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993623424:0@lo:400:kworker.0 00010000:00010000:2.0:1788986806.336370:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986806.784794:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986806.784825:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993624192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986806.784915:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986806.785019:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993624192 00000100:00100000:2.0:1788986806.785028:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993624192 00000100:00100000:2.0:1788986806.785114:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1788986806.785126:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993624192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986806.785185:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986806.785246:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993624192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986806.785254:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 939 00000100:00100000:2.0:1788986806.785326:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993624192:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986807.360360:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986807.777742:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986807.777825:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971416448 00000100:00100000:0.0:1788986807.777834:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971416448 00000100:00080000:3.0:1788986807.777949:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986807.778020:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1093 00000100:00100000:0.0:1788986807.778031:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56800:x1875885971416448:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986807.778287:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56800:x1875885971416448:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 257us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986807.778295:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1093 00000100:00100000:0.0:1788986807.797060:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986807.797118:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971416576 00000100:00100000:0.0:1788986807.797128:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971416576 00000100:00100000:0.0:1788986807.797196:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 602 00000100:00100000:0.0:1788986807.797206:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56800:x1875885971416576:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00080000:1.0:1788986807.797927:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986807.798377:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56800:x1875885971416576:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 1169us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986807.798386:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 602 00000100:00100000:0.0:1788986807.812641:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986807.813669:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971416704 00000100:00100000:3.0:1788986807.813680:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971416704 00000100:00100000:3.0:1788986807.813741:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 603 00000100:00100000:3.0:1788986807.813752:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56800:x1875885971416704:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986807.814619:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56800:x1875885971416704:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 866us (1982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986807.814628:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 603 00000100:00080000:3.0:1788986807.814652:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986807.820649:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986807.821018:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971416832 00000100:00100000:1.0:1788986807.821028:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971416832 00000100:00100000:1.0:1788986807.821112:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1094 00000100:00100000:1.0:1788986807.821124:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56800:x1875885971416832:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986807.821597:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56800:x1875885971416832:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 474us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986807.821606:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1094 00000100:00100000:0.0:1788986807.838518:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986807.838553:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971416960 00000100:00100000:0.0:1788986807.838561:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971416960 00000100:00100000:0.0:1788986807.838607:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1095 00000100:00100000:0.0:1788986807.838616:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56800:x1875885971416960:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986807.838706:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56800:x1875885971416960:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 90us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986807.838713:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1095 00000100:00100000:0.0:1788986807.857769:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986807.858202:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971417088 00000100:00100000:3.0:1788986807.858212:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971417088 00000100:00100000:3.0:1788986807.859023:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 604 00000100:00100000:3.0:1788986807.859038:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56800:x1875885971417088:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986807.859476:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fefa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56800:x1875885971417088:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 440us (1712us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986807.859485:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 604 00000100:00100000:1.0:1788986807.861739:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986807.861806:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971417216 00000100:00100000:3.0:1788986807.861814:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971417216 00000100:00100000:3.0:1788986807.861955:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 605 00000100:00100000:3.0:1788986807.861977:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56800:x1875885971417216:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986807.862397:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:56800:x1875885971417216:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 431us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986807.862405:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 605 00000100:00100000:2.0:1788986807.866498:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986807.867728:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971417344 00000100:00100000:3.0:1788986807.867739:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971417344 00000100:00100000:3.0:1788986807.867790:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1096 00000100:00100000:3.0:1788986807.867800:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56800:x1875885971417344:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986807.868250:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56800:x1875885971417344:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 452us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986807.868258:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1096 00000100:00100000:0.0:1788986807.935421:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986807.935515:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971417472 00000100:00100000:1.0:1788986807.935524:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971417472 00000100:00100000:1.0:1788986807.935582:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1097 00000100:00100000:1.0:1788986807.935593:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:56801:x1875885971417472:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986807.935611:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986807.935674:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e74 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15a6 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986807.935761:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986807.935775:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986807.935788:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986807.935826:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00000004:00200000:1.0:1788986807.935830:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986807.935874:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986807.935900:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549e74 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15a6 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986807.935920:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15a6 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986807.935929:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:1.0:1788986807.935932:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986807.935935:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d48a00, rc 0) 00000100:00100000:1.0:1788986807.936008:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56801:x1875885971417472:12345-192.168.206.21@tcp:101:rm.0 Request processed in 417us (592us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986807.936015:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1097 00000100:00100000:3.0:1788986807.941855:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986807.941906:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971417728 00000100:00100000:3.0:1788986807.941914:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971417728 00000100:00100000:3.0:1788986807.941979:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1098 00000100:00100000:3.0:1788986807.941990:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56801:x1875885971417728:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986807.942008:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986807.942029:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549e82 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15ad expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986807.942132:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x54:0x0]: returning size 16384 00010000:00010000:3.0:1788986807.942373:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549e82 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15ad expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.942386:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745b00) 00010000:00010000:3.0:1788986807.942390:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788986807.942394:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf549e82 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15ad expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.942408:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986807.942642:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:56801:x1875885971417728:12345-192.168.206.21@tcp:101:rm.0 Request processed in 653us (794us total) trans 4294967710 rc 301/301 00000100:00100000:3.0:1788986807.942650:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1098 00000100:00100000:3.0:1788986807.953215:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986807.953330:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971417856 00000100:00100000:0.0:1788986807.953340:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971417856 00000100:00100000:0.0:1788986807.953394:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 108 00000100:00100000:0.0:1788986807.953404:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:56801:x1875885971417856:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:1.0:1788986807.969117:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:56801:x1875885971417856:12345-192.168.206.21@tcp:37:rm.0 Request processed in 15706us (15900us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986807.969131:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 108 00000100:00100000:3.0:1788986807.973374:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986807.975543:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971418112 00000100:00100000:1.0:1788986807.975556:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971418112 00000100:00100000:1.0:1788986807.977613:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 109 00000100:00100000:1.0:1788986807.977631:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:56801:x1875885971418112:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:1.0:1788986807.977936:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:56801:x1875885971418112:12345-192.168.206.21@tcp:35:rm.0 Request processed in 310us (4569us total) trans 4294967711 rc 0/0 00000100:00100000:1.0:1788986807.977947:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 109 00000100:00100000:3.0:1788986807.982571:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986807.982612:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971418368 00000100:00100000:3.0:1788986807.982621:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971418368 00000100:00100000:3.0:1788986807.982681:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1099 00000100:00100000:3.0:1788986807.982694:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:56801:x1875885971418368:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788986807.982751:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788986807.982777:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48a00/0xc20d828fcf549e7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15a6 expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.982800:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf549e20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x54:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1591 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.982812:0:5856:0:(ldlm_lockd.c:1754:ldlm_request_cancel()) ### server-side cancel handler stale lock (cookie c20d828fcf549a76) 00010000:00010000:3.0:1788986807.982817:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:3.0:1788986807.982830:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986807.983539:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549e90 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.983555:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549e90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.983564:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549e90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.983576:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549e97 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.983584:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549e97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.983590:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549e97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985218:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549e9e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985235:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985245:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985288:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549e9e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985296:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549e9e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985304:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549e9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985310:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986807.985315:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549e9e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985323:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549e9e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985335:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x54:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:3.0:1788986807.985338:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986807.985343:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549e9e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985349:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf549e9e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x54:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985372:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549e90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985379:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549e90 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985384:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549e90 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985390:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986807.985394:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549e90 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985399:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549e90 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985409:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:3.0:1788986807.985411:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986807.985414:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549e90 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.985420:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf549e90 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.986317:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549e97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.986328:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549e97 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.986335:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549e97 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.986340:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986807.986344:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549e97 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.986351:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549e97 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.986360:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9a6a165d (ffff9b0a55745000) 00010000:00010000:3.0:1788986807.986363:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986807.986367:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549e97 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986807.986373:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf549e97 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9a6a165d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986807.987114:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:56801:x1875885971418368:12345-192.168.206.21@tcp:36:rm.0 Request processed in 4418us (4546us total) trans 0 rc -13/-13 00000100:00100000:3.0:1788986807.987124:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1099 00010000:00010000:2.0:1788986808.384432:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986808.434070:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986808.434170:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971418496 00000100:00100000:2.0:1788986808.434180:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971418496 00000100:00100000:2.0:1788986808.434248:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1421 00000100:00100000:2.0:1788986808.434258:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971418496:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986808.434721:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971418496:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 463us (859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986808.434729:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1421 00000020:00000080:3.0:1788986809.388527:0:97098:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd7e7c0040 20000000:00000080:3.0:1788986809.388543:0:97098:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094242c000 uarg=0000000000000000 00010000:00010000:0.0:1788986809.398367:0:97098:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986809.399205:0:97098:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986809.399277:0:97098:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986809.399297:0:97098:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986809.399320:0:97098:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf549dfd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549df6 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986809.399328:0:97098:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986809.399367:0:97098:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf549dfd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549df6 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986809.399382:0:97098:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf549dfd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549df6 expref: 18 pid: 5849 timeout: 2693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986809.399408:0:97098:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fef8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97098:1875885993624320:0@lo:104: 00000100:00100000:0.0:1788986809.399469:0:97098:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986809.399710:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993624320 00000100:00100000:1.0:1788986809.399718:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993624320 00000100:00100000:1.0:1788986809.400465:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:1.0:1788986809.400478:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:97098:x1875885993624320:12345-0@lo:104: 00010000:00010000:1.0:1788986809.400492:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986809.401364:0:97098:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a511f3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788986809.403060:0:97098:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fef8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97098:1875885993624320:0@lo:104: 00010000:00010000:1.0:1788986809.403064:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986809.403077:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:97098:x1875885993624320:12345-0@lo:104: Request processed in 2600us (3605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986809.403104:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00010000:00010000:2.0:1788986809.403121:0:97098:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403236:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986809.403245:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403253:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986809.403258:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403267:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986809.403274:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986809.403280:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986809.403373:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403380:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986809.403407:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403415:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf549df6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549dfd expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403432:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986809.403434:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986809.403436:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986809.403509:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8096e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993624448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986809.403551:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986809.403640:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993624448 00000100:00100000:3.0:1788986809.403648:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993624448 00010000:00010000:3.0:1788986809.403674:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf549dfd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549df6 expref: 19 pid: 5849 timeout: 2693 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986809.403771:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 448 00000100:00100000:3.0:1788986809.403780:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993624448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986809.403792:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986809.403798:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf549dfd lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549df6 expref: 19 pid: 5849 timeout: 2693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403808:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf549dfd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549df6 expref: 19 pid: 5849 timeout: 2693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403821:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf549dfd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549df6 expref: 19 pid: 5849 timeout: 2693 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403832:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403851:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403875:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403881:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403887:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403894:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403899:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986809.403902:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403910:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403928:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986809.403936:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986809.403993:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993624448:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986809.404001:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 448 00000100:00100000:0.0:1788986809.404149:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8096e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993624448:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986809.404298:0:97098:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986809.404308:0:97098:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986809.404313:0:97098:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ea5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97098 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986809.417940:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788986810.336594:0:97146:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe814ab410 20000000:00000080:0.0:1788986810.336609:0:97146:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a73ab7000 uarg=0000000000000000 00010000:00010000:0.0:1788986810.336820:0:97146:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986810.336834:0:97146:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986810.336851:0:97146:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986810.337121:0:97146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf549eac lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.337138:0:97146:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf549eac lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.337149:0:97146:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf549eac lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.337156:0:97146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf549eac lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.337163:0:97146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf549eac lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.337171:0:97146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf549eac lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.337176:0:97146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efe00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986810.337180:0:97146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf549eac lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.337188:0:97146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf549eac lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.337200:0:97146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf549eac lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.337208:0:97146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf549eac lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.337226:0:97146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efe00/0xc20d828fcf549eac lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986810.371005:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986810.371030:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8096c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993624576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986810.371113:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986810.371196:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993624576 00000100:00100000:2.0:1788986810.371214:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993624576 00000100:00100000:2.0:1788986810.371273:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 940 00000100:00100000:2.0:1788986810.371282:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993624576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986810.371315:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986810.371360:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993624576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986810.371367:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 940 00000100:00080000:2.0:1788986810.371388:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986810.371656:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8096c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993624576:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986810.439173:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986810.458297:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967711 is committed 10000000:01000000:0.0:1788986810.816577:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986810.816583:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986810.816588:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986810.816630:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.816640:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.816651:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986810.816675:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fef9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993624704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986810.816736:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986810.816848:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09426a6240 going to sleep for 11 seconds 00000100:00100000:3.0:1788986810.817170:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993624704 00000100:00100000:3.0:1788986810.817177:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993624704 00000100:00100000:2.0:1788986810.817355:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1788986810.817366:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993624704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986810.817379:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986810.817392:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf549eba lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549eb3 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986810.817414:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf549eba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549eb3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986810.817498:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf549eba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549eb3 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986810.817506:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0000, rc 0) 00000100:00100000:2.0:1788986810.817604:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993624704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 240us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986810.817612:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:0.0:1788986810.817693:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fef9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993624704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986810.817707:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549eba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.817716:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549eba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986810.817732:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986810.817736:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549eba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986810.817745:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549eba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788986811.314505:0:97195:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc8b165f00 20000000:00000080:2.0:1788986811.314522:0:97195:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094295e400 uarg=0000000000000000 00010000:00010000:2.0:1788986811.315813:0:97195:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986811.315832:0:97195:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986811.315850:0:97195:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986811.315867:0:97195:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986811.315882:0:97195:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf549eba lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549eb3 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986811.315890:0:97195:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986811.315928:0:97195:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf549eba lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549eb3 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986811.315942:0:97195:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf549eba lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549eb3 expref: 18 pid: 5846 timeout: 2695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986811.315966:0:97195:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97195:1875885993624832:0@lo:104: 00000100:00100000:2.0:1788986811.316027:0:97195:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986811.316083:0:97195:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788986811.316394:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993624832 00000100:00100000:0.0:1788986811.316401:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993624832 00000100:00100000:0.0:1788986811.316442:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 383 00000100:00100000:0.0:1788986811.316451:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:97195:x1875885993624832:12345-0@lo:104: 00010000:00010000:0.0:1788986811.316464:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549eba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986811.316526:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986811.316532:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:97195:x1875885993624832:12345-0@lo:104: Request processed in 83us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986811.316539:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 383 00010000:00010000:1.0:1788986811.316612:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986811.316619:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549eba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316625:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986811.316629:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549eba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316636:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549eba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986811.316642:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549eba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986811.316647:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986811.316681:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549eba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316688:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986811.316708:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549eba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316715:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef400/0xc20d828fcf549eb3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549eba expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316728:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986811.316730:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986811.316732:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986811.316742:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993624960:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986811.316773:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986811.316813:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993624960 00000100:00100000:1.0:1788986811.316817:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993624960 00010000:00010000:1.0:1788986811.316835:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf549eba lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549eb3 expref: 19 pid: 5846 timeout: 2695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986811.316855:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1788986811.316861:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993624960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986811.316870:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986811.316874:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf549eba lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549eb3 expref: 19 pid: 5846 timeout: 2695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316882:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf549eba lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549eb3 expref: 19 pid: 5846 timeout: 2695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316896:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316904:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316918:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316924:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316931:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316938:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316943:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986811.316957:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316965:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316974:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986811.316983:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986811.317013:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993624960:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986811.317020:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 449 00000100:00100000:1.0:1788986811.317055:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993624960:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986811.317527:0:97195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0000/0xc20d828fcf549eba lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549eb3 expref: 18 pid: 5846 timeout: 2695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986811.317538:0:97195:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97195:1875885993624832:0@lo:104: 00010000:00010000:2.0:1788986811.317551:0:97195:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986811.317559:0:97195:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986811.317649:0:97195:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986811.317657:0:97195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf549ec1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97195 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986811.394643:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8096e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993625216:0@lo:400:kworker.0 00000100:00100000:3.0:1788986811.394705:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986811.394754:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788986811.394761:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8096c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993625088:0@lo:400:kworker.0 00000100:00100000:3.0:1788986811.394782:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986811.394799:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993625600:0@lo:400:kworker.0 00000100:00100000:3.0:1788986811.394834:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986811.394868:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993625216 00000100:00100000:3.0:1788986811.394876:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993625216 00000100:00100000:3.0:1788986811.394925:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993625088 00000100:00100000:3.0:1788986811.394928:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993625088 00000100:00100000:3.0:1788986811.394961:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1849 00000100:00100000:3.0:1788986811.394970:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993625216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986811.395027:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993625216:12345-0@lo:400:kworker.0 Request processed in 58us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986811.395034:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1849 00000100:00100000:3.0:1788986811.395051:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1850 00000100:00100000:3.0:1788986811.395056:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993625088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986811.395084:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993625088:12345-0@lo:400:kworker.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986811.395111:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1850 00000100:00100000:3.0:1788986811.395131:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993625600 00000100:00100000:3.0:1788986811.395135:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993625600 00000100:00100000:3.0:1788986811.395162:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1399 00000100:00100000:3.0:1788986811.395169:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993625600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986811.395198:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993625600:12345-0@lo:400:kworker.0 Request processed in 29us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986811.395204:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1399 00000100:00080000:3.0:1788986811.395220:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986811.395224:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986811.395254:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8096c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993625088:0@lo:400:kworker.0 00000100:00100000:3.0:1788986811.395264:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80910000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993625600:0@lo:400:kworker.0 00000100:00100000:3.0:1788986811.395273:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8096e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993625216:0@lo:400:kworker.0 00000100:00100000:1.0:1788986811.396049:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993625344:0@lo:400:kworker.0 00000100:00100000:1.0:1788986811.396158:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986811.396266:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993625344 00000100:00100000:3.0:1788986811.396272:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993625344 00000100:00100000:3.0:1788986811.396351:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1400 00000100:00100000:3.0:1788986811.396360:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993625344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986811.396400:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993625344:12345-0@lo:400:kworker.0 Request processed in 42us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986811.396406:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1400 00000100:00100000:1.0:1788986811.396465:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993625344:0@lo:400:kworker.0 00000100:00100000:1.0:1788986811.396483:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986811.396490:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993625472:0@lo:400:kworker.0 00000100:00100000:1.0:1788986811.396515:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986811.396546:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993625472 00000100:00100000:1.0:1788986811.396550:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993625472 00000100:00100000:1.0:1788986811.396582:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1851 00000100:00100000:1.0:1788986811.396588:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993625472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986811.396622:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993625472:12345-0@lo:400:kworker.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986811.396628:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1851 00000100:00100000:1.0:1788986811.397005:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993625472:0@lo:400:kworker.0 00000100:00080000:1.0:1788986811.397022:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788986811.460997:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986811.917706:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993625728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986811.917798:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986811.917975:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993625728 00000100:00100000:2.0:1788986811.917985:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993625728 00000100:00100000:2.0:1788986811.918034:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 941 00000100:00100000:2.0:1788986811.918045:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993625728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986811.918080:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986811.918161:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993625728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986811.918168:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 941 00000100:00100000:3.0:1788986811.918370:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993625728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986812.480261:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788986812.737142:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986812.737149:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986812.737153:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986812.737197:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986812.737210:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986812.737232:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986812.737257:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fef9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993625856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986812.737321:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986812.737377:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a52ecd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986812.737562:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993625856 00000100:00100000:1.0:1788986812.737570:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993625856 00000100:00100000:1.0:1788986812.737622:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1788986812.737630:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993625856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986812.737642:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986812.737655:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf549ecf lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549ec8 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986812.737676:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf549ecf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549ec8 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986812.737692:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf549ecf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549ec8 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986812.737701:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d48e00, rc 0) 00000100:00100000:1.0:1788986812.737747:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993625856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986812.737754:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:3.0:1788986812.739115:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fef9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993625856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986812.739137:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549ecf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986812.739147:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549ecf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986812.739166:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986812.739171:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549ecf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986812.739178:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549ecf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986813.510960:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986813.553531:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986813.553975:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971418624 00000100:00100000:2.0:1788986813.553985:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971418624 00000100:00100000:2.0:1788986813.554041:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1424 00000100:00100000:2.0:1788986813.554051:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971418624:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986813.554126:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971418624:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 76us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986813.554134:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1424 00000100:00100000:3.0:1788986813.557274:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986813.557315:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986813.557349:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986813.557381:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971418880 00000100:00100000:3.0:1788986813.557389:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971418880 00000100:00100000:3.0:1788986813.557441:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971419008 00000100:00100000:3.0:1788986813.557444:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971419008 00000100:00100000:0.0:1788986813.557456:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971418752 00000100:00100000:0.0:1788986813.557460:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971418752 00000100:00100000:3.0:1788986813.557468:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1401 00000100:00100000:3.0:1788986813.557476:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971418880:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986813.557488:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1852 00000100:00100000:0.0:1788986813.557494:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971418752:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986813.557510:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1402 00000100:00100000:2.0:1788986813.557528:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971419008:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986813.557538:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971418880:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 60us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986813.557546:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1401 00000100:00080000:3.0:1788986813.557568:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986813.557573:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986813.557575:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986813.560568:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971418752:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 3063us (3292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986813.560581:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1852 00000100:00100000:2.0:1788986813.560773:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971419008:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 3251us (3422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986813.560783:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1402 00010000:00010000:1.0:1788986814.528939:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986814.931330:0:97391:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd280b6130 20000000:00000080:3.0:1788986814.931348:0:97391:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a44c52c00 uarg=0000000000000000 00010000:00010000:3.0:1788986814.931659:0:97391:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788986814.931674:0:97391:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788986814.931692:0:97391:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986814.931710:0:97391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.931725:0:97391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf549ecf lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549ec8 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.931733:0:97391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.931769:0:97391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf549ecf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549ec8 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.931784:0:97391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf549ecf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549ec8 expref: 18 pid: 5849 timeout: 2698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986814.931873:0:97391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80911180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97391:1875885993625984:0@lo:104: 00000100:00100000:3.0:1788986814.931946:0:97391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986814.932049:0:97391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80e929c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986814.932341:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788986814.932354:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993625984 00000100:00100000:1.0:1788986814.932360:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993625984 00000100:00100000:1.0:1788986814.932496:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:1.0:1788986814.932505:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a49821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:97391:x1875885993625984:12345-0@lo:104: 00010000:00010000:1.0:1788986814.932518:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549ecf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986814.932588:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986814.932594:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a49821850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:97391:x1875885993625984:12345-0@lo:104: Request processed in 92us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986814.932601:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00010000:00010000:2.0:1788986814.932677:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986814.932685:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549ecf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986814.932693:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986814.932696:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549ecf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986814.932709:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549ecf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986814.932716:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549ecf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986814.932722:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986814.932754:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549ecf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986814.932761:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986814.932780:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549ecf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986814.932787:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf549ec8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549ecf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986814.932815:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986814.932817:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986814.932819:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986814.932883:0:97391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80911180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97391:1875885993625984:0@lo:104: 00010000:00010000:3.0:1788986814.932902:0:97391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986814.933048:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993626112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986814.933084:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986814.933622:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993626112 00000100:00100000:3.0:1788986814.933628:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993626112 00010000:00010000:3.0:1788986814.933652:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf549ecf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549ec8 expref: 19 pid: 5849 timeout: 2698 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986814.933722:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 450 00000100:00100000:3.0:1788986814.933731:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993626112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986814.933742:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986814.933748:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf549ecf lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549ec8 expref: 19 pid: 5849 timeout: 2698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.933759:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf549ecf lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549ec8 expref: 19 pid: 5849 timeout: 2698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.933772:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf549ecf lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549ec8 expref: 19 pid: 5849 timeout: 2698 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.933786:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.933795:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.933888:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.933895:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.933902:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.933909:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.933915:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986814.933918:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.933926:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.933957:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986814.933968:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986814.934072:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fefbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993626112:12345-0@lo:103:ldlm_bl.0 Request processed in 284us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986814.934080:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 450 00000100:00100000:1.0:1788986814.934496:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993626112:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986814.934552:0:97391:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986814.934561:0:97391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986814.934567:0:97391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf549ed6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986815.493585:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986815.493605:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993626240:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986815.493666:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986815.496566:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993626240 00000100:00100000:2.0:1788986815.496580:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993626240 00000100:00100000:2.0:1788986815.496644:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 942 00000100:00100000:2.0:1788986815.496653:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993626240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986815.496687:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986815.496769:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993626240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (3102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986815.496775:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 942 00000100:00080000:2.0:1788986815.496877:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986815.496923:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993626240:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986815.552608:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788986816.192771:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986816.192778:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986816.192783:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986816.192824:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986816.192833:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986816.192842:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986816.192862:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80911180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993626368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986816.192919:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986816.193049:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b6540 going to sleep for 11 seconds 00000100:00100000:0.0:1788986816.193743:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993626368 00000100:00100000:0.0:1788986816.193751:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993626368 00000100:00100000:0.0:1788986816.193804:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:0.0:1788986816.193812:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993626368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986816.193825:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986816.193842:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ee4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549edd expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986816.193865:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ee4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549edd expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986816.193876:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ee4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549edd expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986816.193885:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef200, rc 0) 00000100:00100000:0.0:1788986816.193945:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993626368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986816.193952:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:3.0:1788986816.194511:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80911180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993626368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986816.194541:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549ee4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986816.194550:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549ee4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986816.194583:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986816.194589:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549ee4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986816.194596:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549ee4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986816.512417:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993626624:0@lo:400:kworker.0 00000100:00100000:3.0:1788986816.512486:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986816.512568:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788986816.512575:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993626496:0@lo:400:kworker.0 00000100:00100000:3.0:1788986816.512598:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986816.512618:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993627008:0@lo:400:kworker.0 00000100:00100000:3.0:1788986816.512641:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986816.512670:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993626624 00000100:00100000:3.0:1788986816.512677:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993626624 00000100:00100000:3.0:1788986816.512725:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993626496 00000100:00100000:3.0:1788986816.512728:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993626496 00000100:00100000:3.0:1788986816.512750:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1853 00000100:00100000:3.0:1788986816.512758:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993626624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986816.512832:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993626624:12345-0@lo:400:kworker.0 Request processed in 73us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986816.512838:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1853 00000100:00100000:3.0:1788986816.512857:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1854 00000100:00100000:3.0:1788986816.512877:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993626496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986816.512905:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993626496:12345-0@lo:400:kworker.0 Request processed in 29us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986816.512911:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1854 00000100:00100000:3.0:1788986816.512942:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993627008 00000100:00100000:3.0:1788986816.512945:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993627008 00000100:00100000:3.0:1788986816.512982:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1403 00000100:00100000:3.0:1788986816.512989:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993627008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986816.513021:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993627008:12345-0@lo:400:kworker.0 Request processed in 33us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986816.513027:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1403 00000100:00080000:3.0:1788986816.513042:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986816.513057:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986816.513118:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993626496:0@lo:400:kworker.0 00000100:00100000:3.0:1788986816.513130:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993627008:0@lo:400:kworker.0 00000100:00100000:3.0:1788986816.513137:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993626624:0@lo:400:kworker.0 00000100:00100000:0.0:1788986816.513610:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993626880:0@lo:400:kworker.0 00000100:00100000:0.0:1788986816.513645:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986816.513686:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986816.513693:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993626752:0@lo:400:kworker.0 00000100:00100000:0.0:1788986816.513716:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986816.513742:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993626752 00000100:00100000:0.0:1788986816.513746:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993626752 00000100:00100000:0.0:1788986816.513775:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1788986816.513781:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a76789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993626752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986816.513829:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a76789c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993626752:12345-0@lo:400:kworker.0 Request processed in 48us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986816.513836:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1404 00000100:00100000:0.0:1788986816.513998:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993626752:0@lo:400:kworker.0 00000100:00100000:2.0:1788986816.514580:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993626880 00000100:00100000:2.0:1788986816.514586:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993626880 00000100:00100000:2.0:1788986816.514642:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1855 00000100:00100000:2.0:1788986816.514650:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993626880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986816.514698:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993626880:12345-0@lo:400:kworker.0 Request processed in 49us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986816.514705:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1855 00000100:00080000:0.0:1788986816.515140:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986816.515167:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993626880:0@lo:400:kworker.0 00010000:00010000:2.0:1788986816.576531:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986817.026037:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986817.026060:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993627136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986817.026510:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986817.026645:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993627136 00000100:00100000:2.0:1788986817.026654:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993627136 00000100:00100000:2.0:1788986817.026709:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 943 00000100:00100000:2.0:1788986817.026719:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993627136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986817.026751:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986817.026800:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993627136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986817.026807:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 943 00000100:00100000:0.0:1788986817.026887:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993627136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986817.600527:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986818.625003:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986818.675067:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986818.675143:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986818.675177:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986818.675256:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986818.675601:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971419136 00000100:00100000:3.0:1788986818.675610:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971419136 00000100:00100000:3.0:1788986818.675662:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1426 00000100:00100000:3.0:1788986818.675671:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971419136:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986818.675732:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971419136:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 62us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986818.675739:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1426 00000100:00100000:3.0:1788986818.675769:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971419392 00000100:00100000:3.0:1788986818.675772:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971419392 00000100:00100000:3.0:1788986818.675804:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971419520 00000100:00100000:3.0:1788986818.675807:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971419520 00000100:00100000:3.0:1788986818.675825:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1405 00000100:00100000:3.0:1788986818.675831:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971419392:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986818.675857:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971419392:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986818.675863:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1405 00000100:00100000:3.0:1788986818.675875:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1406 00000100:00100000:3.0:1788986818.675882:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971419520:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986818.675902:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971419520:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 21us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986818.675920:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1406 00000100:00080000:3.0:1788986818.676017:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986818.676021:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986818.676892:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971419264 00000100:00100000:1.0:1788986818.676900:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971419264 00000100:00100000:1.0:1788986818.676969:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1856 00000100:00100000:1.0:1788986818.676978:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971419264:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986818.677031:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971419264:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 55us (1853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986818.677039:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1856 00000100:00080000:3.0:1788986818.677657:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986819.649623:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986820.617718:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986820.617754:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993627264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986820.618471:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986820.618616:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993627264 00000100:00100000:2.0:1788986820.618627:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993627264 00000100:00100000:2.0:1788986820.618710:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 944 00000100:00100000:2.0:1788986820.618722:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993627264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986820.618781:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986820.618849:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80912680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993627264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986820.618858:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 944 00000100:00080000:3.0:1788986820.618990:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986820.619044:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993627264:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986820.674156:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986821.632458:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993627776:0@lo:400:kworker.0 00000100:00100000:2.0:1788986821.632742:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986821.632818:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788986821.632826:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993627392:0@lo:400:kworker.0 00000100:00100000:2.0:1788986821.632946:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986821.632977:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993627904:0@lo:400:kworker.0 00000100:00100000:2.0:1788986821.633006:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986821.633046:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993627392 00000100:00100000:2.0:1788986821.633055:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993627392 00000100:00100000:2.0:1788986821.633142:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1427 00000100:00100000:2.0:1788986821.633153:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993627392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986821.633212:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993627392:12345-0@lo:400:kworker.0 Request processed in 61us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986821.633219:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1427 00000100:00100000:2.0:1788986821.633255:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993627904 00000100:00100000:2.0:1788986821.633260:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993627904 00000100:00100000:2.0:1788986821.633304:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1857 00000100:00100000:2.0:1788986821.633313:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993627904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986821.633348:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993627904:12345-0@lo:400:kworker.0 Request processed in 36us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986821.633354:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1857 00000100:00080000:2.0:1788986821.633375:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986821.633410:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993627392:0@lo:400:kworker.0 00000100:00100000:2.0:1788986821.633446:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993627904:0@lo:400:kworker.0 00000100:00100000:0.0:1788986821.633712:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993627520:0@lo:400:kworker.0 00000100:00100000:0.0:1788986821.633748:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986821.633774:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993628032:0@lo:400:kworker.0 00000100:00100000:0.0:1788986821.633799:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986821.633822:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986821.633829:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993627648:0@lo:400:kworker.0 00000100:00100000:0.0:1788986821.633863:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986821.633908:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993627776 00000100:00100000:0.0:1788986821.633913:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993627776 00000100:00100000:0.0:1788986821.633985:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993628032 00000100:00100000:0.0:1788986821.633989:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993628032 00000100:00100000:0.0:1788986821.634019:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1788986821.634026:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993627776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986821.634067:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993627776:12345-0@lo:400:kworker.0 Request processed in 42us (1326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986821.634073:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1407 00000100:00100000:0.0:1788986821.634109:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1788986821.634116:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993628032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986821.634149:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993628032:12345-0@lo:400:kworker.0 Request processed in 34us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986821.634154:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1408 00000100:00100000:0.0:1788986821.634183:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993627520 00000100:00100000:0.0:1788986821.634187:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993627520 00000100:00100000:0.0:1788986821.634210:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993627648 00000100:00100000:0.0:1788986821.634213:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993627648 00000100:00100000:0.0:1788986821.634233:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1858 00000100:00100000:0.0:1788986821.634240:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993627520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986821.634272:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993627520:12345-0@lo:400:kworker.0 Request processed in 33us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986821.634278:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1858 00000100:00100000:0.0:1788986821.634290:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1859 00000100:00100000:0.0:1788986821.634297:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993627648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986821.634322:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993627648:12345-0@lo:400:kworker.0 Request processed in 27us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986821.634328:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1859 00000100:00080000:0.0:1788986821.634351:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986821.634356:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986821.634378:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993627648:0@lo:400:kworker.0 00000100:00100000:0.0:1788986821.634388:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993627520:0@lo:400:kworker.0 00000100:00100000:0.0:1788986821.634397:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993628032:0@lo:400:kworker.0 00000100:00100000:0.0:1788986821.634444:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993627776:0@lo:400:kworker.0 00010000:00010000:2.0:1788986821.696358:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986822.147038:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986822.147067:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993628160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986822.147175:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986822.147281:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993628160 00000100:00100000:2.0:1788986822.147291:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993628160 00000100:00100000:2.0:1788986822.147355:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 945 00000100:00100000:2.0:1788986822.147376:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993628160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986822.147422:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986822.147492:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993628160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986822.147500:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 945 00000100:00100000:2.0:1788986822.147563:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993628160:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986822.721006:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986823.745992:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986823.800724:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986823.800838:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986823.800902:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986823.800943:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986823.800989:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971419904 00000100:00100000:0.0:1788986823.801002:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971419904 00000100:00100000:0.0:1788986823.801069:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971420032 00000100:00100000:0.0:1788986823.801072:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971420032 00000100:00100000:0.0:1788986823.801123:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1409 00000100:00100000:0.0:1788986823.801136:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971419904:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986823.801220:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971419904:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 87us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986823.801227:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1409 00000100:00100000:0.0:1788986823.801247:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1410 00000100:00100000:0.0:1788986823.801255:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971420032:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986823.801281:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971420032:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986823.801287:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1410 00000100:00080000:0.0:1788986823.801304:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986823.801308:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986823.802699:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971419776 00000100:00100000:3.0:1788986823.802715:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971419776 00000100:00100000:3.0:1788986823.802810:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1860 00000100:00100000:3.0:1788986823.802822:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971419776:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986823.802891:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971419776:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 62us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986823.802897:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1860 00000100:00080000:0.0:1788986823.803182:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986823.809679:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971419648 00000100:00100000:1.0:1788986823.809701:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971419648 00000100:00100000:1.0:1788986823.809869:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1428 00000100:00100000:1.0:1788986823.809893:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971419648:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986823.810004:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971419648:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 124us (9294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986823.810012:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1428 00010000:00010000:2.0:1788986824.769991:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788986824.835599:0:97733:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 22: test nodemap mapped_trusted_admin fileops ========================================================== 16:47:03 (1788986823) 00000100:00100000:0.0:1788986825.728425:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993628288:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986825.728501:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986825.728704:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993628288 00000100:00100000:2.0:1788986825.728716:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993628288 00000100:00100000:2.0:1788986825.728777:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 946 00000100:00100000:2.0:1788986825.728788:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993628288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986825.728820:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986825.728899:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993628288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986825.728906:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 946 00000100:00080000:0.0:1788986825.733313:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986825.733550:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993628288:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986825.793940:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:1.0:1788986825.839476:0:97782:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1788986825.853009:0:97782:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000020:00000080:0.0:1788986826.695336:0:97830:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc61629750 20000000:00000080:0.0:1788986826.695353:0:97830:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511cc400 uarg=0000000000000000 10000000:01000000:0.0:1788986826.696043:0:97830:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986826.696063:0:97830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986826.696080:0:97830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ee4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549edd expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986826.696345:0:97830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986826.696387:0:97830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ee4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549edd expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986826.696401:0:97830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ee4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549edd expref: 18 pid: 5848 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986826.696420:0:97830:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fef9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97830:1875885993628416:0@lo:104: 00000100:00100000:0.0:1788986826.696532:0:97830:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986826.696612:0:97830:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a43fb2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788986826.696651:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993628416 00000100:00100000:2.0:1788986826.696658:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993628416 00000100:00100000:2.0:1788986826.696732:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 385 00000100:00100000:2.0:1788986826.696742:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:97830:x1875885993628416:12345-0@lo:104: 00010000:00010000:2.0:1788986826.696754:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549ee4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986826.696818:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986826.696824:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:97830:x1875885993628416:12345-0@lo:104: Request processed in 84us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986826.696830:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 385 00010000:00010000:3.0:1788986826.696880:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986826.696887:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549ee4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.696894:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986826.696899:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549ee4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.696907:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549ee4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986826.696915:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549ee4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986826.696920:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986826.696946:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549ee4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.696952:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986826.696969:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549ee4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.696975:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549edd lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549ee4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.696991:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986826.696993:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986826.696994:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986826.697009:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993628544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986826.697038:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986826.697067:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993628544 00000100:00100000:3.0:1788986826.697070:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993628544 00010000:00010000:3.0:1788986826.697085:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ee4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549edd expref: 19 pid: 5848 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986826.697126:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1788986826.697132:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45610450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993628544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986826.697141:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986826.697145:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ee4 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549edd expref: 19 pid: 5848 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.697154:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ee4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549edd expref: 19 pid: 5848 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.697179:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.697187:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.697199:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.697206:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.697213:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.697220:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.697225:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986826.697229:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.697235:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.697248:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986826.697258:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986826.697285:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45610450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993628544:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986826.697291:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 451 00000100:00100000:3.0:1788986826.697353:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993628544:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986826.698335:0:97830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf549ee4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549edd expref: 18 pid: 5848 timeout: 2710 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986826.698349:0:97830:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fef9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97830:1875885993628416:0@lo:104: 00010000:00010000:0.0:1788986826.698366:0:97830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986826.698375:0:97830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986826.698381:0:97830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986826.698388:0:97830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf549eeb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986826.753241:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993628928:0@lo:400:kworker.0 00000100:00100000:2.0:1788986826.753309:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986826.753485:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986826.753492:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993629056:0@lo:400:kworker.0 00000100:00100000:2.0:1788986826.753521:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986826.753557:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993628928 00000100:00100000:2.0:1788986826.753564:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993628928 00000100:00100000:2.0:1788986826.753608:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1788986826.753617:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993628928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986826.753669:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993628928:12345-0@lo:400:kworker.0 Request processed in 53us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986826.753676:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1411 00000100:00100000:2.0:1788986826.753696:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993629056 00000100:00100000:2.0:1788986826.753699:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993629056 00000100:00100000:2.0:1788986826.753728:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1861 00000100:00100000:2.0:1788986826.753734:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993629056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986826.753761:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993629056:12345-0@lo:400:kworker.0 Request processed in 28us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986826.753767:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1861 00000100:00080000:2.0:1788986826.753787:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986826.753821:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993629056:0@lo:400:kworker.0 00000100:00100000:2.0:1788986826.753832:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993628928:0@lo:400:kworker.0 00000100:00100000:0.0:1788986826.753938:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993628800:0@lo:400:kworker.0 00000100:00100000:0.0:1788986826.753968:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986826.753994:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788986826.754000:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993628672:0@lo:400:kworker.0 00000100:00100000:0.0:1788986826.754022:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986826.754037:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993629184:0@lo:400:kworker.0 00000100:00100000:0.0:1788986826.754056:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986826.754081:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993629184 00000100:00100000:0.0:1788986826.754085:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993629184 00000100:00100000:0.0:1788986826.754138:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1412 00000100:00100000:0.0:1788986826.754144:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993629184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986826.754253:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094385aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993629184:12345-0@lo:400:kworker.0 Request processed in 108us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986826.754260:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1412 00000100:00100000:0.0:1788986826.754290:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993629184:0@lo:400:kworker.0 00000100:00100000:2.0:1788986826.754422:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993628800 00000100:00100000:2.0:1788986826.754427:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993628800 00000100:00100000:2.0:1788986826.754459:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993628672 00000100:00100000:2.0:1788986826.754462:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993628672 00000100:00100000:2.0:1788986826.754483:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1862 00000100:00100000:2.0:1788986826.754490:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993628800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986826.754530:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943859880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993628800:12345-0@lo:400:kworker.0 Request processed in 41us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986826.754535:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1862 00000100:00100000:2.0:1788986826.754548:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1863 00000100:00100000:2.0:1788986826.754553:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094385ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993628672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986826.754581:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094385ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993628672:12345-0@lo:400:kworker.0 Request processed in 28us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986826.754586:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1863 00000100:00100000:2.0:1788986826.754611:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993628672:0@lo:400:kworker.0 00000100:00100000:2.0:1788986826.754621:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993628800:0@lo:400:kworker.0 00000100:00080000:2.0:1788986826.754640:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986826.754643:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788986826.821305:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986827.264185:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993629312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986827.264251:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986827.264360:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993629312 00000100:00100000:2.0:1788986827.264368:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993629312 00000100:00100000:2.0:1788986827.264420:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1788986827.264429:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993629312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986827.264460:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986827.264523:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993629312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986827.264529:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:1.0:1788986827.264602:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993629312:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788986827.522774:0:97878:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe6266bef0 20000000:00000080:0.0:1788986827.522793:0:97878:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a761c5000 uarg=0000000000000000 10000000:01000000:0.0:1788986827.523277:0:97878:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986827.523298:0:97878:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549ef2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986827.523314:0:97878:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549ef2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986827.523324:0:97878:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549ef2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986827.523331:0:97878:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549ef2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986827.523338:0:97878:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549ef2 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986827.523346:0:97878:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549ef2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986827.523353:0:97878:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986827.523357:0:97878:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549ef2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986827.523365:0:97878:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549ef2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986827.523451:0:97878:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549ef2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986827.523462:0:97878:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549ef2 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986827.523468:0:97878:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf549ef2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97878 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986827.847304:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788986828.096561:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986828.096566:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986828.096570:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986828.096612:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986828.096624:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986828.096635:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986828.096671:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993629440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986828.096736:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986828.096790:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788986828.098763:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993629440 00000100:00100000:3.0:1788986828.098774:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993629440 00000100:00100000:3.0:1788986828.098825:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:3.0:1788986828.098835:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993629440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986828.098849:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986828.098877:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549f00 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549ef9 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.098900:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549f00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549ef9 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.098913:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549f00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549ef9 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.098921:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986828.098993:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993629440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (2256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986828.099003:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1788986828.099122:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943858700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993629440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986828.099140:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986828.099150:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549f00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986828.099169:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986828.099175:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986828.099182:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788986828.277815:0:97926:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff5072d270 20000000:00000080:1.0:1788986828.277831:0:97926:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a79bd8c00 uarg=0000000000000000 10000000:01000000:1.0:1788986828.278020:0:97926:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986828.278040:0:97926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986828.278057:0:97926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549f00 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549ef9 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986828.278066:0:97926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986828.278922:0:97926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549f00 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549ef9 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986828.278938:0:97926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549f00 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549ef9 expref: 18 pid: 5849 timeout: 2712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986828.278952:0:97926:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97926:1875885993629568:0@lo:104: 00000100:00100000:1.0:1788986828.279010:0:97926:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986828.279304:0:97926:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788986828.280513:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993629568 00000100:00100000:3.0:1788986828.280522:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993629568 00000100:00100000:3.0:1788986828.280574:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788986828.280584:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:97926:x1875885993629568:12345-0@lo:104: 00010000:00010000:3.0:1788986828.280600:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549f00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.280686:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986828.280692:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:97926:x1875885993629568:12345-0@lo:104: Request processed in 110us (1682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986828.280699:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00010000:00010000:2.0:1788986828.280772:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986828.280779:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549f00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986828.280787:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986828.280791:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549f00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986828.280800:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549f00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986828.280806:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549f00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986828.280812:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986828.280853:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986828.280871:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986828.280890:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986828.280898:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf549ef9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f00 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986828.280916:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986828.280918:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986828.280920:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986828.280932:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993629696:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986828.280968:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986828.281033:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993629696 00000100:00100000:3.0:1788986828.281037:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993629696 00010000:00010000:3.0:1788986828.281057:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549f00 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549ef9 expref: 19 pid: 5849 timeout: 2712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986828.281082:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 452 00000100:00100000:3.0:1788986828.281113:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993629696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986828.281123:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986828.281128:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549f00 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549ef9 expref: 19 pid: 5849 timeout: 2712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.281138:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549f00 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549ef9 expref: 19 pid: 5849 timeout: 2712 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.281154:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.281167:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.281181:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.281189:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.281195:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.281202:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.281207:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986828.281211:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.281233:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.281243:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986828.281252:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986828.281279:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993629696:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986828.281287:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 452 00000100:00100000:2.0:1788986828.281833:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993629696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986828.281888:0:97926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2e00/0xc20d828fcf549f00 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549ef9 expref: 18 pid: 5849 timeout: 2712 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986828.281901:0:97926:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:97926:1875885993629568:0@lo:104: 00010000:00010000:2.0:1788986828.281914:0:97926:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986828.281922:0:97926:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986828.281929:0:97926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986828.281934:0:97926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f07 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986828.871991:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986828.926645:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986828.926690:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986828.926719:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971420160 00000100:00100000:0.0:1788986828.926719:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971420288 00000100:00100000:3.0:1788986828.926729:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971420160 00000100:00100000:0.0:1788986828.926729:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971420288 00000100:00100000:3.0:1788986828.926779:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1430 00000100:00100000:0.0:1788986828.926789:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1864 00000100:00100000:3.0:1788986828.926791:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971420160:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986828.926803:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971420288:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986828.926869:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971420160:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 81us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986828.926878:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1430 00000100:00080000:1.0:1788986828.930185:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986828.930726:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943858700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971420288:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 3920us (4027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986828.930738:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1864 00000100:00100000:3.0:1788986828.933045:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986828.933102:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986828.933145:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971420416 00000100:00100000:2.0:1788986828.933164:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971420416 00000100:00100000:2.0:1788986828.933611:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971420544 00000100:00100000:2.0:1788986828.933615:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971420544 00000100:00080000:3.0:1788986828.938819:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986828.938826:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986828.939494:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 606 00000100:00100000:3.0:1788986828.939510:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971420416:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788986828.939538:0:8478:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf549c21 00000100:00080000:3.0:1788986828.939548:0:8478:0:(import.c:65:import_set_state_nolock()) ffff9b094371d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788986828.939600:0:8478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967365 00010000:00010000:0.0:1788986828.939824:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986828.941049:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80910700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971420416:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 1531us (7997us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986828.941161:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 606 00000100:00100000:2.0:1788986828.947565:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 607 00000100:00100000:2.0:1788986828.947582:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971420544:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:2.0:1788986828.947611:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf549e04 00000100:00080000:2.0:1788986828.947621:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f56c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788986828.947674:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967365 00010000:00010000:3.0:1788986828.947698:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986828.947936:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971420544:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 358us (14847us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986828.947944:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 607 00000020:00000080:0.0:1788986829.151416:0:97975:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff1a0a6440 20000000:00000080:0.0:1788986829.151434:0:97975:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a761c4400 uarg=0000000000000000 10000000:01000000:0.0:1788986829.151656:0:97975:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986829.151677:0:97975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf549f0e lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 97975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986829.151693:0:97975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf549f0e lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 97975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986829.151704:0:97975:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf549f0e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 97975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986829.151710:0:97975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf549f0e lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986829.151718:0:97975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf549f0e lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 97975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986829.151725:0:97975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf549f0e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986829.151731:0:97975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986829.151736:0:97975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf549f0e lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 97975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986829.151743:0:97975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf549f0e lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 97975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986829.151754:0:97975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf549f0e lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986829.151761:0:97975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf549f0e lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986829.151768:0:97975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf549f0e lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 97975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986829.891264:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986829.891270:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986829.891274:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986829.891313:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986829.891324:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986829.891327:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986829.891343:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986829.891367:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993629824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986829.891427:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986829.892228:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788986829.893500:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993629824 00000100:00100000:2.0:1788986829.893511:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993629824 00000100:00100000:2.0:1788986829.893652:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1431 00000100:00100000:2.0:1788986829.893662:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993629824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986829.893676:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986829.893692:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549f1c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549f15 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986829.893723:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549f1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549f15 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986829.893734:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549f1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549f15 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986829.893742:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1200, rc 0) 00000100:00100000:2.0:1788986829.893804:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993629824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (2377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986829.893811:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1431 00000100:00100000:2.0:1788986829.898527:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80913480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993629824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986829.898554:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f1c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986829.898567:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549f1c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986829.898593:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986829.898598:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f1c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986829.898605:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f1c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788986830.049156:0:98023:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd8df74e30 20000000:00000080:3.0:1788986830.049173:0:98023:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a45766c00 uarg=0000000000000000 10000000:01000000:3.0:1788986830.049542:0:98023:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986830.049564:0:98023:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.049580:0:98023:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549f1c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549f15 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.049588:0:98023:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.049636:0:98023:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549f1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549f15 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.049652:0:98023:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549f1c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549f15 expref: 18 pid: 5846 timeout: 2713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986830.049666:0:98023:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80911f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98023:1875885993629952:0@lo:104: 00000100:00100000:3.0:1788986830.050429:0:98023:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986830.050538:0:98023:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788986830.053400:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993629952 00000100:00100000:2.0:1788986830.053412:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993629952 00000100:00100000:2.0:1788986830.053507:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 387 00000100:00100000:2.0:1788986830.053517:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:98023:x1875885993629952:12345-0@lo:104: 00010000:00010000:2.0:1788986830.053538:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549f1c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986830.053642:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788986830.053649:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80913480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:98023:x1875885993629952:12345-0@lo:104: Request processed in 133us (3221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986830.053656:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 387 00010000:00010000:0.0:1788986830.053704:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986830.053711:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549f1c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986830.053728:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788986830.053732:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549f1c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986830.053741:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549f1c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788986830.053748:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549f1c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986830.053753:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788986830.053788:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f1c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986830.053795:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788986830.053813:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f1c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986830.053820:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf549f15 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f1c expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986830.053838:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986830.053840:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986830.053842:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986830.054178:0:98023:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80911f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98023:1875885993629952:0@lo:104: 00010000:00010000:1.0:1788986830.054199:0:98023:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986830.057246:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993630080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986830.057312:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986830.057485:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993630080 00000100:00100000:1.0:1788986830.057492:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993630080 00010000:00010000:1.0:1788986830.057524:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549f1c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549f15 expref: 19 pid: 5846 timeout: 2713 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986830.057561:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 453 00000100:00100000:1.0:1788986830.057569:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80910a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993630080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986830.057582:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986830.057588:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549f1c lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549f15 expref: 19 pid: 5846 timeout: 2713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986830.057600:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549f1c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549f15 expref: 19 pid: 5846 timeout: 2713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986830.057616:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf549f1c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549f15 expref: 19 pid: 5846 timeout: 2713 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986830.057633:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986830.057641:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986830.057657:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986830.057665:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986830.057672:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986830.057680:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986830.057687:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986830.057692:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986830.057700:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986830.057730:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986830.057740:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986830.057774:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80910a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993630080:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986830.057781:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 453 00010000:00010000:0.0:1788986830.057835:0:98023:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986830.057844:0:98023:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986830.057862:0:98023:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf549f23 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98023 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986830.060263:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993630080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986830.848434:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986830.848455:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993630208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986830.848527:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986830.849067:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993630208 00000100:00100000:1.0:1788986830.849075:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993630208 00000100:00100000:1.0:1788986830.849150:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:1.0:1788986830.849159:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993630208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986830.849203:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986830.849315:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80912d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993630208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986830.849324:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:1.0:1788986830.849373:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993630208:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986830.850525:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1788986830.894621:0:98071:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc9510a6e0 20000000:00000080:3.0:1788986830.894638:0:98071:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a45766000 uarg=0000000000000000 10000000:01000000:3.0:1788986830.895006:0:98071:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986830.895027:0:98071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549f2a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.895042:0:98071:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549f2a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.895052:0:98071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549f2a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.895060:0:98071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549f2a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.895067:0:98071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549f2a lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.895074:0:98071:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549f2a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.895081:0:98071:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986830.895086:0:98071:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549f2a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.895195:0:98071:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549f2a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.895208:0:98071:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549f2a lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.895216:0:98071:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549f2a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.895222:0:98071:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf549f2a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986830.912880:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788986831.488182:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986831.488189:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986831.488193:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986831.488234:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986831.488245:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986831.488258:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986831.488284:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80913b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993630336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986831.488347:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986831.488398:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7540 going to sleep for 11 seconds 00000100:00100000:1.0:1788986831.488453:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993630336 00000100:00100000:1.0:1788986831.488460:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993630336 00000100:00100000:1.0:1788986831.488506:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1432 00000100:00100000:1.0:1788986831.488515:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993630336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986831.488527:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986831.488539:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f38 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549f31 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986831.488659:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549f31 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986831.488671:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549f31 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986831.488680:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d48800, rc 0) 00000100:00100000:1.0:1788986831.488727:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993630336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 214us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986831.488733:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1432 00000100:00100000:3.0:1788986831.488864:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80913b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993630336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986831.488880:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f38 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986831.488888:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549f38 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986831.488906:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986831.488911:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f38 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986831.488918:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f38 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986831.872371:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993630592:0@lo:400:kworker.0 00000100:00100000:2.0:1788986831.872448:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986831.872520:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986831.872527:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993630720:0@lo:400:kworker.0 00000100:00100000:2.0:1788986831.872554:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986831.872592:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993630720 00000100:00100000:2.0:1788986831.872599:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993630720 00000100:00100000:2.0:1788986831.872651:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1413 00000100:00100000:2.0:1788986831.872659:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993630720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986831.872708:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993630720:12345-0@lo:400:kworker.0 Request processed in 49us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986831.872714:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1413 00000100:00100000:2.0:1788986831.872754:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993630720:0@lo:400:kworker.0 00000100:00100000:2.0:1788986831.872814:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993630464:0@lo:400:kworker.0 00000100:00100000:2.0:1788986831.872849:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986831.872878:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993630976:0@lo:400:kworker.0 00000100:00100000:2.0:1788986831.872897:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986831.872913:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986831.872918:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993630848:0@lo:400:kworker.0 00000100:00100000:2.0:1788986831.872940:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986831.872967:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993630592 00000100:00100000:2.0:1788986831.872971:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993630592 00000100:00100000:2.0:1788986831.873001:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993630464 00000100:00100000:2.0:1788986831.873004:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993630464 00000100:00100000:2.0:1788986831.873019:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993630848 00000100:00100000:2.0:1788986831.873022:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993630848 00000100:00100000:2.0:1788986831.873036:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1788986831.873042:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993630592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986831.873078:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993630592:12345-0@lo:400:kworker.0 Request processed in 36us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986831.873084:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1865 00000100:00100000:2.0:1788986831.873117:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1866 00000100:00100000:2.0:1788986831.873124:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993630464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986831.873158:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993630464:12345-0@lo:400:kworker.0 Request processed in 35us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986831.873164:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1866 00000100:00100000:2.0:1788986831.873176:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1867 00000100:00100000:2.0:1788986831.873182:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993630848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986831.873209:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993630848:12345-0@lo:400:kworker.0 Request processed in 27us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986831.873214:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1867 00000100:00080000:2.0:1788986831.873229:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986831.873248:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993630848:0@lo:400:kworker.0 00000100:00100000:2.0:1788986831.873257:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993630464:0@lo:400:kworker.0 00000100:00100000:2.0:1788986831.873283:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993630592:0@lo:400:kworker.0 00000100:00100000:1.0:1788986831.873506:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993630976 00000100:00100000:1.0:1788986831.873511:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993630976 00000100:00100000:1.0:1788986831.873549:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1414 00000100:00100000:1.0:1788986831.873555:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993630976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986831.873594:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993630976:12345-0@lo:400:kworker.0 Request processed in 39us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986831.873600:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1414 00000100:00080000:2.0:1788986831.873763:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986831.873784:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993630976:0@lo:400:kworker.0 00010000:00010000:0.0:1788986831.936323:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986832.388406:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986832.388427:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993631104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986832.388485:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986832.388543:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993631104 00000100:00100000:2.0:1788986832.388550:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993631104 00000100:00100000:2.0:1788986832.388589:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:2.0:1788986832.388597:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993631104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986832.388627:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986832.388671:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993631104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986832.388678:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:2.0:1788986832.388721:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993631104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986832.960269:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788986833.454118:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788986833.454127:0:6721:0:(genops.c:885:class_export_put()) final put ffff9b094371d800/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788986833.454154:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b094371d800/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0000 00000020:00000080:1.0:1788986833.454208:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b094371d000 for lustre-OST0000 00000001:00100000:3.0:1788986833.463286:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:3.0:1788986833.463305:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b0a7f56b000/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:2.0:1788986833.463605:0:94116:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a7f56b000/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0001 00000020:00000080:2.0:1788986833.463660:0:94116:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a7f56c800 for lustre-OST0001 00000020:00000080:0.0:1788986833.524276:0:98220:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff7dd55b00 20000000:00000080:0.0:1788986833.524293:0:98220:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a4631b000 uarg=0000000000000000 10000000:01000000:0.0:1788986833.524689:0:98220:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986833.524722:0:98220:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986833.524743:0:98220:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f38 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549f31 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986833.524757:0:98220:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986833.524883:0:98220:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549f31 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986833.524899:0:98220:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f38 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549f31 expref: 18 pid: 5849 timeout: 2717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986833.524984:0:98220:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98220:1875885993631232:0@lo:104: 00000100:00100000:0.0:1788986833.525048:0:98220:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986833.525266:0:98220:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eace40 going to sleep for 11 seconds 00000100:00100000:3.0:1788986833.526409:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993631232 00000100:00100000:3.0:1788986833.526418:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993631232 00000100:00100000:3.0:1788986833.526507:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:3.0:1788986833.526517:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:98220:x1875885993631232:12345-0@lo:104: 00010000:00010000:3.0:1788986833.526532:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549f38 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.526604:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986833.526611:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:98220:x1875885993631232:12345-0@lo:104: Request processed in 97us (1563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986833.526618:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:1.0:1788986833.526687:0:98220:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98220:1875885993631232:0@lo:104: 00010000:00010000:1.0:1788986833.526721:0:98220:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986833.526896:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986833.526905:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549f38 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986833.526923:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986833.526927:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549f38 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986833.526937:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549f38 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986833.526945:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549f38 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986833.526951:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986833.526983:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f38 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986833.526990:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986833.527008:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f38 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986833.527015:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf549f31 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f38 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986833.527037:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986833.527038:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986833.527040:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986833.527052:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993631360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986833.527116:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986833.527635:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993631360 00000100:00100000:3.0:1788986833.527641:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993631360 00010000:00010000:3.0:1788986833.527663:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f38 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549f31 expref: 19 pid: 5849 timeout: 2717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986833.527859:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 454 00000100:00100000:3.0:1788986833.527869:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993631360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986833.527880:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986833.527886:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f38 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549f31 expref: 19 pid: 5849 timeout: 2717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.527898:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f38 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549f31 expref: 19 pid: 5849 timeout: 2717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.527974:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf549f38 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549f31 expref: 19 pid: 5849 timeout: 2717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.527989:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.527997:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.528012:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.528019:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.528026:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.528032:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.528037:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986833.528041:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.528048:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.528068:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986833.528079:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986833.528149:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993631360:12345-0@lo:103:ldlm_bl.0 Request processed in 281us (1032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986833.528156:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 454 00000100:00100000:2.0:1788986833.528229:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993631360:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986833.528310:0:98220:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986833.528320:0:98220:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986833.528327:0:98220:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f3f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98220 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986833.987943:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986834.035301:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986834.035347:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986834.035415:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971420800 00000100:00100000:3.0:1788986834.035425:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971420800 00000100:00100000:3.0:1788986834.035529:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1868 00000100:00100000:3.0:1788986834.035538:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971420800:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986834.035604:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971420800:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986834.035612:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1868 00000100:00100000:1.0:1788986834.037113:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971420672 00000100:00100000:1.0:1788986834.037122:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971420672 00000100:00100000:1.0:1788986834.037179:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1433 00000100:00100000:1.0:1788986834.037189:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971420672:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986834.037244:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971420672:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 56us (1896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986834.037251:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1433 00000100:00080000:0.0:1788986834.039082:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1788986834.256585:0:98268:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffde0d05c80 20000000:00000080:3.0:1788986834.256601:0:98268:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a4631b000 uarg=0000000000000000 10000000:01000000:3.0:1788986834.256890:0:98268:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986834.256910:0:98268:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f46 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.256926:0:98268:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f46 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.256938:0:98268:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f46 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.256945:0:98268:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f46 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.256951:0:98268:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f46 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.256959:0:98268:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f46 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.256964:0:98268:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986834.256968:0:98268:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f46 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.256975:0:98268:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f46 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.256987:0:98268:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f46 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.256994:0:98268:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f46 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.257000:0:98268:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f46 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98268 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986834.880202:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986834.880210:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986834.880215:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986834.880276:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.880296:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.880310:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986834.880334:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80913b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993631488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986834.880403:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986834.880474:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76628a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788986834.880652:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993631488 00000100:00100000:2.0:1788986834.880661:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993631488 00000100:00100000:2.0:1788986834.880715:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:2.0:1788986834.880724:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993631488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986834.880736:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986834.880748:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549f54 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549f4d expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986834.880770:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549f54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549f4d expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986834.880780:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549f54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549f4d expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986834.880790:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0c00, rc 0) 00000100:00100000:2.0:1788986834.880846:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993631488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986834.880853:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:3.0:1788986834.881125:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80913b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993631488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986834.881141:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f54 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.881149:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549f54 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986834.881166:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986834.881171:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f54 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986834.881179:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f54 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986835.009527:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986835.971210:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986835.971229:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993631616:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986835.971293:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986835.971347:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993631616 00000100:00100000:3.0:1788986835.971353:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993631616 00000100:00100000:3.0:1788986835.971396:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:3.0:1788986835.971404:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993631616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986835.971438:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986835.971480:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993631616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986835.971487:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00080000:3.0:1788986835.971504:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986835.971538:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993631616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986836.038211:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986836.992935:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993632000:0@lo:400:kworker.0 00000100:00100000:2.0:1788986836.993001:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986836.993058:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788986836.993064:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993631872:0@lo:400:kworker.0 00000100:00100000:2.0:1788986836.993103:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986836.993122:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993632384:0@lo:400:kworker.0 00000100:00100000:2.0:1788986836.993158:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986836.993191:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993632000 00000100:00100000:2.0:1788986836.993200:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993632000 00000100:00100000:2.0:1788986836.993256:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993631872 00000100:00100000:2.0:1788986836.993260:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993631872 00000100:00100000:2.0:1788986836.993286:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1869 00000100:00100000:2.0:1788986836.993293:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993632000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986836.993338:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993632000:12345-0@lo:400:kworker.0 Request processed in 46us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986836.993346:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1869 00000100:00100000:2.0:1788986836.993364:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1870 00000100:00100000:2.0:1788986836.993370:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993631872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986836.993398:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993631872:12345-0@lo:400:kworker.0 Request processed in 28us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986836.993404:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1870 00000100:00100000:2.0:1788986836.993424:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993632384 00000100:00100000:2.0:1788986836.993428:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993632384 00000100:00100000:2.0:1788986836.993450:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1415 00000100:00100000:2.0:1788986836.993457:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993632384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986836.993486:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993632384:12345-0@lo:400:kworker.0 Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986836.993492:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1415 00000100:00080000:2.0:1788986836.993507:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986836.993511:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986836.993547:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80cc8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993631872:0@lo:400:kworker.0 00000100:00100000:2.0:1788986836.993559:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993632384:0@lo:400:kworker.0 00000100:00100000:2.0:1788986836.993567:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993632000:0@lo:400:kworker.0 00000100:00100000:0.0:1788986836.993738:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993631744:0@lo:400:kworker.0 00000100:00100000:0.0:1788986836.993771:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986836.993797:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993632256:0@lo:400:kworker.0 00000100:00100000:0.0:1788986836.993832:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986836.993851:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986836.993857:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993632128:0@lo:400:kworker.0 00000100:00100000:0.0:1788986836.993878:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986836.993904:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993631744 00000100:00100000:0.0:1788986836.993908:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993631744 00000100:00100000:0.0:1788986836.993935:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1788986836.993942:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993631744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986836.993974:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993631744:12345-0@lo:400:kworker.0 Request processed in 33us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986836.993980:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1435 00000100:00100000:0.0:1788986836.994005:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993632256 00000100:00100000:0.0:1788986836.994009:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993632256 00000100:00100000:0.0:1788986836.994036:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1871 00000100:00100000:0.0:1788986836.994042:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993632256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986836.994070:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993632256:12345-0@lo:400:kworker.0 Request processed in 28us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986836.994075:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1871 00000100:00100000:0.0:1788986836.994112:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993632128 00000100:00100000:0.0:1788986836.994116:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993632128 00000100:00100000:0.0:1788986836.994151:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1416 00000100:00100000:0.0:1788986836.994158:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993632128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986836.994187:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993632128:12345-0@lo:400:kworker.0 Request processed in 29us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986836.994192:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1416 00000100:00080000:0.0:1788986836.994211:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986836.994228:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993632128:0@lo:400:kworker.0 00000100:00100000:0.0:1788986836.994237:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ccb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993631744:0@lo:400:kworker.0 00000100:00100000:0.0:1788986836.994244:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993632256:0@lo:400:kworker.0 00010000:00010000:0.0:1788986837.058642:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986837.504298:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993632512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986837.504364:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986837.504426:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993632512 00000100:00100000:0.0:1788986837.504434:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993632512 00000100:00100000:0.0:1788986837.504487:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1788986837.504496:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993632512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986837.504626:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986837.504684:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993632512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 182us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986837.504692:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:3.0:1788986837.507270:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993632512:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1788986837.672951:0:98465:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee6d054a0 20000000:00000080:2.0:1788986837.672969:0:98465:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a44c52800 uarg=0000000000000000 00010000:00010000:2.0:1788986837.673840:0:98465:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986837.673865:0:98465:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986837.673878:0:98465:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986837.673895:0:98465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986837.673910:0:98465:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549f54 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549f4d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986837.673918:0:98465:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986837.673950:0:98465:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549f54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549f4d expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986837.673965:0:98465:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549f54 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549f4d expref: 18 pid: 5846 timeout: 2721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986837.673979:0:98465:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe41f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98465:1875885993632640:0@lo:104: 00000100:00100000:2.0:1788986837.674036:0:98465:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986837.674226:0:98465:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76582e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788986837.674290:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993632640 00000100:00100000:0.0:1788986837.674297:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993632640 00000100:00100000:0.0:1788986837.674352:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 389 00000100:00100000:0.0:1788986837.674362:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:98465:x1875885993632640:12345-0@lo:104: 00010000:00010000:0.0:1788986837.674374:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549f54 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986837.674442:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986837.674448:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:98465:x1875885993632640:12345-0@lo:104: Request processed in 89us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986837.674455:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 389 00010000:00010000:1.0:1788986837.674467:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986837.674474:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549f54 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986837.674481:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986837.674485:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549f54 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986837.674494:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549f54 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986837.674501:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549f54 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986837.674507:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986837.674542:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f54 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986837.674552:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788986837.674562:0:98465:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe41f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98465:1875885993632640:0@lo:104: 00010000:00010000:1.0:1788986837.674579:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f54 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986837.674582:0:98465:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986837.674587:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2200/0xc20d828fcf549f4d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f54 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986837.674603:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986837.674605:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986837.674607:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986837.674613:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986837.674634:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993632768:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986837.674665:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986837.674707:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993632768 00000100:00100000:3.0:1788986837.674711:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993632768 00010000:00010000:3.0:1788986837.674731:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549f54 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549f4d expref: 19 pid: 5846 timeout: 2721 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986837.674761:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 455 00000100:00100000:3.0:1788986837.674768:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993632768:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986837.674778:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986837.674783:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549f54 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549f4d expref: 19 pid: 5846 timeout: 2721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986837.674792:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549f54 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549f4d expref: 19 pid: 5846 timeout: 2721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986837.674812:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf549f54 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549f4d expref: 19 pid: 5846 timeout: 2721 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986837.674826:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986837.674834:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986837.674847:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986837.674865:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986837.674872:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986837.674878:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986837.674883:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986837.674886:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986837.674893:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986837.674912:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986837.674921:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986837.674959:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993632768:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986837.674967:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 455 00010000:00010000:0.0:1788986837.675075:0:98465:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986837.675083:0:98465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986837.675122:0:98465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf549f5b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986837.675146:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993632768:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788986838.081693:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986839.111236:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986839.152662:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986839.152711:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986839.152781:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971420928 00000100:00100000:1.0:1788986839.152790:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971420928 00000100:00100000:1.0:1788986839.152850:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1436 00000100:00100000:1.0:1788986839.152859:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971420928:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986839.152931:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971420928:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 73us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986839.152938:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1436 00000100:00100000:2.0:1788986839.153388:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971421056 00000100:00100000:2.0:1788986839.153393:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971421056 00000100:00100000:2.0:1788986839.153449:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1872 00000100:00100000:2.0:1788986839.153456:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971421056:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986839.153490:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971421056:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 36us (780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986839.153496:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1872 00000100:00080000:1.0:1788986839.153594:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:0.0:1788986839.424167:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986839.424174:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986839.424179:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986839.424220:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986839.424232:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986839.424242:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986839.424277:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993632896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986839.424337:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986839.424386:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eacd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788986839.424415:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993632896 00000100:00100000:2.0:1788986839.424423:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993632896 00000100:00100000:2.0:1788986839.424630:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:2.0:1788986839.424641:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993632896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986839.424653:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986839.424679:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1e00/0xc20d828fcf549f69 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549f62 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986839.424702:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1e00/0xc20d828fcf549f69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549f62 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986839.424851:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1e00/0xc20d828fcf549f69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549f62 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986839.424861:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1e00, rc 0) 00000100:00100000:2.0:1788986839.424907:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993632896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 269us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986839.424917:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:0.0:1788986839.425675:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993632896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986839.425694:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f69 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986839.425704:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549f69 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986839.425806:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986839.425814:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f69 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986839.425823:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f69 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986840.128548:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986840.178288:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986840.178323:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971421184 00000100:00100000:3.0:1788986840.178331:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971421184 00000100:00100000:3.0:1788986840.178383:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1100 00000100:00100000:3.0:1788986840.178392:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971421184:12345-192.168.206.21@tcp:17:kworker.0 00000100:00100000:3.0:1788986840.178493:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971421184:12345-192.168.206.21@tcp:17:kworker.0 Request processed in 101us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986840.178500:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1100 00000100:00100000:3.0:1788986841.090429:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986841.090452:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993633024:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986841.090510:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986841.090846:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993633024 00000100:00100000:1.0:1788986841.090855:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993633024 00000100:00100000:1.0:1788986841.090907:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:1.0:1788986841.090916:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993633024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986841.090950:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986841.090998:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993633024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986841.091005:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:1.0:1788986841.091051:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993633024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986841.091243:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986841.153304:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788986841.252839:0:98662:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffed43aaa00 20000000:00000080:0.0:1788986841.252858:0:98662:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a8090f400 uarg=0000000000000000 00010000:00010000:1.0:1788986841.253955:0:98662:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788986841.253972:0:98662:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788986841.253987:0:98662:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986841.254006:0:98662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986841.254023:0:98662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1e00/0xc20d828fcf549f69 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549f62 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986841.254031:0:98662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986841.254067:0:98662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1e00/0xc20d828fcf549f69 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549f62 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986841.254081:0:98662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1e00/0xc20d828fcf549f69 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549f62 expref: 18 pid: 5846 timeout: 2725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986841.254195:0:98662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98662:1875885993633152:0@lo:104: 00000100:00100000:1.0:1788986841.254252:0:98662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986841.254455:0:98662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c43c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788986841.254503:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993633152 00000100:00100000:3.0:1788986841.254510:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993633152 00000100:00100000:3.0:1788986841.254673:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:3.0:1788986841.254682:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:98662:x1875885993633152:12345-0@lo:104: 00010000:00010000:3.0:1788986841.254695:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549f69 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986841.254759:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986841.254765:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:98662:x1875885993633152:12345-0@lo:104: Request processed in 85us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986841.254772:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00010000:00010000:2.0:1788986841.254836:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986841.254844:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549f69 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.254851:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986841.254855:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549f69 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.254863:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549f69 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986841.254869:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549f69 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986841.254874:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986841.254905:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f69 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.254912:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986841.254934:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f69 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.254940:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef200/0xc20d828fcf549f62 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f69 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.254955:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986841.254957:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986841.254958:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986841.254977:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993633280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986841.255008:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986841.255046:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993633280 00000100:00100000:2.0:1788986841.255050:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993633280 00010000:00010000:2.0:1788986841.255068:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1e00/0xc20d828fcf549f69 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549f62 expref: 19 pid: 5846 timeout: 2725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986841.255111:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1788986841.255118:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993633280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986841.255128:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986841.255133:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1e00/0xc20d828fcf549f69 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549f62 expref: 19 pid: 5846 timeout: 2725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.255143:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1e00/0xc20d828fcf549f69 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549f62 expref: 19 pid: 5846 timeout: 2725 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.255158:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.255165:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.255177:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.255184:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.255190:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.255201:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.255206:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986841.255210:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.255217:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.255225:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986841.255235:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986841.255277:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993633280:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986841.255284:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 456 00000100:00100000:2.0:1788986841.255329:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993633280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986841.255548:0:98662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1e00/0xc20d828fcf549f69 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549f62 expref: 18 pid: 5846 timeout: 2725 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986841.255563:0:98662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:98662:1875885993633152:0@lo:104: 00010000:00010000:1.0:1788986841.255575:0:98662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986841.255584:0:98662:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986841.255590:0:98662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986841.255596:0:98662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf549f70 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788986842.057864:0:98711:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff80c28460 20000000:00000080:0.0:1788986842.057883:0:98711:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f8bac00 uarg=0000000000000000 00010000:00010000:0.0:1788986842.058351:0:98711:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986842.058366:0:98711:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986842.058379:0:98711:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986842.058397:0:98711:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f77 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 98711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986842.058412:0:98711:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f77 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 98711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986842.058422:0:98711:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f77 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 98711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986842.058429:0:98711:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f77 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986842.058436:0:98711:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f77 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 98711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986842.058449:0:98711:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f77 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986842.058455:0:98711:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986842.058459:0:98711:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f77 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 98711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986842.058468:0:98711:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f77 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 98711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986842.058479:0:98711:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f77 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986842.058486:0:98711:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f77 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986842.058492:0:98711:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf549f77 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 98711 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986842.112512:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993633408:0@lo:400:kworker.0 00000100:00100000:3.0:1788986842.112579:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986842.112632:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993633920:0@lo:400:kworker.0 00000100:00100000:0.0:1788986842.112750:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993633408 00000100:00100000:0.0:1788986842.112758:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993633408 00000100:00100000:0.0:1788986842.112811:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:0.0:1788986842.112820:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993633408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986842.113157:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09425f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993633792:0@lo:400:kworker.0 00000100:00100000:1.0:1788986842.113289:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a42c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993633536:0@lo:400:kworker.0 00000100:00100000:0.0:1788986842.113735:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993633408:12345-0@lo:400:kworker.0 Request processed in 915us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986842.113744:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00100000:2.0:1788986842.114137:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986842.117199:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993633792 00000100:00100000:0.0:1788986842.117212:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993633792 00000100:00100000:0.0:1788986842.117271:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1788986842.117280:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993633792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986842.117355:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993633792:12345-0@lo:400:kworker.0 Request processed in 77us (3219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986842.117361:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1417 00000100:00100000:0.0:1788986842.117552:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09425f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993633792:0@lo:400:kworker.0 00000100:00100000:0.0:1788986842.119005:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993633664:0@lo:400:kworker.0 00000100:00100000:0.0:1788986842.119066:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986842.119130:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993633664 00000100:00100000:0.0:1788986842.119136:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993633664 00000100:00100000:0.0:1788986842.119189:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1873 00000100:00100000:0.0:1788986842.119198:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993633664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986842.119244:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09425f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993633664:12345-0@lo:400:kworker.0 Request processed in 48us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986842.119263:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1873 00000100:00100000:0.0:1788986842.119303:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993633664:0@lo:400:kworker.0 00000100:00100000:3.0:1788986842.119865:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788986842.119939:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986842.121448:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993633408:0@lo:400:kworker.0 00000100:00100000:1.0:1788986842.123408:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986842.126910:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993634048:0@lo:400:kworker.0 00000100:00100000:1.0:1788986842.126977:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986842.127032:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993634048 00000100:00100000:1.0:1788986842.127039:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993634048 00000100:00100000:1.0:1788986842.127111:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1788986842.127120:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993634048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986842.127171:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993634048:12345-0@lo:400:kworker.0 Request processed in 52us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986842.127177:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1418 00000100:00100000:1.0:1788986842.127235:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993634048:0@lo:400:kworker.0 00000100:00100000:0.0:1788986842.133345:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993633920 00000100:00100000:0.0:1788986842.133362:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993633920 00000100:00100000:1.0:1788986842.134492:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993633536 00000100:00100000:1.0:1788986842.134501:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993633536 00000100:00100000:1.0:1788986842.134529:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1874 00000100:00100000:1.0:1788986842.134539:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993633920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986842.134623:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993633920:12345-0@lo:400:kworker.0 Request processed in 86us (14758us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986842.134631:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1874 00000100:00100000:1.0:1788986842.134649:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1875 00000100:00100000:1.0:1788986842.135428:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993633536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986842.135481:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993633536:12345-0@lo:400:kworker.0 Request processed in 61us (12080us total) trans 0 rc 0/0 00000100:00080000:3.0:1788986842.138578:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986842.138589:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986842.138643:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993633920:0@lo:400:kworker.0 00000100:00100000:1.0:1788986842.142206:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1875 00000100:00100000:1.0:1788986842.142345:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a42c7bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993633536:0@lo:400:kworker.0 00010000:00010000:2.0:1788986842.177270:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986842.625444:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986842.625464:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993634176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986842.625528:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986842.625658:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993634176 00000100:00100000:3.0:1788986842.625665:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993634176 00000100:00100000:3.0:1788986842.625709:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:3.0:1788986842.625717:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993634176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986842.625747:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986842.625807:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993634176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986842.625814:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:3.0:1788986842.625861:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993634176:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1788986842.882178:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986842.882186:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986842.882190:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986842.882236:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986842.882248:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986842.882259:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986842.882284:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993634304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986842.882348:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986842.882398:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a450316c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986842.883425:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993634304 00000100:00100000:1.0:1788986842.883434:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993634304 00000100:00100000:1.0:1788986842.883491:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1439 00000100:00100000:1.0:1788986842.883500:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993634304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986842.883516:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986842.883530:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf549f85 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549f7e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986842.883553:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf549f85 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549f7e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986842.883564:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf549f85 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549f7e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986842.883572:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d49800, rc 0) 00000100:00100000:1.0:1788986842.883623:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993634304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (1275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986842.883630:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1439 00000100:00100000:2.0:1788986842.889249:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe40000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993634304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986842.889276:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f85 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986842.889288:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549f85 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986842.889310:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788986842.889316:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f85 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986842.889324:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549f85 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986843.205533:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986844.225142:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986844.276926:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986844.276972:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986844.277124:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971421312 00000100:00100000:2.0:1788986844.277134:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971421312 00000100:00100000:2.0:1788986844.277179:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1440 00000100:00100000:2.0:1788986844.277189:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971421312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986844.277265:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971421312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986844.277273:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1440 00000100:00100000:0.0:1788986844.277676:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971421440 00000100:00100000:0.0:1788986844.277681:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971421440 00000100:00100000:0.0:1788986844.277736:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1876 00000100:00100000:0.0:1788986844.277746:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971421440:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986844.277797:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971421440:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 53us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986844.277804:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1876 00000100:00080000:3.0:1788986844.277854:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788986845.255319:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986846.209190:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986846.209216:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993634432:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986846.209306:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986846.209374:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993634432 00000100:00100000:1.0:1788986846.209382:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993634432 00000100:00100000:1.0:1788986846.209441:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:1.0:1788986846.209452:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993634432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986846.209495:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986846.209543:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993634432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986846.209551:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00080000:1.0:1788986846.209574:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986846.209611:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993634432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986846.276018:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986847.234608:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993634944:0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.234700:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986847.234780:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788986847.234787:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993634560:0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.234822:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986847.234849:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993635072:0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.234877:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986847.234908:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993634816:0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.234932:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986847.234953:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788986847.234959:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993634688:0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.234980:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986847.235000:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993635200:0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.235024:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986847.235058:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993634944 00000100:00100000:0.0:1788986847.235068:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993634944 00000100:00100000:0.0:1788986847.235150:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993635200 00000100:00100000:0.0:1788986847.235153:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993635200 00000100:00100000:0.0:1788986847.235190:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1788986847.235199:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993634944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.235401:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993634944:12345-0@lo:400:kworker.0 Request processed in 201us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986847.235410:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1419 00000100:00100000:0.0:1788986847.235432:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1788986847.235440:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993635200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.235472:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993635200:12345-0@lo:400:kworker.0 Request processed in 33us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986847.235478:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1420 00000100:00100000:0.0:1788986847.235503:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993635072 00000100:00100000:0.0:1788986847.235507:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993635072 00000100:00100000:0.0:1788986847.235548:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993634816 00000100:00100000:0.0:1788986847.235551:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993634816 00000100:00100000:0.0:1788986847.235568:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993634688 00000100:00100000:0.0:1788986847.235571:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993634688 00000100:00100000:0.0:1788986847.235585:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1877 00000100:00100000:0.0:1788986847.235591:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993635072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.235623:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993635072:12345-0@lo:400:kworker.0 Request processed in 31us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986847.235629:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1877 00000100:00100000:0.0:1788986847.235641:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1878 00000100:00100000:0.0:1788986847.235648:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993634816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.235674:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993634816:12345-0@lo:400:kworker.0 Request processed in 27us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986847.235679:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1878 00000100:00100000:0.0:1788986847.235693:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1879 00000100:00100000:0.0:1788986847.235699:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993634688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.235727:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993634688:12345-0@lo:400:kworker.0 Request processed in 29us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986847.235732:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1879 00000100:00080000:0.0:1788986847.235766:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986847.235771:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986847.235811:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993635072:0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.235824:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993634944:0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.235865:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993634688:0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.235874:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993635200:0@lo:400:kworker.0 00000100:00100000:0.0:1788986847.235883:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993634816:0@lo:400:kworker.0 00000100:00100000:3.0:1788986847.237263:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993634560 00000100:00100000:3.0:1788986847.237279:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993634560 00000100:00100000:3.0:1788986847.237353:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:3.0:1788986847.237363:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993634560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986847.237640:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993634560:12345-0@lo:400:kworker.0 Request processed in 277us (2815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986847.237722:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:0.0:1788986847.238365:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993634560:0@lo:400:kworker.0 00010000:00010000:3.0:1788986847.297202:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788986847.699634:0:99004:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0675dcc0 20000000:00000080:0.0:1788986847.699664:0:99004:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a8090d800 uarg=0000000000000000 10000000:01000000:0.0:1788986847.699728:0:99004:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986847.699772:0:99004:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986847.699795:0:99004:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf549f85 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549f7e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986847.699805:0:99004:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986847.699861:0:99004:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf549f85 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549f7e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986847.699879:0:99004:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf549f85 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549f7e expref: 18 pid: 5846 timeout: 2731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986847.699897:0:99004:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99004:1875885993635328:0@lo:104: 00000100:00100000:0.0:1788986847.699992:0:99004:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986847.700068:0:99004:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a511f3780 going to sleep for 11 seconds 00000100:00100000:3.0:1788986847.700423:0:7642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788986847.700441:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993635328 00000100:00100000:3.0:1788986847.700450:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993635328 00000100:00100000:3.0:1788986847.700692:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 391 00000100:00100000:3.0:1788986847.700704:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a76003850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:99004:x1875885993635328:12345-0@lo:104: 00010000:00010000:3.0:1788986847.700721:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549f85 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986847.700817:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986847.700824:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a76003850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:99004:x1875885993635328:12345-0@lo:104: Request processed in 123us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986847.700832:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 391 00000100:00100000:1.0:1788986847.700976:0:99004:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99004:1875885993635328:0@lo:104: 00010000:00010000:1.0:1788986847.701003:0:99004:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.701041:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986847.701047:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549f85 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.701055:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986847.701061:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549f85 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.701070:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549f85 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986847.701079:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549f85 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986847.701117:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986847.701159:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f85 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.701165:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986847.701186:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f85 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.701194:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf549f7e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549f85 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.701210:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986847.701212:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986847.701214:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986847.701278:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986847.701293:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993635456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986847.701333:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986847.701937:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993635456 00000100:00100000:1.0:1788986847.701946:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993635456 00010000:00010000:1.0:1788986847.701985:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf549f85 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549f7e expref: 19 pid: 5846 timeout: 2731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986847.702028:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 457 00000100:00100000:1.0:1788986847.702037:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993635456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986847.702062:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986847.702069:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf549f85 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549f7e expref: 19 pid: 5846 timeout: 2731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.702081:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf549f85 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549f7e expref: 19 pid: 5846 timeout: 2731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.702138:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf549f85 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549f7e expref: 19 pid: 5846 timeout: 2731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.702155:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.702163:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.702182:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.702189:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.702195:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.702202:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.702207:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986847.702211:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.702218:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.702237:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986847.702247:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986847.702302:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943858000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993635456:12345-0@lo:103:ldlm_bl.0 Request processed in 266us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986847.702309:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 457 00010000:00010000:0.0:1788986847.702398:0:99004:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986847.702411:0:99004:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986847.702417:0:99004:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf549f8c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99004 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986847.704649:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993635456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986847.745356:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993635584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986847.745449:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986847.746814:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993635584 00000100:00100000:3.0:1788986847.746829:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993635584 00000100:00100000:3.0:1788986847.746904:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:3.0:1788986847.746916:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993635584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986847.746966:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986847.747063:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993635584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (1614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986847.747071:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:2.0:1788986847.747364:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80907800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993635584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986848.323233:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986848.563367:0:99052:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd72bcbb00 20000000:00000080:3.0:1788986848.563383:0:99052:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7fe75400 uarg=0000000000000000 10000000:01000000:3.0:1788986848.563425:0:99052:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986848.563445:0:99052:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f93 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986848.563461:0:99052:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f93 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986848.563471:0:99052:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f93 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986848.563477:0:99052:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f93 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986848.563485:0:99052:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f93 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986848.563493:0:99052:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f93 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986848.563499:0:99052:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986848.563504:0:99052:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f93 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986848.563511:0:99052:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f93 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986848.563522:0:99052:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f93 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986848.563529:0:99052:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f93 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986848.563536:0:99052:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549f93 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99052 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986849.344275:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986849.394849:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986849.394895:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986849.394928:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971421696 00000100:00100000:1.0:1788986849.394937:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971421696 00000100:00100000:1.0:1788986849.394992:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1880 00000100:00100000:1.0:1788986849.395001:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971421696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986849.395082:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971421696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 82us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986849.395108:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1880 00000100:00080000:1.0:1788986849.395130:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986849.395276:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971421568 00000100:00100000:2.0:1788986849.395282:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971421568 00000100:00100000:2.0:1788986849.395315:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1442 00000100:00100000:2.0:1788986849.395322:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971421568:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986849.395356:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971421568:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986849.395362:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1442 10000000:01000000:0.0:1788986849.476496:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986849.476505:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986849.476510:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986849.476554:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986849.476565:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986849.476575:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986849.476600:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993635712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986849.476661:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986849.477311:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7feffc00 going to sleep for 11 seconds 00000100:00100000:3.0:1788986849.477371:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993635712 00000100:00100000:3.0:1788986849.477378:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993635712 00000100:00100000:3.0:1788986849.477496:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1443 00000100:00100000:3.0:1788986849.477507:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993635712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986849.477521:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986849.477536:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549fa1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf549f9a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986849.477559:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549fa1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf549f9a expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986849.477569:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549fa1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549f9a expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986849.477576:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788986849.477627:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993635712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986849.477634:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1443 00000100:00100000:0.0:1788986849.478343:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993635712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986849.478366:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549fa1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986849.478375:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf549fa1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986849.478465:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986849.478473:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549fa1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986849.478482:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf549fa1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986850.374178:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986851.328396:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986851.328418:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993635840:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986851.328483:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986851.328596:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993635840 00000100:00100000:1.0:1788986851.328604:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993635840 00000100:00100000:1.0:1788986851.328667:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:1.0:1788986851.328677:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993635840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986851.328711:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986851.328768:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993635840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986851.328778:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:3.0:1788986851.328865:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993635840:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986851.329404:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986851.395363:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986851.909760:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986851.909852:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971421824 00000100:00100000:0.0:1788986851.909862:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971421824 00000100:00100000:0.0:1788986851.909932:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1101 00000100:00100000:0.0:1788986851.909943:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58033:x1875885971421824:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986851.909962:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986851.909984:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549fa8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15b4 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986851.910046:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf549faf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986851.910061:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf549faf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986851.910073:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf549faf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986851.910140:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788986851.910144:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986851.910167:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf549faf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986851.910190:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549fa8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15b4 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986851.910220:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf549faf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15b4 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986851.910229:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:0.0:1788986851.910232:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986851.910236:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee400, rc 0) 00000100:00100000:0.0:1788986851.910291:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58033:x1875885971421824:12345-192.168.206.21@tcp:101:rm.0 Request processed in 350us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986851.910298:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1101 00000100:00080000:1.0:1788986851.910355:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986851.913548:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986851.913633:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971421952 00000100:00100000:3.0:1788986851.913642:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971421952 00000100:00100000:3.0:1788986851.913696:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1102 00000100:00100000:3.0:1788986851.913706:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58033:x1875885971421952:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986851.913724:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986851.913752:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549fb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15bb expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.913805:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549fbd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.913819:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549fbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.913830:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549fbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.913844:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fc4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.913850:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.913856:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914053:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549fbd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914061:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549fbd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914068:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549fbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914079:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986851.914084:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549fbd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914120:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549fbd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914132:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:3.0:1788986851.914136:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986851.914140:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549fbd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914146:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549fbd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914160:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fc4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914165:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fc4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914171:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914176:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986851.914179:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fc4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914185:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fc4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914195:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a55745700) 00010000:00010000:3.0:1788986851.914198:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986851.914201:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fc4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914216:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fc4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914243:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549fb6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15bb expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914253:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:3.0:1788986851.914256:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986851.914260:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549fb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15bb expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.914269:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788986851.914330:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58033:x1875885971421952:12345-192.168.206.21@tcp:101:rm.0 Request processed in 625us (791us total) trans 0 rc 301/301 00000100:00100000:3.0:1788986851.914337:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1102 00000100:00100000:2.0:1788986851.962870:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986851.962912:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986851.963003:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971422336 00000100:00100000:1.0:1788986851.963013:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971422336 00000100:00100000:1.0:1788986851.963067:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971422080 00000100:00100000:1.0:1788986851.963071:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971422080 00000100:00100000:1.0:1788986851.963127:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1103 00000100:00100000:1.0:1788986851.963142:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58037:x1875885971422336:12345-192.168.206.21@tcp:36:mkdir.0 00010000:00010000:1.0:1788986851.963197:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986851.963233:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf549faf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15b4 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986851.963254:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b300) 00010000:00010000:1.0:1788986851.963265:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986851.963464:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549fcb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986851.963478:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549fcb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986851.963489:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549fcb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986851.963500:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549fd2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986851.963507:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986851.963519:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986851.964411:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00010000:00010000:1.0:1788986851.964424:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549fcb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986851.964432:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549fcb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986851.964440:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549fcb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986851.964446:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d49800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986851.964450:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549fcb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986851.964458:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549fcb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986851.964469:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316600) 00010000:00010000:1.0:1788986851.964472:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986851.964476:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549fcb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986851.964482:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf549fcb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986851.964498:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000c880835c reply state 0000000089bbc499 transno 4294967712 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986851.964510:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986851.964597:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58037:x1875885971422336:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 1458us (1734us total) trans 4294967712 rc 0/0 00000100:00100000:1.0:1788986851.964605:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1103 00000100:00100000:1.0:1788986851.964634:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1104 00000100:00100000:1.0:1788986851.964646:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971422080:12345-192.168.206.21@tcp:41:mkdir.0 00000004:00000024:1.0:1788986851.964672:0:7899:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788986851.964698:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971422080:12345-192.168.206.21@tcp:41:mkdir.0 Request processed in 56us (1785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986851.964705:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1104 00010000:00010000:3.0:1788986851.966610:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549fd2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.966626:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549fd2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.966634:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549fd2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.966646:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986851.966650:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549fd2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.966658:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549fd2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.966674:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a45316900) 00010000:00010000:3.0:1788986851.966677:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986851.966682:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549fd2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986851.966688:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf549fd2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986852.015711:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986852.015909:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971422464 00000100:00100000:0.0:1788986852.015919:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971422464 00000100:00100000:0.0:1788986852.015986:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1105 00000100:00100000:0.0:1788986852.015995:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58041:x1875885971422464:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:0.0:1788986852.016019:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986852.016040:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549fd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15c2 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986852.016133:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf549fe0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986852.016148:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf549fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986852.016159:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf549fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986852.016191:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788986852.016196:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986852.016217:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf549fe0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986852.016239:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf549fd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15c2 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986852.016258:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf549fe0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15c2 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986852.016267:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:0.0:1788986852.016269:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986852.016273:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef200, rc 0) 00000100:00100000:0.0:1788986852.016325:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58041:x1875885971422464:12345-192.168.206.21@tcp:101:chown.0 Request processed in 330us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986852.016332:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1105 00000100:00100000:2.0:1788986852.022147:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986852.022241:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971422592 00000100:00100000:3.0:1788986852.022251:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971422592 00000100:00100000:3.0:1788986852.022305:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1106 00000100:00100000:3.0:1788986852.022315:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58041:x1875885971422592:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:3.0:1788986852.022335:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986852.022357:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549fe7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15c9 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022412:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022426:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022441:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022455:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549ff5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022461:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022468:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022572:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf549ffc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022581:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf549ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022589:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf549ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986852.022619:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:3.0:1788986852.022623:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986852.022645:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf549ffc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022657:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022663:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022674:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022680:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986852.022684:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022691:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022702:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:3.0:1788986852.022705:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986852.022710:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022716:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf549fee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022739:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549ff5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022746:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549ff5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022752:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022757:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986852.022760:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549ff5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022771:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549ff5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022778:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a55745700) 00010000:00010000:3.0:1788986852.022781:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986852.022784:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549ff5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022790:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf549ff5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022817:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf549fe7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15c9 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022830:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf549ffc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15c9 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.022838:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745400) 00010000:00010000:3.0:1788986852.022841:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986852.022843:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2a00, rc 0) 00000100:00100000:3.0:1788986852.022901:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58041:x1875885971422592:12345-192.168.206.21@tcp:101:chown.0 Request processed in 586us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986852.022908:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1106 00000100:00100000:2.0:1788986852.028764:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986852.028840:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971422848 00000100:00100000:3.0:1788986852.028849:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971422848 00000100:00100000:3.0:1788986852.028908:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1107 00000100:00100000:3.0:1788986852.028919:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58041:x1875885971422848:12345-192.168.206.21@tcp:36:chown.0 00010000:00010000:3.0:1788986852.028966:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986852.028990:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf549ffc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15c9 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.029008:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745400) 00010000:00010000:3.0:1788986852.029017:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986852.029041:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a003 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.029052:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.029061:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986852.029271:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000eba4e4aa reply state 00000000d688bc66 transno 4294967713 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986852.029279:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986852.029286:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000100:00100000:3.0:1788986852.029365:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:58041:x1875885971422848:12345-192.168.206.21@tcp:36:chown.0 Request processed in 447us (608us total) trans 4294967713 rc 0/0 00000100:00100000:3.0:1788986852.029372:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1107 00010000:00010000:3.0:1788986852.031508:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a003 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.031525:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a003 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.031534:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a003 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.031541:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986852.031546:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a003 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.031554:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a003 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.031569:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:3.0:1788986852.031572:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986852.031578:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a003 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.031584:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a003 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986852.352418:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993636224:0@lo:400:kworker.0 00000100:00100000:0.0:1788986852.352494:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986852.352549:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986852.352556:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993636352:0@lo:400:kworker.0 00000100:00100000:0.0:1788986852.352598:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986852.352635:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993636224 00000100:00100000:0.0:1788986852.352642:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993636224 00000100:00100000:0.0:1788986852.352694:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1881 00000100:00100000:0.0:1788986852.352704:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993636224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986852.352769:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993636224:12345-0@lo:400:kworker.0 Request processed in 66us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986852.352776:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1881 00000100:00100000:0.0:1788986852.352799:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993636352 00000100:00100000:0.0:1788986852.352802:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993636352 00000100:00100000:0.0:1788986852.352840:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1421 00000100:00100000:0.0:1788986852.352846:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993636352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986852.352877:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993636352:12345-0@lo:400:kworker.0 Request processed in 31us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986852.352883:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1421 00000100:00080000:0.0:1788986852.352899:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986852.352932:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993636352:0@lo:400:kworker.0 00000100:00100000:0.0:1788986852.352943:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993636224:0@lo:400:kworker.0 00000100:00100000:2.0:1788986852.353169:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993636096:0@lo:400:kworker.0 00000100:00100000:2.0:1788986852.353200:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986852.353228:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993636608:0@lo:400:kworker.0 00000100:00100000:2.0:1788986852.353248:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986852.353267:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788986852.353273:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993635968:0@lo:400:kworker.0 00000100:00100000:2.0:1788986852.353300:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986852.353324:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993636480:0@lo:400:kworker.0 00000100:00100000:2.0:1788986852.353343:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986852.353383:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993636608 00000100:00100000:2.0:1788986852.353387:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993636608 00000100:00100000:2.0:1788986852.353421:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1788986852.353428:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993636608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986852.353465:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993636608:12345-0@lo:400:kworker.0 Request processed in 38us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986852.353471:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1422 00000100:00100000:2.0:1788986852.353489:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993635968 00000100:00100000:2.0:1788986852.353493:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993635968 00000100:00100000:2.0:1788986852.353516:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1788986852.353523:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993635968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986852.353552:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993635968:12345-0@lo:400:kworker.0 Request processed in 30us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986852.353558:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1444 00000100:00100000:2.0:1788986852.353582:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993636096 00000100:00100000:2.0:1788986852.353586:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993636096 00000100:00100000:2.0:1788986852.353606:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993636480 00000100:00100000:2.0:1788986852.353609:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993636480 00000100:00100000:2.0:1788986852.353628:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1882 00000100:00100000:2.0:1788986852.353634:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993636096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986852.353664:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993636096:12345-0@lo:400:kworker.0 Request processed in 30us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986852.353670:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1882 00000100:00100000:2.0:1788986852.353682:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1883 00000100:00100000:2.0:1788986852.353688:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993636480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986852.353716:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993636480:12345-0@lo:400:kworker.0 Request processed in 29us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986852.353722:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1883 00000100:00080000:2.0:1788986852.353756:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986852.353760:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986852.353793:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993635968:0@lo:400:kworker.0 00000100:00100000:2.0:1788986852.353814:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993636480:0@lo:400:kworker.0 00000100:00100000:2.0:1788986852.353826:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993636096:0@lo:400:kworker.0 00000100:00100000:2.0:1788986852.353836:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993636608:0@lo:400:kworker.0 00010000:00010000:0.0:1788986852.418742:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986852.864814:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986852.864835:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993636736:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986852.864900:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986852.864958:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993636736 00000100:00100000:0.0:1788986852.864965:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993636736 00000100:00100000:0.0:1788986852.865014:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1788986852.865024:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993636736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986852.865057:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986852.865129:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993636736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986852.865136:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1788986852.865319:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993636736:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788986852.942927:0:99248:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec6caaba0 20000000:00000080:0.0:1788986852.942947:0:99248:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a8090dc00 uarg=0000000000000000 10000000:01000000:0.0:1788986852.942988:0:99248:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986852.943007:0:99248:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986852.943024:0:99248:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549fa1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf549f9a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986852.943033:0:99248:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986852.943068:0:99248:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549fa1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf549f9a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986852.943082:0:99248:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549fa1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf549f9a expref: 18 pid: 5849 timeout: 2736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986852.943124:0:99248:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99248:1875885993636864:0@lo:104: 00000100:00100000:0.0:1788986852.943184:0:99248:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986852.943235:0:99248:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eac900 going to sleep for 11 seconds 00000100:00100000:3.0:1788986852.945012:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993636864 00000100:00100000:3.0:1788986852.945024:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993636864 00000100:00100000:3.0:1788986852.945085:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:3.0:1788986852.945111:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:99248:x1875885993636864:12345-0@lo:104: 00010000:00010000:3.0:1788986852.945127:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549fa1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945223:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986852.945230:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:99248:x1875885993636864:12345-0@lo:104: Request processed in 121us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986852.945238:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00010000:00010000:3.0:1788986852.945262:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986852.945268:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf549fa1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945279:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986852.945283:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf549fa1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945291:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf549fa1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986852.945296:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf549fa1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986852.945302:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986852.945337:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549fa1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945343:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986852.945363:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549fa1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945371:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508eee00/0xc20d828fcf549f9a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf549fa1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945387:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986852.945388:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986852.945390:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986852.945410:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993636992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986852.945444:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986852.945481:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993636992 00000100:00100000:3.0:1788986852.945485:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993636992 00010000:00010000:3.0:1788986852.945505:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549fa1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549f9a expref: 19 pid: 5849 timeout: 2736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986852.945527:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1788986852.945534:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45611c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993636992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986852.945544:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986852.945550:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549fa1 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf549f9a expref: 19 pid: 5849 timeout: 2736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945559:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549fa1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf549f9a expref: 19 pid: 5849 timeout: 2736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945574:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945582:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945609:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945617:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945624:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945630:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945635:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986852.945639:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945647:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945655:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986852.945663:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986852.945687:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45611c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993636992:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986852.945694:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 458 00000100:00100000:3.0:1788986852.945762:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993636992:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986852.945977:0:99248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf549fa1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf549f9a expref: 18 pid: 5849 timeout: 2736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986852.945990:0:99248:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439aea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:99248:1875885993636864:0@lo:104: 00010000:00010000:2.0:1788986852.946006:0:99248:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986852.946013:0:99248:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986852.946019:0:99248:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986852.946025:0:99248:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a00a lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99248 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986853.448163:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986853.869736:0:99296:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcb7a42ea0 20000000:00000080:3.0:1788986853.869759:0:99296:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7fb6e800 uarg=0000000000000000 10000000:01000000:3.0:1788986853.869819:0:99296:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986853.869846:0:99296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a011 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 99296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986853.869867:0:99296:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a011 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 99296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986853.869880:0:99296:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a011 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 99296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986853.869886:0:99296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a011 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986853.870325:0:99296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a011 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 99296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986853.870341:0:99296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a011 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986853.870349:0:99296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986853.870354:0:99296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a011 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 99296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986853.870363:0:99296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a011 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 99296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986853.870379:0:99296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a011 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986853.870389:0:99296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a011 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986853.870397:0:99296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a011 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 99296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986854.467682:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986854.526320:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986854.526388:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986854.526501:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971422976 00000100:00100000:1.0:1788986854.526514:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971422976 00000100:00100000:1.0:1788986854.526599:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1445 00000100:00100000:1.0:1788986854.526613:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971422976:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986854.526727:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971422976:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 118us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986854.526735:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1445 00000100:00100000:3.0:1788986854.529168:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971423104 00000100:00100000:3.0:1788986854.529491:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971423104 00000100:00080000:2.0:1788986854.530726:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986854.531313:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1884 00000100:00100000:3.0:1788986854.531348:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971423104:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986854.531481:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971423104:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 155us (5091us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986854.531491:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1884 10000000:01000000:1.0:1788986854.720362:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788986854.720372:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788986854.720378:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788986854.720434:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986854.720449:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986854.720467:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986854.720500:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094366f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993637120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788986854.720594:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986854.720663:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788986854.720734:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993637120 00000100:00100000:2.0:1788986854.720746:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993637120 00000100:00100000:2.0:1788986854.720812:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:2.0:1788986854.720825:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993637120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986854.720843:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986854.720860:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a01f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a018 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986854.720889:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a01f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a018 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986854.720902:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a01f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a018 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986854.720913:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0c00, rc 0) 00000100:00100000:2.0:1788986854.720980:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993637120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986854.720988:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:3.0:1788986854.721142:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094366f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993637120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986854.721163:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a01f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986854.721173:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a01f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986854.721196:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986854.721202:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a01f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986854.721210:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a01f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986855.488516:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986856.449464:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986856.449495:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993637248:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986856.450344:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986856.451340:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993637248 00000100:00100000:0.0:1788986856.451355:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993637248 00000100:00100000:0.0:1788986856.451433:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1788986856.451445:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993637248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986856.451494:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986856.452399:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80910a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993637248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 945us (2047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986856.452411:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00080000:2.0:1788986856.453288:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986856.457554:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993637248:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986856.514673:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788986856.575064:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967712 is committed 00000001:00080000:2.0:1788986856.575120:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967713 is committed 00000100:00100000:2.0:1788986857.474198:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993637504:0@lo:400:kworker.0 00000100:00100000:1.0:1788986857.474229:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993637760:0@lo:400:kworker.0 00000100:00100000:2.0:1788986857.474271:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986857.474277:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986857.474419:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993637376:0@lo:400:kworker.0 00000100:00100000:2.0:1788986857.474831:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993638016:0@lo:400:kworker.0 00000100:00100000:1.0:1788986857.474915:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993637760 00000100:00100000:1.0:1788986857.474923:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993637760 00000100:00100000:1.0:1788986857.474978:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1788986857.474987:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993637760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986857.475040:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993637760:12345-0@lo:400:kworker.0 Request processed in 53us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986857.475047:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1423 00000100:00100000:1.0:1788986857.475204:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe42680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993637760:0@lo:400:kworker.0 00000100:00100000:1.0:1788986857.476368:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993637632:0@lo:400:kworker.0 00000100:00100000:1.0:1788986857.476420:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986857.476466:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993637504 00000100:00100000:1.0:1788986857.476472:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993637504 00000100:00100000:1.0:1788986857.476504:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993637632 00000100:00100000:1.0:1788986857.476507:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993637632 00000100:00100000:1.0:1788986857.476536:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1885 00000100:00100000:1.0:1788986857.476543:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993637504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986857.476585:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993637504:12345-0@lo:400:kworker.0 Request processed in 42us (2315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986857.476592:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1885 00000100:00100000:1.0:1788986857.476607:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1886 00000100:00100000:1.0:1788986857.476613:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993637632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986857.479220:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993637632:0@lo:400:kworker.0 00000100:00100000:1.0:1788986857.479220:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993637632:12345-0@lo:400:kworker.0 Request processed in 2596us (2789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986857.479237:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1886 00000100:00080000:1.0:1788986857.479278:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986857.479871:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986857.480414:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993637888:0@lo:400:kworker.0 00000100:00100000:0.0:1788986857.480453:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986857.480495:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993637888 00000100:00100000:0.0:1788986857.480502:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993637888 00000100:00100000:0.0:1788986857.480554:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1887 00000100:00100000:0.0:1788986857.480569:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993637888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986857.480618:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993637888:12345-0@lo:400:kworker.0 Request processed in 57us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986857.480626:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1887 00000100:00100000:0.0:1788986857.480659:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993637888:0@lo:400:kworker.0 00000100:00080000:0.0:1788986857.481469:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986857.481877:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986857.481951:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe43100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993637504:0@lo:400:kworker.0 00000100:00100000:1.0:1788986857.482375:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993637376 00000100:00100000:1.0:1788986857.482382:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993637376 00000100:00100000:1.0:1788986857.482427:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1447 00000100:00100000:1.0:1788986857.482436:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993637376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986857.482489:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993637376:12345-0@lo:400:kworker.0 Request processed in 54us (2628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986857.482496:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1447 00000100:00100000:0.0:1788986857.485305:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993638016 00000100:00100000:0.0:1788986857.485318:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993638016 00000100:00100000:0.0:1788986857.485488:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1424 00000100:00100000:0.0:1788986857.485500:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993638016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986857.485581:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993638016:12345-0@lo:400:kworker.0 Request processed in 84us (3706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986857.485588:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1424 00000100:00100000:0.0:1788986857.485652:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993638016:0@lo:400:kworker.0 00000100:00100000:0.0:1788986857.485685:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe41500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993637376:0@lo:400:kworker.0 00000100:00080000:1.0:1788986857.485827:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788986857.536823:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986857.659993:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986857.660126:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971423232 00000100:00100000:1.0:1788986857.660136:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971423232 00000100:00100000:1.0:1788986857.660240:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00100000:1.0:1788986857.660256:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:5588:x1875885971423232:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986857.660276:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986857.660302:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf549fe0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15c2 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986857.660331:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a4823b500) 00010000:00010000:1.0:1788986857.660422:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986857.660491:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5588:x1875885971423232:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 241us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986857.660504:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 17 00000100:00080000:0.0:1788986857.660733:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986857.986049:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993638144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986857.986174:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986857.987447:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993638144 00000100:00100000:1.0:1788986857.987460:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993638144 00000100:00100000:1.0:1788986857.987539:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:1.0:1788986857.987551:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993638144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986857.987589:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986857.987674:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993638144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 125us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986857.987680:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:2.0:1788986857.987809:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993638144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986858.531731:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986858.531801:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971423360 00000100:00100000:1.0:1788986858.531812:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971423360 00000100:00100000:1.0:1788986858.531880:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1108 00000100:00100000:1.0:1788986858.531890:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58146:x1875885971423360:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986858.531909:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986858.531932:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a026 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15d0 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.531991:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf54a02d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.532005:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf54a02d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.532018:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf54a02d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986858.532050:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788986858.532054:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986858.532073:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf54a02d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.532127:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a026 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15d0 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.532144:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf54a02d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15d0 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.532152:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788986858.532155:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986858.532326:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d49200, rc 0) 00000100:00100000:1.0:1788986858.532419:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58146:x1875885971423360:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 529us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986858.532427:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1108 00000100:00100000:3.0:1788986858.539750:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986858.539788:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971423488 00000100:00100000:3.0:1788986858.539797:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971423488 00000100:00100000:3.0:1788986858.539856:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1109 00000100:00100000:3.0:1788986858.539867:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58146:x1875885971423488:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986858.539888:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986858.539907:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a034 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15d7 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.539961:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a03b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.539976:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a03b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.539986:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a03b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540000:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a042 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540007:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540014:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540340:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a049 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540350:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540358:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986858.540387:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:3.0:1788986858.540391:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986858.540408:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a049 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540421:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a03b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540428:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a03b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540434:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a03b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540440:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986858.540444:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a03b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540451:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a03b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540463:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:3.0:1788986858.540466:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986858.540470:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a03b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540475:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a03b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540488:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a042 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540494:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a042 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540499:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a042 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540504:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986858.540507:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a042 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540512:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a042 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540518:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a55745c00) 00010000:00010000:3.0:1788986858.540520:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986858.540523:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a042 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540528:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a042 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540559:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a034 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15d7 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540572:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a049 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15d7 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.540579:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:3.0:1788986858.540581:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986858.540583:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3200, rc 0) 00000100:00100000:3.0:1788986858.540636:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58146:x1875885971423488:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 771us (896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986858.540643:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1109 00000100:00100000:0.0:1788986858.549339:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986858.549635:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971423744 00000100:00100000:1.0:1788986858.549646:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971423744 00000100:00100000:1.0:1788986858.549720:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1110 00000100:00100000:1.0:1788986858.549733:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58146:x1875885971423744:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:1.0:1788986858.549790:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986858.549817:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a049 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15d7 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.549836:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:1.0:1788986858.549848:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986858.549928:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a050 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.549947:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a050 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.549957:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a050 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.567397:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986858.598632:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967714 is committed 00000004:00010000:1.0:1788986858.598892:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000073494e53 reply state 00000000e29f39b4 transno 4294967714 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a050 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986858.598905:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986858.598920:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00010000:00080000:1.0:1788986858.599010:0:7899:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:1.0:1788986858.599029:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58146:x1875885971423744:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 49296us (49695us total) trans 4294967714 rc 0/0 00000100:00100000:1.0:1788986858.599038:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1110 00010000:00010000:1.0:1788986858.599071:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a050 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.599080:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a050 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.599109:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a050 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.599116:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986858.599121:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a050 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.599130:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a050 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.599145:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:1.0:1788986858.599148:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788986858.599153:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a050 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.599231:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a050 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986858.670868:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986858.675608:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971423872 00000100:00100000:2.0:1788986858.675623:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971423872 00000100:00100000:2.0:1788986858.675684:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1111 00000100:00100000:2.0:1788986858.675703:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58151:x1875885971423872:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986858.675727:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986858.675747:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a057 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15de expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.675808:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a05e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.675823:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a05e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.675834:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a05e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.675848:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a065 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.675855:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a065 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.675861:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a065 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676507:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a06c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676520:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a06c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676528:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a06c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986858.676554:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:2.0:1788986858.676558:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986858.676579:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a06c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676590:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a05e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676596:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a05e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676602:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a05e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676608:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986858.676612:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a05e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676619:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a05e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676631:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:2.0:1788986858.676635:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986858.676640:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a05e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676646:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a05e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676655:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a065 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676661:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a065 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676666:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a065 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676671:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986858.676673:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a065 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676679:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a065 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676686:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a45acac00) 00010000:00010000:2.0:1788986858.676688:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986858.676701:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a065 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676707:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a065 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676735:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a057 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15de expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676752:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a06c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15de expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.676760:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986858.676762:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986858.676765:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1e00, rc 0) 00000100:00100000:2.0:1788986858.676876:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943858000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58151:x1875885971423872:12345-192.168.206.21@tcp:101:touch.0 Request processed in 1181us (6020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986858.676883:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1111 00000100:00100000:3.0:1788986858.679652:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986858.679794:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971424128 00000100:00100000:2.0:1788986858.679803:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971424128 00000100:00100000:2.0:1788986858.680049:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1112 00000100:00100000:2.0:1788986858.680060:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58151:x1875885971424128:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986858.680079:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986858.680121:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a073 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15e5 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.680365:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a07a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.680379:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a07a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.680391:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a07a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.680447:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a081 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.680456:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.680463:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986858.681165:0:15241:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x23:0x0], index 0: 0 00010000:00010000:2.0:1788986858.681390:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54a088 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.681401:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54a088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.681409:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54a088 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.681437:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a07a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.681444:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a07a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.681450:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a07a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.681455:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986858.681459:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a07a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.681466:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a07a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.681481:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986858.681483:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986858.681487:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a07a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.681493:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a07a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986858.681504:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006f4f1540 reply state 000000003fbaa605 transno 4294967715 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986858.681512:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986858.681537:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a073 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15e5 expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.681547:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54a088 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15e5 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.681554:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9b0a45aca200) 00010000:00010000:2.0:1788986858.681555:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986858.681557:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0800, rc 0) 00000100:00100000:2.0:1788986858.681628:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58151:x1875885971424128:12345-192.168.206.21@tcp:101:touch.0 Request processed in 1570us (1984us total) trans 4294967715 rc 0/0 00000100:00100000:2.0:1788986858.681634:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1112 00010000:00010000:3.0:1788986858.683832:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a081 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.683850:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a081 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.683857:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a081 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.683863:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986858.683868:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a081 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.683876:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a081 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.683891:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a45aca300) 00010000:00010000:3.0:1788986858.683894:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986858.683899:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a081 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.683905:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a081 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986858.684232:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986858.684293:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971424384 00000100:00100000:2.0:1788986858.684301:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971424384 00000100:00100000:1.0:1788986858.684568:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1113 00000100:00100000:1.0:1788986858.684580:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:58151:x1875885971424384:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:1.0:1788986858.684628:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986858.684645:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54a088 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15e5 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.684657:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9b0a45aca200) 00010000:00010000:1.0:1788986858.684664:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986858.684716:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a096 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.684728:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.684738:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986858.684854:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000ef41e123 reply state 00000000d27750a8 transno 4294967716 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986858.684863:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986858.684956:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58151:x1875885971424384:12345-192.168.206.21@tcp:36:touch.0 Request processed in 378us (727us total) trans 4294967716 rc 0/0 00000100:00100000:1.0:1788986858.684964:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1113 00010000:00010000:2.0:1788986858.687397:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a096 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.687418:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a096 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.687427:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a096 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.687434:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986858.687439:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a096 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.687448:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a096 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.687464:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:2.0:1788986858.687467:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986858.687472:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a096 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.687480:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a096 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986858.687793:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986858.687902:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971424512 00000100:00100000:2.0:1788986858.687911:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971424512 00000100:00100000:2.0:1788986858.687965:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1114 00000100:00100000:2.0:1788986858.687975:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:58151:x1875885971424512:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986858.687997:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986858.688500:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a09d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15ec expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986858.688725:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a09d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15ec expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986858.688739:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a09d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15ec expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986858.688755:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:0.0:1788986858.688758:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788986858.688761:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0600, rc 0) 00000100:00100000:0.0:1788986858.688817:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58151:x1875885971424512:12345-192.168.206.21@tcp:101:touch.0 Request processed in 843us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986858.688824:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1114 00000100:00100000:1.0:1788986858.692797:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986858.692899:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971424640 00000100:00100000:2.0:1788986858.692909:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971424640 00000100:00100000:2.0:1788986858.692985:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 608 00000100:00100000:2.0:1788986858.692992:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2345:x1875885971424640:12345-192.168.206.21@tcp:8:touch.0 00010000:00080000:2.0:1788986858.693178:0:86533:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 2642 last 0 00000020:00000080:2.0:1788986858.693213:0:86533:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf54a0a4 00002000:00100000:2.0:1788986858.693226:0:86533:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b0942ce6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788986858.693248:0:86533:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788986858.693447:0:86533:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788986858.693475:0:86533:0:(import.c:65:import_set_state_nolock()) ffff9b0942ce1800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788986858.693682:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971424640:12345-192.168.206.21@tcp:8:touch.0 Request processed in 688us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986858.693703:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 608 00000100:00100000:3.0:1788986858.701330:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986858.701495:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971424768 00000100:00100000:0.0:1788986858.701506:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971424768 00000100:00100000:0.0:1788986858.701700:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 609 00000100:00100000:0.0:1788986858.701714:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:0:x1875885971424768:12345-192.168.206.21@tcp:2:touch.0 00000100:00080000:1.0:1788986858.702160:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788986858.729456:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967366 is committed 00000001:00100000:2.0:1788986858.729607:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:3.0:1788986858.729774:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:0:x1875885971424768:12345-192.168.206.21@tcp:2:touch.0 Request processed in 28060us (28691us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788986858.729786:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 609 00000100:00100000:0.0:1788986858.732602:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986858.732730:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971425024 00000100:00100000:1.0:1788986858.732740:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971425024 00000100:00100000:1.0:1788986858.732793:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 110 00000100:00100000:1.0:1788986858.732804:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58151:x1875885971425024:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:1.0:1788986858.733125:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58151:x1875885971425024:12345-192.168.206.21@tcp:35:touch.0 Request processed in 322us (530us total) trans 4294967717 rc 0/0 00000100:00100000:1.0:1788986858.733134:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 110 00000100:00100000:1.0:1788986858.789522:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986858.789666:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971425152 00000100:00100000:2.0:1788986858.789677:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971425152 00000100:00100000:2.0:1788986858.789790:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1115 00000100:00100000:2.0:1788986858.789801:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58155:x1875885971425152:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986858.789825:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986858.789845:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a0ab lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15f3 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.789915:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a0b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.789930:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a0b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.789945:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a0b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.789960:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a0b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.789967:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.789973:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790053:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54a0c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790062:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54a0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790070:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54a0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986858.790140:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5b:0x0]: returning size 0 00000004:00200000:2.0:1788986858.790145:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986858.790162:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54a0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790174:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54a0c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790182:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a0b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790191:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a0b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790198:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a0b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790204:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986858.790208:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a0b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790216:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a0b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790227:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986858.790230:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986858.790235:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a0b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790241:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a0b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790253:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a0b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790259:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a0b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790265:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a0b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790271:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986858.790274:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a0b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790281:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a0b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790288:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986858.790291:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986858.790294:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a0b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790300:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a0b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790329:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a0ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15f3 expref: 13 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790343:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54a0c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15f3 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.790350:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:2.0:1788986858.790353:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986858.790355:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1600, rc 0) 00000100:00100000:2.0:1788986858.790419:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58155:x1875885971425152:12345-192.168.206.21@tcp:101:rm.0 Request processed in 620us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986858.790427:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1115 00000100:00100000:2.0:1788986858.797202:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986858.797337:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971425280 00000100:00100000:0.0:1788986858.797348:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971425280 00000100:00100000:0.0:1788986858.797404:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 610 00000100:00100000:0.0:1788986858.797414:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971425280:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986858.797431:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986858.797449:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54a0c7 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d15fa expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986858.797476:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23:0x0] initial LVB size: 0, mtime: 0x6aa1c5ea, atime: 0x6aa1c5ea, ctime: 0x6aa1c5ea, blocks: 0x1 00010000:00010000:0.0:1788986858.797495:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=2642s v=(0 0) 00010000:00010000:0.0:1788986858.797500:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986858.797509:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54a0c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15fa expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986858.797527:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54a0c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15fa expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986858.797539:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788986858.797609:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971425280:12345-192.168.206.21@tcp:101:rm.0 Request processed in 197us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986858.797616:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 610 00000100:00100000:3.0:1788986858.804993:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986858.805129:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971425536 00000100:00100000:1.0:1788986858.805139:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971425536 00000100:00100000:1.0:1788986858.805320:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1116 00000100:00100000:1.0:1788986858.805331:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58155:x1875885971425536:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788986858.805377:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788986858.805400:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54a0c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5b:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15f3 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.805421:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a09d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5b:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15ec expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.805431:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:1.0:1788986858.805441:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986858.805461:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a0ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.805475:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a0ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.805484:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a0ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.805497:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a0d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.805504:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.805511:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.805609:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a0dc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.805618:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a0dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.805626:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a0dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986858.806530:0:7899:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].35, 64 off10432 00000004:00080000:1.0:1788986858.806543:0:7899:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2642709453553ns, next at 2643709450265ns, rc = 0 00010000:00010000:1.0:1788986858.806601:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a0e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806612:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a0e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806626:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a0e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806635:0:7899:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a0e3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806642:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a0e3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806649:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a0e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806673:0:7899:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986858.806701:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a0dc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806708:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a0dc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806714:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a0dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806721:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d49a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986858.806725:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a0dc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806733:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a0dc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806743:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:1.0:1788986858.806746:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986858.806752:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a0dc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806759:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a0dc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5b:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806775:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a0ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806782:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a0ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806789:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a0ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806794:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d49800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986858.806797:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a0ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806802:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a0ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806809:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:1.0:1788986858.806812:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986858.806815:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a0ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986858.806821:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a0ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986858.806829:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f33b18ab reply state 000000003950d4e4 transno 4294967718 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986858.806844:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986858.806931:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58155:x1875885971425536:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1598us (1944us total) trans 4294967718 rc 0/0 00000100:00100000:1.0:1788986858.806939:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1116 00010000:00010000:2.0:1788986858.807470:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986858.807479:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a0e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.807490:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986858.807494:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a0e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.807501:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a0e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.807512:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5b:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:2.0:1788986858.807515:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788986858.807518:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a0e3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.807524:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a0e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5b:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986858.807541:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986858.807542:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986858.807544:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986858.809483:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a0d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.809498:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a0d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.809505:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a0d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.809511:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986858.809515:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a0d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.809523:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a0d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.809536:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a45316600) 00010000:00010000:3.0:1788986858.809539:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986858.809543:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a0d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986858.809550:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a0d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.598335:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986859.639289:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986859.639482:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971425664 00000100:00100000:1.0:1788986859.639490:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971425664 00000100:00100000:1.0:1788986859.639545:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1448 00000100:00100000:1.0:1788986859.639555:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971425664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986859.639620:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971425664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986859.639628:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1448 00000100:00100000:2.0:1788986859.753816:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986859.753909:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971425792 00000100:00100000:0.0:1788986859.753919:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971425792 00000100:00100000:0.0:1788986859.753988:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1117 00000100:00100000:0.0:1788986859.753998:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58170:x1875885971425792:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986859.754021:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986859.754042:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a0ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1601 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.754119:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a0f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.754134:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.754145:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788986859.754290:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788986859.754376:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:0.0:1788986859.754381:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986859.754411:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a0f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.754437:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a0ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1601 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.754453:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a0f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1601 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.754462:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:0.0:1788986859.754464:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986859.754468:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986859.754525:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ccb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58170:x1875885971425792:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 528us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986859.754532:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1117 00000100:00100000:0.0:1788986859.764979:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986859.765070:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971426048 00000100:00100000:2.0:1788986859.765079:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971426048 00000100:00100000:2.0:1788986859.765162:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1118 00000100:00100000:2.0:1788986859.765172:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58170:x1875885971426048:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986859.765217:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986859.765242:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a0f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1601 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986859.765263:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a06c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15de expref: 11 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986859.765280:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45aca700) 00010000:00010000:2.0:1788986859.765289:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986859.765312:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a0f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986859.765325:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986859.765334:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788986859.873570:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967718 is committed 00000004:00080000:1.0:1788986859.873582:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 95 committed 00000001:00080000:1.0:1788986859.873604:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967719 is committed 00000100:00100000:0.0:1788986859.874051:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986859.874069:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993638272:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788986859.874148:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00010000:3.0:1788986859.874189:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e9d18547 reply state 000000002b9d3e44 transno 4294967719 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986859.874201:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986859.874217:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993638272 00000100:00100000:0.0:1788986859.874224:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993638272 00000004:00200000:3.0:1788986859.874226:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000100:00100000:0.0:1788986859.874273:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 611 00000100:00100000:0.0:1788986859.874282:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993638272:12345-0@lo:6:osp-syn-0-0.0 00010000:00080000:3.0:1788986859.874303:0:15241:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00002000:00080000:0.0:1788986859.874303:0:86533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:35 count 1 00000100:00100000:3.0:1788986859.874321:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58170:x1875885971426048:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 109148us (109349us total) trans 4294967719 rc 0/0 00010000:00010000:0.0:1788986859.874323:0:86533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986859.874337:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1118 00010000:00010000:0.0:1788986859.874345:0:86533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54a0c7 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15fa expref: 5 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.874356:0:86533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788986859.874360:0:86533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986859.874365:0:86533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 4/0,1 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.874390:0:86533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54a0c7 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15fa expref: 5 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.874416:0:86533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54a0c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15fa expref: 5 pid: 6697 timeout: 2743 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986859.874429:0:86533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:86533:1875885993638400:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986859.874472:0:86533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5abfeb40 going to sleep for 11 seconds 00000100:00080000:0.0:1788986859.874484:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986859.875125:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a0f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986859.875137:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a0f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986859.875143:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a0f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986859.875150:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986859.875710:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a0f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986859.875724:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a0f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986859.875742:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:3.0:1788986859.875745:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986859.875752:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a0f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986859.875759:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a0f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986859.889453:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986859.889487:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971426176 00000100:00100000:0.0:1788986859.889496:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971426176 00010000:00010000:0.0:1788986859.889535:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54a0c7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15fa expref: 6 pid: 6697 timeout: 2743 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986859.889582:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 459 00000100:00100000:0.0:1788986859.889592:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971426176:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986859.889605:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986859.889611:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54a0c7 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15fa expref: 6 pid: 6697 timeout: 2743 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.889623:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54a0c7 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15fa expref: 6 pid: 6697 timeout: 2743 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.889644:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986859.889648:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986859.889653:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.889662:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.889680:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986859.889739:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971426176:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 148us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986859.889746:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 459 00010000:00010000:1.0:1788986859.889901:0:86533:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000070705d56/0xc20d828fcf54a0c7 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15fa expref: 5 pid: 6697 timeout: 2743 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986859.889914:0:86533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ac000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:86533:1875885993638400:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788986859.889933:0:86533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.889945:0:86533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.889956:0:86533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.889966:0:86533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.889973:0:86533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.889998:0:86533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788986859.890528:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993638272:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16246us (16378us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1788986859.890536:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 611 00000004:00080000:1.0:1788986859.890573:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a797e1880/2, rc 0, transno 4294967367 00000100:00100000:1.0:1788986859.890578:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993638272:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788986859.890695:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986859.890701:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.890710:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efe00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986859.890715:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.890725:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.890745:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.890753:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9b0c7d7/0xc20d828fcf54a0ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986859.890771:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986859.890773:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986859.890775:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986859.990809:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986859.990907:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971426304 00000100:00100000:1.0:1788986859.990916:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971426304 00000100:00100000:1.0:1788986859.990973:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1119 00000100:00100000:1.0:1788986859.990983:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58174:x1875885971426304:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986859.991006:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986859.991025:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a106 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1608 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991083:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a10d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991141:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a10d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991151:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a10d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991166:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a114 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991172:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991178:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991471:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a11b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991480:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a11b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991488:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a11b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986859.991513:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:1.0:1788986859.991517:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986859.991535:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a11b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991547:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a10d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991556:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a10d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991562:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a10d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991568:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986859.991571:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a10d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991578:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a10d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991588:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788986859.991591:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986859.991595:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a10d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991600:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a10d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991611:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a114 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991616:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a114 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991621:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a114 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991626:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d49800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986859.991629:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a114 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991634:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a114 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991641:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a45316100) 00010000:00010000:1.0:1788986859.991643:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986859.991646:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a114 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991651:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a114 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991677:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a106 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1608 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991702:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a11b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1608 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986859.991710:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:1.0:1788986859.991712:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986859.991714:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d49a00, rc 0) 00000100:00100000:1.0:1788986859.991763:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58174:x1875885971426304:12345-192.168.206.21@tcp:101:touch.0 Request processed in 782us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986859.991771:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1119 00000100:00100000:0.0:1788986860.004701:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986860.004804:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971426560 00000100:00100000:2.0:1788986860.004813:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971426560 00000100:00100000:2.0:1788986860.004876:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1120 00000100:00100000:2.0:1788986860.004885:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58174:x1875885971426560:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986860.004905:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986860.004925:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a122 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d160f expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.005210:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a129 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.005225:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.005237:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.005252:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a130 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.005260:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.005267:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986860.005957:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x23:0x0], index 1: 0 00010000:00010000:2.0:1788986860.006229:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a137 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.006241:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.006249:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a137 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.006283:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a129 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.006290:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a129 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.006296:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a129 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.006301:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986860.006305:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a129 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.006311:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a129 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.006327:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:2.0:1788986860.006330:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986860.006336:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a129 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.006342:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a129 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986860.006354:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000089ccc1f0 reply state 000000006705d0a6 transno 4294967720 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986860.006362:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986860.006389:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a122 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d160f expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.006402:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a137 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d160f expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.006409:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986860.006412:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986860.006414:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1400, rc 0) 00000100:00100000:2.0:1788986860.006470:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58174:x1875885971426560:12345-192.168.206.21@tcp:101:touch.0 Request processed in 1586us (1787us total) trans 4294967720 rc 0/0 00000100:00100000:2.0:1788986860.006478:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1120 00010000:00010000:3.0:1788986860.016731:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a130 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.016748:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a130 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.016760:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a130 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.016767:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986860.016771:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a130 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.016778:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a130 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.016793:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a45aca700) 00010000:00010000:3.0:1788986860.016796:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986860.016800:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a130 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.016807:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a130 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986860.019304:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986860.019602:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971426816 00000100:00100000:3.0:1788986860.019613:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971426816 00000100:00100000:3.0:1788986860.019673:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1121 00000100:00100000:3.0:1788986860.019740:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:58174:x1875885971426816:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:3.0:1788986860.019795:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986860.019823:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a137 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d160f expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.019841:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:3.0:1788986860.019851:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986860.019892:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a145 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.019905:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.019916:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986860.020051:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007c92466a reply state 000000004ffa8fe2 transno 4294967721 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986860.020060:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986860.020193:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58174:x1875885971426816:12345-192.168.206.21@tcp:36:touch.0 Request processed in 509us (897us total) trans 4294967721 rc 0/0 00000100:00100000:3.0:1788986860.020200:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1121 00010000:00010000:2.0:1788986860.022753:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a145 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.022770:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a145 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.022782:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.022788:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986860.022792:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a145 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.022799:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a145 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.022815:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9b0a55745800) 00010000:00010000:2.0:1788986860.022818:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986860.022822:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a145 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.022828:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a145 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986860.023604:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986860.028203:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971426944 00000100:00100000:1.0:1788986860.028218:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971426944 00000100:00100000:1.0:1788986860.028317:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1122 00000100:00100000:1.0:1788986860.028328:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:58174:x1875885971426944:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986860.028354:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986860.028376:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a14c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1616 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.028696:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a14c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1616 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.028713:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a14c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1616 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.028732:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:1.0:1788986860.028735:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788986860.028739:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d48e00, rc 0) 00000100:00100000:1.0:1788986860.028805:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58174:x1875885971426944:12345-192.168.206.21@tcp:101:touch.0 Request processed in 479us (5207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986860.028813:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1122 00000100:00100000:0.0:1788986860.036056:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986860.039381:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971427072 00000100:00100000:3.0:1788986860.039394:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971427072 00000100:00100000:3.0:1788986860.039452:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 612 00000100:00100000:3.0:1788986860.039459:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2345:x1875885971427072:12345-192.168.206.21@tcp:8:touch.0 00010000:00080000:3.0:1788986860.039490:0:8478:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp t0 exp 0000000000000000 cur 2643 last 0 00000020:00000080:3.0:1788986860.039522:0:8478:0:(genops.c:1384:class_connect()) connect: client d307e018-a913-49dd-8d34-07b37c8ccf58, cookie 0xc20d828fcf54a153 00002000:00100000:3.0:1788986860.039534:0:8478:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d307e018-a913-49dd-8d34-07b37c8ccf58/ffff9b0a76743800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 5111808 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788986860.039567:0:8478:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788986860.039803:0:8478:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788986860.039837:0:8478:0:(import.c:65:import_set_state_nolock()) ffff9b0a76747000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788986860.039902:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971427072:12345-192.168.206.21@tcp:8:touch.0 Request processed in 441us (3855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986860.039910:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 612 00000100:00100000:0.0:1788986860.043710:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986860.044248:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971427200 00000100:00100000:2.0:1788986860.044257:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971427200 00000100:00100000:2.0:1788986860.044329:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 613 00000100:00100000:2.0:1788986860.044340:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:0:x1875885971427200:12345-192.168.206.21@tcp:2:touch.0 00000100:00080000:0.0:1788986860.044512:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1788986860.092710:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967366 is committed 00000001:00100000:0.0:1788986860.092726:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000100:00100000:2.0:1788986860.092853:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:0:x1875885971427200:12345-192.168.206.21@tcp:2:touch.0 Request processed in 48510us (49146us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788986860.092862:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 613 00000100:00100000:0.0:1788986860.095833:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986860.095921:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971427456 00000100:00100000:1.0:1788986860.095930:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971427456 00000100:00100000:1.0:1788986860.095982:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 111 00000100:00100000:1.0:1788986860.095992:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58174:x1875885971427456:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:1.0:1788986860.096453:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58174:x1875885971427456:12345-192.168.206.21@tcp:35:touch.0 Request processed in 462us (632us total) trans 4294967722 rc 0/0 00000100:00100000:1.0:1788986860.096640:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 111 00000100:00100000:0.0:1788986860.178511:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986860.180747:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971427584 00000100:00100000:1.0:1788986860.180759:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971427584 00000100:00100000:1.0:1788986860.180885:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1123 00000100:00100000:1.0:1788986860.180897:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58178:x1875885971427584:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986860.180920:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986860.180940:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a15a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d161d expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.180998:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a161 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181013:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a161 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181026:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a161 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181041:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a168 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181048:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181055:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181169:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a16f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181177:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181183:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986860.181214:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5c:0x0]: returning size 0 00000004:00200000:1.0:1788986860.181219:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986860.181238:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181249:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a16f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181257:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a161 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181264:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a161 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181271:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181277:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986860.181281:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a161 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181287:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a161 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181297:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:1.0:1788986860.181300:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986860.181304:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a161 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181310:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48800/0xc20d828fcf54a161 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181321:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a168 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181330:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a168 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181335:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181339:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986860.181342:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a168 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181346:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a168 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181352:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a45316f00) 00010000:00010000:1.0:1788986860.181354:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986860.181356:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a168 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181361:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a168 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181389:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49800/0xc20d828fcf54a15a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d161d expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181402:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a16f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d161d expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.181409:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:1.0:1788986860.181411:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986860.181414:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00100000:1.0:1788986860.181484:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58178:x1875885971427584:12345-192.168.206.21@tcp:101:rm.0 Request processed in 589us (2981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986860.181491:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1123 00000100:00100000:0.0:1788986860.185980:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986860.186075:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971427712 00000100:00100000:1.0:1788986860.186085:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971427712 00000100:00100000:1.0:1788986860.186361:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 614 00000100:00100000:1.0:1788986860.186372:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971427712:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986860.186390:0:86533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986860.186409:0:86533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a176 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1624 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788986860.186437:0:86533:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23:0x0] initial LVB size: 0, mtime: 0x6aa1c5eb, atime: 0x6aa1c5eb, ctime: 0x6aa1c5eb, blocks: 0x1 00010000:00010000:1.0:1788986860.186456:0:86533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=2644s v=(0 0) 00010000:00010000:1.0:1788986860.186460:0:86533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986860.186469:0:86533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1624 expref: 6 pid: 86533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.186488:0:86533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1624 expref: 6 pid: 86533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.186501:0:86533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986860.186564:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971427712:12345-192.168.206.21@tcp:101:rm.0 Request processed in 193us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986860.186781:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 614 00000100:00100000:0.0:1788986860.189976:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986860.190115:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971427968 00000100:00100000:2.0:1788986860.190125:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971427968 00000100:00100000:2.0:1788986860.190194:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1124 00000100:00100000:2.0:1788986860.190204:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58178:x1875885971427968:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:2.0:1788986860.190256:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986860.190281:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a16f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5c:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d161d expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.190303:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d48e00/0xc20d828fcf54a14c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1616 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.190314:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:2.0:1788986860.190324:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986860.190344:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a17d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.190358:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a17d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.190367:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a17d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.190382:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a184 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.190390:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.190411:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.190504:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a18b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.190513:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a18b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.190521:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a18b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986860.192987:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].35, 64 off10432 00000004:00080000:2.0:1788986860.193002:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2644095912403ns, next at 2645095909590ns, rc = 0 00010000:00010000:2.0:1788986860.193068:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a192 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193084:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193127:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a192 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193135:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a192 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193142:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a192 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193149:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a192 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193510:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986860.193537:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a18b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193545:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a18b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193560:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a18b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193567:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986860.193578:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a18b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193585:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a18b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193597:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:2.0:1788986860.193600:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986860.193605:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a18b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193612:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a18b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5c:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193631:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a17d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193637:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a17d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193643:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a17d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193648:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986860.193651:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a17d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193657:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a17d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193669:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:2.0:1788986860.193671:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986860.193674:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a17d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986860.193680:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a17d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986860.193702:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000072620c30 reply state 00000000691a6d24 transno 4294967723 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986860.193711:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986860.193800:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58178:x1875885971427968:12345-192.168.206.21@tcp:36:rm.0 Request processed in 3594us (3830us total) trans 4294967723 rc 0/0 00000100:00100000:2.0:1788986860.193810:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1124 00010000:00010000:1.0:1788986860.195734:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986860.195746:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a192 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.195760:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986860.195764:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a192 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.195773:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a192 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.195787:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5c:0x0].0x0 (ffff9b0a45aca600) 00010000:00010000:1.0:1788986860.195789:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788986860.195794:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a192 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.195799:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a192 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5c:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986860.195819:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986860.195821:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986860.195823:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986860.197940:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a184 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.197956:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a184 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.197964:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a184 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.197969:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986860.197974:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a184 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.197981:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a184 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.197995:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a45acae00) 00010000:00010000:3.0:1788986860.197998:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986860.198002:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a184 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986860.198008:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a184 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986860.610047:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986861.114275:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986861.115170:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971428096 00000100:00100000:3.0:1788986861.115182:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971428096 00000100:00100000:3.0:1788986861.115249:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1125 00000100:00100000:3.0:1788986861.115260:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58192:x1875885971428096:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986861.115284:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986861.115304:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a199 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d162b expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.115370:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a1a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.115384:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.115397:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986861.115429:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:3.0:1788986861.115433:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986861.115450:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a1a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.115475:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a199 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d162b expref: 13 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.115493:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a1a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d162b expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.115501:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:3.0:1788986861.115504:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986861.115508:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986861.115566:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58192:x1875885971428096:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 308us (2479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986861.115573:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1125 00000100:00080000:0.0:1788986861.115753:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986861.123512:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986861.123636:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971428352 00000100:00100000:3.0:1788986861.123646:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971428352 00000100:00100000:3.0:1788986861.123715:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1126 00000100:00100000:3.0:1788986861.123725:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094366f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58192:x1875885971428352:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986861.123772:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986861.123810:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a1a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d162b expref: 12 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.123833:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49a00/0xc20d828fcf54a11b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1608 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.123844:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316c00) 00010000:00010000:3.0:1788986861.123854:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986861.123877:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a1a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.123891:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a1a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.123901:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a1a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986861.124159:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000319739c5 reply state 00000000a3320268 transno 4294967724 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a1a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986861.124169:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986861.124177:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000100:00100000:3.0:1788986861.124262:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094366f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58192:x1875885971428352:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 538us (758us total) trans 4294967724 rc 0/0 00000100:00100000:3.0:1788986861.124269:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1126 00010000:00010000:3.0:1788986861.127353:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a1a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.127369:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a1a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.127376:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a1a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.127382:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986861.127386:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a1a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.127393:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a1a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.127408:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986861.127410:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986861.127416:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a1a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.127422:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a1a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986861.326588:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986861.327581:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971428480 00000100:00100000:2.0:1788986861.327592:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971428480 00000100:00100000:2.0:1788986861.327661:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1127 00000100:00100000:2.0:1788986861.327671:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58204:x1875885971428480:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986861.327782:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58204:x1875885971428480:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 113us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986861.327790:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1127 00000100:00100000:1.0:1788986861.330144:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986861.330283:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971428608 00000100:00100000:2.0:1788986861.330292:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971428608 00000100:00100000:3.0:1788986861.330533:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 615 00000100:00100000:3.0:1788986861.330544:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58204:x1875885971428608:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986861.330899:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58204:x1875885971428608:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 356us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986861.330906:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 615 00000100:00080000:0.0:1788986861.336927:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986861.340227:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986861.340324:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971428736 00000100:00100000:2.0:1788986861.340332:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971428736 00000100:00100000:2.0:1788986861.340390:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 616 00000100:00100000:2.0:1788986861.340400:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58204:x1875885971428736:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986861.340820:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58204:x1875885971428736:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 420us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986861.340829:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 616 00000100:00100000:2.0:1788986861.348394:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986861.348486:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971428864 00000100:00100000:3.0:1788986861.348495:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971428864 00000100:00100000:3.0:1788986861.348551:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1128 00000100:00100000:3.0:1788986861.348562:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58204:x1875885971428864:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986861.348973:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80cc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58204:x1875885971428864:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 412us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986861.348981:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1128 00000100:00100000:1.0:1788986861.356580:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986861.356690:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971428992 00000100:00100000:0.0:1788986861.356700:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971428992 00000100:00100000:0.0:1788986861.356758:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1129 00000100:00100000:0.0:1788986861.356768:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58204:x1875885971428992:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986861.356858:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58204:x1875885971428992:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 92us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986861.356866:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1129 00000100:00100000:0.0:1788986861.363674:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986861.363774:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971429120 00000100:00100000:1.0:1788986861.363783:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971429120 00000100:00100000:1.0:1788986861.363836:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 617 00000100:00100000:1.0:1788986861.363847:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58204:x1875885971429120:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986861.364585:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58204:x1875885971429120:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 736us (916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986861.364598:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 617 00000100:00100000:1.0:1788986861.371721:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986861.371815:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971429248 00000100:00100000:0.0:1788986861.371825:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971429248 00000100:00100000:0.0:1788986861.371881:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 618 00000100:00100000:0.0:1788986861.371891:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58204:x1875885971429248:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986861.372632:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58204:x1875885971429248:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 740us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986861.372641:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 618 00000100:00100000:0.0:1788986861.396070:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986861.396479:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971429376 00000100:00100000:3.0:1788986861.396490:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971429376 00000100:00100000:3.0:1788986861.396563:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1130 00000100:00100000:3.0:1788986861.396575:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58204:x1875885971429376:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986861.396991:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58204:x1875885971429376:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 418us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986861.396999:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1130 00000100:00100000:3.0:1788986861.485881:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986861.486020:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971429504 00000100:00100000:1.0:1788986861.486029:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971429504 00000100:00100000:1.0:1788986861.486135:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1131 00000100:00100000:1.0:1788986861.486145:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58208:x1875885971429504:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:1.0:1788986861.486164:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986861.486330:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a1ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1632 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486393:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a1b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486408:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a1b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486418:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a1b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486432:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a1bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486438:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a1bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486443:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a1bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486800:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a1c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486815:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486823:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986861.486858:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:1.0:1788986861.486862:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986861.486885:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a1c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486898:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a1b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486906:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a1b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486913:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a1b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486920:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986861.486925:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a1b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486934:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a1b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486944:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788986861.486947:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986861.486952:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a1b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486962:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a1b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486975:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a1bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486980:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a1bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486985:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a1bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486989:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986861.486991:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a1bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.486997:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a1bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.487004:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a45316f00) 00010000:00010000:1.0:1788986861.487006:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986861.487008:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a1bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.487014:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a1bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.487044:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a1ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1632 expref: 13 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.487057:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a1c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1632 expref: 12 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.487064:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:1.0:1788986861.487066:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986861.487069:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788986861.487486:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58208:x1875885971429504:12345-192.168.206.21@tcp:101:dd.0 Request processed in 1341us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986861.487494:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1131 00000100:00100000:1.0:1788986861.500530:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986861.500629:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971429760 00000100:00100000:2.0:1788986861.500638:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971429760 00000100:00100000:2.0:1788986861.500703:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1132 00000100:00100000:2.0:1788986861.500714:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58208:x1875885971429760:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788986861.500733:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986861.500753:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54a1ca lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1639 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.500863:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a1d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.500877:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a1d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.500890:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a1d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.500904:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a1d8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.500916:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a1d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.500922:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a1d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986861.502866:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x24:0x0], index 0: 0 00010000:00010000:2.0:1788986861.503058:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a1df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.503072:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a1df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.503082:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a1df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.503135:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a1d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.503142:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a1d1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.503149:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a1d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.503155:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986861.503159:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a1d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.503176:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a1d1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.503194:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:2.0:1788986861.503197:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986861.503202:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a1d1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.503213:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a1d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986861.503226:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d12ccfa2 reply state 00000000eaf27896 transno 4294967725 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a1d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986861.503235:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986861.503268:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1600/0xc20d828fcf54a1ca lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1639 expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.503283:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a1df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1639 expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.503290:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:2.0:1788986861.503292:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986861.503295:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788986861.503364:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42c7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+15:58208:x1875885971429760:12345-192.168.206.21@tcp:101:dd.0 Request processed in 2652us (2843us total) trans 4294967725 rc 0/0 00000100:00100000:2.0:1788986861.503373:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1132 00010000:00010000:3.0:1788986861.514170:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a1d8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.514188:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a1d8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.514196:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a1d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.514203:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986861.514207:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a1d8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.514215:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a1d8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.514231:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a45aca900) 00010000:00010000:3.0:1788986861.514235:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986861.514240:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a1d8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.514246:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a1d8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986861.519239:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986861.519448:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971429888 00000100:00100000:3.0:1788986861.519457:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971429888 00000100:00100000:3.0:1788986861.519501:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 619 00000100:00100000:3.0:1788986861.519509:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58208:x1875885971429888:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:3.0:1788986861.519525:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986861.519544:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f7fd41f/0xc20d828fcf54a1ed lrc: 2/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1640 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788986861.519579:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788986861.519600:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=2645s v=(0 0) 00010000:00010000:3.0:1788986861.519604:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986861.519613:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f7fd41f/0xc20d828fcf54a1ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1640 expref: 6 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.519628:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f7fd41f/0xc20d828fcf54a1ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1640 expref: 6 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986861.519640:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3c00, rc 0) 00000100:00100000:3.0:1788986861.519705:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58208:x1875885971429888:12345-192.168.206.21@tcp:101:dd.0 Request processed in 195us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986861.519712:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 619 00000100:00100000:0.0:1788986861.555301:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986861.555523:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971430016 00000100:00100000:2.0:1788986861.555533:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971430016 00002000:00100000:2.0:1788986861.555596:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x24:0x0] (0->1048575) req@ffff9b0a7fe56d80 x1875885971430016/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:27/0 lens 488/0 e 0 to 0 dl 1788986872 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788986861.555607:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a7fe56d80 with x1875885971430016 ext(0->1048575) 00002000:00010000:2.0:1788986861.555612:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0a7fe56d80 00000100:00100000:2.0:1788986861.555649:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 28 00000100:00100000:2.0:1788986861.555658:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971430016:12345-192.168.206.21@tcp:4:dd.0 00000100:00100000:0.0:1788986861.570411:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986861.570436:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993638528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986861.570519:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986861.572243:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993638528 00000100:00100000:3.0:1788986861.572253:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993638528 00000100:00100000:3.0:1788986861.572378:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:3.0:1788986861.572388:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993638528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986861.572412:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986861.572487:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993638528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (1969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986861.572494:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:3.0:1788986861.572560:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993638528:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986861.581518:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986861.582695:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971430016:12345-192.168.206.21@tcp:4:dd.0 Request processed in 27018us (27383us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788986861.582709:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 28 00002000:00100000:3.0:1788986861.582724:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x24:0x0] (0->1048575) req@ffff9b0a7fe56d80 x1875885971430016/t4294967368(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:27/0 lens 488/448 e 0 to 0 dl 1788986872 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788986861.582735:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a7fe56d80 with x1875885971430016 ext(0->1048575) 00002000:00010000:3.0:1788986861.582742:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0a7fe56d80 00000100:00100000:0.0:1788986861.588036:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986861.588127:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971430144 00000100:00100000:3.0:1788986861.588136:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971430144 00000100:00100000:3.0:1788986861.588199:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1133 00000100:00100000:3.0:1788986861.588210:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+14:58208:x1875885971430144:12345-192.168.206.21@tcp:44:dd.0 00000001:00080000:1.0:1788986861.616234:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967722 is committed 00000001:00080000:1.0:1788986861.616259:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967725 is committed 00000004:00080000:1.0:1788986861.616268:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 97 committed 00000100:00100000:1.0:1788986861.616388:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993638656:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788986861.616452:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986861.616522:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993638656 00000100:00100000:1.0:1788986861.616529:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993638656 00000100:00100000:1.0:1788986861.616959:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 620 00000100:00100000:1.0:1788986861.616968:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993638656:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788986861.616994:0:86533:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:35 count 1 00010000:00010000:1.0:1788986861.617017:0:86533:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.617037:0:86533:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a176 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1624 expref: 5 pid: 86533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.617046:0:86533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788986861.617052:0:86533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986861.617056:0:86533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.617083:0:86533:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1624 expref: 5 pid: 86533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986861.617348:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58208:x1875885971430144:12345-192.168.206.21@tcp:44:dd.0 Request processed in 29137us (29318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986861.617357:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1133 00010000:00010000:1.0:1788986861.619234:0:86533:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1624 expref: 5 pid: 86533 timeout: 2745 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986861.619252:0:86533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09429f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:86533:1875885993638784:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986861.619325:0:86533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5ab75240 going to sleep for 11 seconds 00000100:00080000:1.0:1788986861.619342:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986861.623032:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986861.623198:0:86533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09429f4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:86533:1875885993638784:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788986861.623225:0:86533:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986861.623341:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971430272 00000100:00100000:1.0:1788986861.623349:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971430272 00000100:00100000:1.0:1788986861.623401:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 621 00000100:00100000:1.0:1788986861.623410:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971430272:12345-192.168.206.21@tcp:16:dd.0 00000100:00100000:3.0:1788986861.630522:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986861.632262:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971430400 00000100:00100000:1.0:1788986861.632276:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971430400 00010000:00010000:1.0:1788986861.632315:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1624 expref: 6 pid: 86533 timeout: 2745 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986861.632352:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 460 00000100:00100000:1.0:1788986861.632362:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971430400:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986861.632376:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986861.632382:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a176 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1624 expref: 6 pid: 86533 timeout: 2745 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.632397:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a176 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1624 expref: 6 pid: 86533 timeout: 2745 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.632420:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a176 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x23:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1624 expref: 6 pid: 86533 timeout: 2745 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.632437:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986861.632441:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986861.632446:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.632456:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986861.632488:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986861.633340:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971430400:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 973us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986861.633350:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 460 00010000:00010000:2.0:1788986861.634465:0:86533:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.634480:0:86533:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.634492:0:86533:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.634501:0:86533:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.634520:0:86533:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788986861.635184:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993638656:12345-0@lo:6:osp-syn-1-0.0 Request processed in 18215us (18730us total) trans 4294967367 rc 0/0 00000100:00100000:2.0:1788986861.635194:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 620 00010000:00010000:2.0:1788986861.635223:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986861.635230:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.635238:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986861.635242:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.635252:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.635270:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.635277:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035beff3d/0xc20d828fcf54a1f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986861.635300:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986861.635301:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986861.635303:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788986861.635339:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a760e6300/2, rc 0, transno 4294967367 00000100:00100000:2.0:1788986861.635346:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993638656:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788986861.638282:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986861.660723:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967367 is committed 00000100:00100000:2.0:1788986861.660928:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971430272:12345-192.168.206.21@tcp:16:dd.0 Request processed in 37513us (37902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986861.660938:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 621 00000001:00080000:3.0:1788986861.664038:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967368 is committed 00000100:00100000:0.0:1788986861.664223:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986861.664316:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971430656 00000100:00100000:3.0:1788986861.664326:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971430656 00000100:00100000:3.0:1788986861.664425:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 112 00000100:00100000:3.0:1788986861.664437:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58208:x1875885971430656:12345-192.168.206.21@tcp:35:dd.0 00000100:00100000:3.0:1788986861.664893:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:58208:x1875885971430656:12345-192.168.206.21@tcp:35:dd.0 Request processed in 456us (672us total) trans 4294967726 rc 0/0 00000100:00100000:3.0:1788986861.664901:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 112 00000100:00100000:3.0:1788986862.593397:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993639040:0@lo:400:kworker.0 00000100:00100000:3.0:1788986862.593487:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986862.593589:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993638912:0@lo:400:kworker.0 00000100:00100000:1.0:1788986862.593630:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986862.594254:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993639296:0@lo:400:kworker.0 00000100:00100000:2.0:1788986862.594325:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986862.596298:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993639552:0@lo:400:kworker.0 00000100:00100000:3.0:1788986862.596377:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986862.596438:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986862.596446:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993639168:0@lo:400:kworker.0 00000100:00100000:3.0:1788986862.596475:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986862.596526:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993639040 00000100:00100000:3.0:1788986862.596535:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993639040 00000100:00100000:3.0:1788986862.596859:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993639168 00000100:00100000:3.0:1788986862.596864:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993639168 00000100:00100000:3.0:1788986862.596908:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1888 00000100:00100000:3.0:1788986862.596918:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993639040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986862.596987:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993639040:12345-0@lo:400:kworker.0 Request processed in 70us (3500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986862.596994:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1888 00000100:00100000:3.0:1788986862.597017:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1889 00000100:00100000:3.0:1788986862.597024:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993639168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986862.597255:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993639424:0@lo:400:kworker.0 00000100:00100000:2.0:1788986862.597378:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993639296 00000100:00100000:2.0:1788986862.597383:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993639296 00000100:00100000:2.0:1788986862.597416:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993639552 00000100:00100000:2.0:1788986862.597419:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993639552 00000100:00100000:2.0:1788986862.597439:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1425 00000100:00100000:2.0:1788986862.597446:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993639296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986862.598583:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986862.598659:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993638912 00000100:00100000:1.0:1788986862.598667:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993638912 00000100:00100000:1.0:1788986862.598729:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:1.0:1788986862.598738:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993638912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986862.598790:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993638912:12345-0@lo:400:kworker.0 Request processed in 55us (5159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986862.598796:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:1.0:1788986862.598852:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993638912:0@lo:400:kworker.0 00000100:00100000:0.0:1788986862.599009:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993639424 00000100:00100000:0.0:1788986862.599014:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993639424 00000100:00100000:0.0:1788986862.599055:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1890 00000100:00100000:0.0:1788986862.599064:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993639424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986862.599146:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993639424:12345-0@lo:400:kworker.0 Request processed in 75us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986862.599153:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1890 00000100:00100000:1.0:1788986862.599353:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993639424:0@lo:400:kworker.0 00000100:00100000:3.0:1788986862.599420:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993639168:12345-0@lo:400:kworker.0 Request processed in 2395us (2942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986862.599427:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1889 00000100:00100000:3.0:1788986862.599461:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1426 00000100:00100000:3.0:1788986862.599471:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8096e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993639552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986862.599511:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8096e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993639552:12345-0@lo:400:kworker.0 Request processed in 43us (3134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986862.599517:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1426 00000100:00080000:3.0:1788986862.599614:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986862.600044:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993639168:0@lo:400:kworker.0 00000100:00100000:3.0:1788986862.600344:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993639040:0@lo:400:kworker.0 00000100:00100000:3.0:1788986862.600357:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993639552:0@lo:400:kworker.0 00000100:00100000:2.0:1788986862.600487:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993639296:12345-0@lo:400:kworker.0 Request processed in 3040us (6161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986862.600497:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1425 00000100:00100000:1.0:1788986862.600582:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:1.0:1788986862.600589:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a797e1880, transno 4294967367 00000100:00100000:1.0:1788986862.600607:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993639296:0@lo:400:kworker.0 00010000:00010000:2.0:1788986862.668979:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986863.105865:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993639680:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986863.105961:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986863.106058:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993639680 00000100:00100000:0.0:1788986863.106067:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993639680 00000100:00100000:0.0:1788986863.107565:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:0.0:1788986863.107584:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993639680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986863.107718:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986863.107821:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993639680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 244us (1859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986863.107829:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00080000:0.0:1788986863.107864:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986863.116531:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993639680:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788986863.157900:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967726 is committed 00010000:00010000:2.0:1788986863.683086:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986864.588473:0:99691:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2648491381301ns, next at 2643709450265ns, rc = 0 00000004:00080000:3.0:1788986864.588637:0:99691:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2648491546759ns, next at 2645095909590ns, rc = 0 00000004:00080000:1.0:1788986864.592700:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 98 committed 00000004:00080000:1.0:1788986864.592728:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 96 committed 00010000:00010000:2.0:1788986864.707047:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986864.760631:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986864.760702:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986864.760709:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971430784 00000100:00100000:1.0:1788986864.760719:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971430784 00000100:00100000:3.0:1788986864.760737:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986864.760761:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1450 00000100:00100000:3.0:1788986864.760762:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986864.760771:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971430784:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986864.760782:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971430912 00000100:00100000:3.0:1788986864.760785:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971430912 00000100:00100000:3.0:1788986864.760821:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1891 00000100:00100000:3.0:1788986864.760827:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971430912:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986864.760833:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971430784:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 64us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986864.760839:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1450 00000100:00100000:3.0:1788986864.760859:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971430912:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986864.760869:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1891 00000100:00100000:3.0:1788986864.760886:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971431040 00000100:00100000:3.0:1788986864.760889:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971431040 00000100:00100000:3.0:1788986864.760921:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971431168 00000100:00100000:3.0:1788986864.760924:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971431168 00000100:00100000:3.0:1788986864.760950:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1427 00000100:00100000:3.0:1788986864.760957:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971431040:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986864.760982:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971431040:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986864.760988:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1427 00000100:00100000:3.0:1788986864.761001:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1428 00000100:00100000:3.0:1788986864.761007:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971431168:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986864.761029:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971431168:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986864.761035:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1428 00000100:00080000:3.0:1788986864.761052:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986864.761056:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986864.761058:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788986865.285741:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967367 is committed 00010000:00010000:1.0:1788986865.732359:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986866.254427:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986866.254620:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971431296 00000100:00100000:3.0:1788986866.254629:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971431296 00000100:00100000:3.0:1788986866.254717:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1134 00000100:00100000:3.0:1788986866.254728:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58401:x1875885971431296:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986866.254817:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58401:x1875885971431296:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 91us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986866.254827:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1134 00000100:00080000:0.0:1788986866.255279:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986866.262847:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986866.262932:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971431424 00000100:00100000:0.0:1788986866.262941:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971431424 00000100:00100000:0.0:1788986866.263009:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 622 00000100:00100000:0.0:1788986866.263019:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58401:x1875885971431424:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986866.263413:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58401:x1875885971431424:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 395us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986866.263421:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 622 00000100:00080000:3.0:1788986866.264410:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986866.265219:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986866.265370:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971431552 00000100:00100000:0.0:1788986866.265377:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971431552 00000100:00100000:0.0:1788986866.265441:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 623 00000100:00100000:0.0:1788986866.265452:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58401:x1875885971431552:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986866.265778:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58401:x1875885971431552:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 327us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986866.265786:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 623 00000100:00080000:3.0:1788986866.269863:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986866.271529:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986866.271602:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971431680 00000100:00100000:1.0:1788986866.271611:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971431680 00000100:00100000:1.0:1788986866.271673:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1135 00000100:00100000:1.0:1788986866.271684:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58401:x1875885971431680:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986866.272169:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58401:x1875885971431680:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 485us (651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986866.272177:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1135 00000100:00100000:0.0:1788986866.275246:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986866.275319:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971431808 00000100:00100000:3.0:1788986866.275328:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971431808 00000100:00100000:3.0:1788986866.275388:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1136 00000100:00100000:3.0:1788986866.275398:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58401:x1875885971431808:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986866.275482:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58401:x1875885971431808:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 85us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986866.275489:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1136 00000100:00100000:3.0:1788986866.279625:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986866.279711:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971431936 00000100:00100000:2.0:1788986866.279720:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971431936 00000100:00100000:2.0:1788986866.279785:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 624 00000100:00100000:2.0:1788986866.279795:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58401:x1875885971431936:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986866.280216:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58401:x1875885971431936:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 421us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986866.280224:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 624 00000100:00100000:1.0:1788986866.282707:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986866.282789:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971432064 00000100:00100000:3.0:1788986866.282798:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971432064 00000100:00100000:3.0:1788986866.282860:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 625 00000100:00100000:3.0:1788986866.282870:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58401:x1875885971432064:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986866.283244:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58401:x1875885971432064:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 374us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986866.283251:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 625 00000100:00100000:3.0:1788986866.290898:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986866.290984:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971432192 00000100:00100000:1.0:1788986866.290995:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971432192 00000100:00100000:1.0:1788986866.291048:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1137 00000100:00100000:1.0:1788986866.291058:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58401:x1875885971432192:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986866.291489:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58401:x1875885971432192:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 431us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986866.291498:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1137 00000100:00100000:0.0:1788986866.443387:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986866.443458:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971432448 00000100:00100000:3.0:1788986866.443467:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971432448 00000100:00100000:3.0:1788986866.443531:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1138 00000100:00100000:3.0:1788986866.443540:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58405:x1875885971432448:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788986866.443586:0:15241:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986866.443613:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a1df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5d:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1639 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.443631:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:3.0:1788986866.443640:0:15241:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986866.443672:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a1fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.443685:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a1fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.443695:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a1fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.443709:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a202 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.443716:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a202 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.443728:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a202 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.444223:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a209 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.444234:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a209 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.444242:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a209 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788986866.447501:0:15241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].36, 64 off10496 00000004:00080000:3.0:1788986866.447533:0:15241:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2650350443060ns, next at 2651350439273ns, rc = 0 00010000:00010000:3.0:1788986866.447662:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a210 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.447678:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.447688:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a210 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.447696:0:15241:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a210 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.447701:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a210 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.447707:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.447920:0:15241:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986866.447946:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a209 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.447952:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a209 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.447957:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a209 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.447963:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986866.447966:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a209 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.447978:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a209 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.447989:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:3.0:1788986866.447992:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986866.447996:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a209 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.448002:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a209 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5d:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.448022:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a1fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.448028:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a1fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.448033:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a1fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.448038:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986866.448041:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a1fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.448046:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a1fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.448053:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:3.0:1788986866.448056:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986866.448058:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a1fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.448067:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a1fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986866.448077:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f86ddbd7 reply state 000000007e5b8e21 transno 4294967727 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a202 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986866.448085:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986866.449403:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+9:58405:x1875885971432448:12345-192.168.206.21@tcp:36:rm.0 Request processed in 5859us (6019us total) trans 4294967727 rc 0/0 00000100:00100000:3.0:1788986866.449412:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1138 00010000:00010000:3.0:1788986866.458996:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a202 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.459012:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a202 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.459019:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a202 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.459025:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986866.459030:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a202 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.459038:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a202 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.459051:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a55745000) 00010000:00010000:3.0:1788986866.459054:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986866.459059:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a202 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986866.459070:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a202 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986866.464473:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986866.464489:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a210 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986866.464501:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986866.464505:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a210 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986866.464528:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a210 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986866.464547:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5d:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:1.0:1788986866.464551:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788986866.464556:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a210 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986866.464566:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a210 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5d:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986866.464593:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986866.464595:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986866.464597:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986866.688897:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986866.688932:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993639808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986866.688997:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986866.689169:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993639808 00000100:00100000:0.0:1788986866.689177:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993639808 00000100:00100000:0.0:1788986866.689242:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:0.0:1788986866.689251:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993639808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986866.689285:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788986866.689339:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993639808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986866.689345:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:0.0:1788986866.689392:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993639808:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986866.689615:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986866.752316:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986867.714801:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993640320:0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.714875:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986867.714935:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788986867.714941:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993639936:0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.714971:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986867.715007:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993640448:0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715030:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986867.715065:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993640192:0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715109:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986867.715127:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788986867.715132:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993640064:0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715151:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986867.715168:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993640576:0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715187:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986867.715215:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993639936 00000100:00100000:1.0:1788986867.715223:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993639936 00000100:00100000:1.0:1788986867.715265:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1451 00000100:00100000:1.0:1788986867.715273:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993639936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715320:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993639936:12345-0@lo:400:kworker.0 Request processed in 48us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986867.715327:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1451 00000100:00100000:1.0:1788986867.715359:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993640448 00000100:00100000:1.0:1788986867.715362:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993640448 00000100:00100000:1.0:1788986867.715395:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993640192 00000100:00100000:1.0:1788986867.715398:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993640192 00000100:00100000:1.0:1788986867.715418:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993640064 00000100:00100000:1.0:1788986867.715421:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993640064 00000100:00100000:1.0:1788986867.715436:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1892 00000100:00100000:1.0:1788986867.715443:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993640448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715475:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993640448:12345-0@lo:400:kworker.0 Request processed in 33us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986867.715481:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1892 00000100:00100000:1.0:1788986867.715493:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1893 00000100:00100000:1.0:1788986867.715499:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993640192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715528:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993640192:12345-0@lo:400:kworker.0 Request processed in 30us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986867.715534:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1893 00000100:00100000:1.0:1788986867.715545:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1894 00000100:00100000:1.0:1788986867.715551:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993640064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715577:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993640064:12345-0@lo:400:kworker.0 Request processed in 27us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986867.715582:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1894 00000100:00100000:1.0:1788986867.715606:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993640320 00000100:00100000:1.0:1788986867.715609:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993640320 00000100:00100000:1.0:1788986867.715629:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993640576 00000100:00100000:1.0:1788986867.715632:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993640576 00000100:00100000:1.0:1788986867.715666:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1788986867.715673:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09429f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993640320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715705:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09429f4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993640320:12345-0@lo:400:kworker.0 Request processed in 32us (830us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986867.715710:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1429 00000100:00100000:1.0:1788986867.715722:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1430 00000100:00100000:1.0:1788986867.715728:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993640576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715754:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993640576:12345-0@lo:400:kworker.0 Request processed in 26us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986867.715759:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1430 00000100:00080000:1.0:1788986867.715777:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986867.715781:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986867.715815:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993640064:0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715823:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967367 gen 2 00000004:00080000:1.0:1788986867.715828:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a760e6300, transno 4294967367 00000100:00100000:1.0:1788986867.715835:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993640576:0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715845:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993640192:0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715871:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993639936:0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715880:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993640448:0@lo:400:kworker.0 00000100:00100000:1.0:1788986867.715887:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993640320:0@lo:400:kworker.0 00010000:00010000:0.0:1788986867.787020:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986868.225514:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986868.225533:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993640704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986868.225590:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986868.225696:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993640704 00000100:00100000:0.0:1788986868.225704:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993640704 00000100:00100000:0.0:1788986868.225751:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:0.0:1788986868.225760:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993640704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986868.225791:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986868.225846:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993640704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986868.225853:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:3.0:1788986868.225979:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993640704:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788986868.746624:0:99837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2652649532290ns, next at 2651350439273ns, rc = 0 00010000:00010000:1.0:1788986868.802280:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788986868.810309:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 98 committed 00000001:00080000:0.0:1788986868.810336:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967727 is committed 00000004:00080000:0.0:1788986868.810341:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 97 committed 00000100:00100000:3.0:1788986868.810653:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986868.810873:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993640832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788986868.811039:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986868.811350:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993640832 00000100:00100000:1.0:1788986868.811358:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993640832 00000100:00100000:1.0:1788986868.811488:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 626 00000100:00100000:1.0:1788986868.811498:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993640832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788986868.811534:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:36 count 1 00010000:00010000:1.0:1788986868.811558:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986868.811576:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f7fd41f/0xc20d828fcf54a1ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1640 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986868.811584:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x24:0x0].0x0 since=7s v=(0 0) 00010000:00010000:1.0:1788986868.811588:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986868.811592:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986868.811617:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f7fd41f/0xc20d828fcf54a1ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1640 expref: 5 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986868.811629:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f7fd41f/0xc20d828fcf54a1ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1640 expref: 5 pid: 8478 timeout: 2752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986868.811653:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993640960:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986868.813075:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c43c0 going to sleep for 11 seconds 00000100:00080000:3.0:1788986868.813202:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986868.823828:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986868.823927:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993640960:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788986868.823952:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986868.826316:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971432576 00000100:00100000:3.0:1788986868.826330:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971432576 00010000:00010000:3.0:1788986868.826398:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f7fd41f/0xc20d828fcf54a1ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1640 expref: 6 pid: 8478 timeout: 2752 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986868.826443:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 461 00000100:00100000:3.0:1788986868.826452:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971432576:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986868.826467:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986868.826473:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f7fd41f/0xc20d828fcf54a1ed lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1640 expref: 6 pid: 8478 timeout: 2752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986868.826485:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f7fd41f/0xc20d828fcf54a1ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1640 expref: 6 pid: 8478 timeout: 2752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986868.826527:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f7fd41f/0xc20d828fcf54a1ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1640 expref: 6 pid: 8478 timeout: 2752 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986868.826555:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986868.826559:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x24:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986868.826565:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986868.826574:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986868.826608:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986868.826673:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe55f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971432576:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 221us (2852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986868.826680:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 461 00010000:00010000:2.0:1788986868.826969:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986868.826980:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986868.826990:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986868.826998:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986868.827018:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788986868.827625:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993640832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 16127us (16585us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788986868.827645:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 626 00010000:00010000:2.0:1788986868.827671:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986868.827676:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986868.827685:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986868.827689:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986868.827698:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986868.827713:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986868.827720:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ee7c8dd/0xc20d828fcf54a217 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986868.827740:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986868.827741:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986868.827743:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788986868.827776:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7f350e00/2, rc 0, transno 4294967369 00000100:00100000:2.0:1788986868.827789:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993640832:0@lo:6:osp-syn-0-0.0 00000004:00080000:2.0:1788986868.827980:0:99837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2652730889384ns, next at 2645095909590ns, rc = 0 00000100:00080000:1.0:1788986868.832108:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788986868.833171:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 99 committed 00010000:00010000:1.0:1788986869.824469:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986869.874081:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986869.874143:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986869.874173:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986869.874198:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986869.874225:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971432832 00000100:00100000:0.0:1788986869.874233:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971432832 00000100:00100000:0.0:1788986869.874290:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1895 00000100:00100000:0.0:1788986869.874301:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971432832:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986869.874369:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971432832:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 70us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986869.874376:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1895 00000100:00100000:0.0:1788986869.874398:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971432960 00000100:00100000:0.0:1788986869.874402:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971432960 00000100:00100000:0.0:1788986869.874424:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971433088 00000100:00100000:0.0:1788986869.874427:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971433088 00000100:00100000:0.0:1788986869.874450:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1431 00000100:00100000:0.0:1788986869.874457:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971432960:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986869.874483:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971432960:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986869.874490:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1431 00000100:00100000:0.0:1788986869.874503:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1432 00000100:00100000:0.0:1788986869.874509:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971433088:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986869.874531:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971433088:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986869.874537:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1432 00000100:00080000:0.0:1788986869.874552:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986869.874706:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986869.875289:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971432704 00000100:00100000:2.0:1788986869.875295:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971432704 00000100:00100000:2.0:1788986869.878889:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1452 00000100:00100000:2.0:1788986869.878912:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971432704:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986869.878989:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971432704:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 88us (4917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986869.878997:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1452 00010000:00010000:2.0:1788986870.848414:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986871.371647:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967369 is committed 00000100:00100000:3.0:1788986871.815549:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986871.815570:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993641088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986871.815649:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986871.815707:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993641088 00000100:00100000:3.0:1788986871.815714:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993641088 00000100:00100000:3.0:1788986871.815767:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:3.0:1788986871.815777:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993641088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986871.815809:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986871.815871:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993641088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986871.815877:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00080000:3.0:1788986871.815900:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986871.815936:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:3.0:1788986871.815941:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7f350e00, transno 4294967369 00000100:00100000:3.0:1788986871.815958:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993641088:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986871.879840:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986872.832384:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993641472:0@lo:400:kworker.0 00000100:00100000:0.0:1788986872.832469:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986872.832536:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986872.832542:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993641600:0@lo:400:kworker.0 00000100:00100000:0.0:1788986872.832566:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986872.832649:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993641344:0@lo:400:kworker.0 00000100:00100000:1.0:1788986872.832676:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986872.832701:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993641856:0@lo:400:kworker.0 00000100:00100000:1.0:1788986872.832718:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986872.832733:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788986872.832738:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993641216:0@lo:400:kworker.0 00000100:00100000:1.0:1788986872.832761:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986872.832781:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993641728:0@lo:400:kworker.0 00000100:00100000:1.0:1788986872.832798:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986872.832819:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993641216 00000100:00100000:1.0:1788986872.832825:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993641216 00000100:00100000:1.0:1788986872.832863:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:1.0:1788986872.832871:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993641216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986872.832915:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993641216:12345-0@lo:400:kworker.0 Request processed in 43us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986872.832921:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:1.0:1788986872.832963:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993641216:0@lo:400:kworker.0 00000100:00100000:0.0:1788986872.833030:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993641472 00000100:00100000:0.0:1788986872.833034:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993641472 00000100:00100000:0.0:1788986872.833077:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993641344 00000100:00100000:0.0:1788986872.833079:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993641344 00000100:00100000:0.0:1788986872.833121:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993641728 00000100:00100000:0.0:1788986872.833124:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993641728 00000100:00100000:0.0:1788986872.833138:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1896 00000100:00100000:0.0:1788986872.833143:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993641472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986872.833177:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993641472:12345-0@lo:400:kworker.0 Request processed in 34us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986872.833183:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1896 00000100:00100000:0.0:1788986872.833195:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1897 00000100:00100000:0.0:1788986872.833200:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993641344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986872.833226:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993641344:12345-0@lo:400:kworker.0 Request processed in 25us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986872.833231:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1897 00000100:00100000:0.0:1788986872.833241:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1898 00000100:00100000:0.0:1788986872.833246:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993641728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986872.833267:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993641728:12345-0@lo:400:kworker.0 Request processed in 21us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986872.833272:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1898 00000100:00100000:0.0:1788986872.833289:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993641600 00000100:00100000:0.0:1788986872.833292:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993641600 00000100:00100000:0.0:1788986872.833309:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993641856 00000100:00100000:0.0:1788986872.833311:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993641856 00000100:00100000:0.0:1788986872.833328:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1788986872.833333:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993641600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986872.833358:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993641600:12345-0@lo:400:kworker.0 Request processed in 25us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986872.833364:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1433 00000100:00100000:0.0:1788986872.833373:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1788986872.833379:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993641856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986872.833399:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993641856:12345-0@lo:400:kworker.0 Request processed in 21us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986872.833404:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1434 00000100:00100000:0.0:1788986872.833438:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993641728:0@lo:400:kworker.0 00000100:00100000:0.0:1788986872.833447:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993641344:0@lo:400:kworker.0 00000100:00100000:0.0:1788986872.833455:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993641856:0@lo:400:kworker.0 00000100:00100000:0.0:1788986872.833480:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993641600:0@lo:400:kworker.0 00000100:00100000:0.0:1788986872.833489:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993641472:0@lo:400:kworker.0 00000100:00080000:1.0:1788986872.833708:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986872.833713:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986872.897599:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986873.344352:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993641984:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986873.344448:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986873.344817:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993641984 00000100:00100000:3.0:1788986873.344825:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993641984 00000100:00100000:3.0:1788986873.344890:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:3.0:1788986873.344900:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993641984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986873.344941:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986873.345003:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45a55c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993641984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986873.345010:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:2.0:1788986873.345367:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993641984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986873.920672:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986874.944362:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986874.998340:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986874.998389:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986874.998426:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986874.998455:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986874.998482:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971433216 00000100:00100000:0.0:1788986874.998491:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971433216 00000100:00100000:0.0:1788986874.998555:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1454 00000100:00100000:0.0:1788986874.998566:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971433216:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986874.998646:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971433216:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 82us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986874.998654:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1454 00000100:00100000:1.0:1788986874.998789:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971433344 00000100:00100000:1.0:1788986874.998794:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971433344 00000100:00100000:1.0:1788986874.998841:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1899 00000100:00100000:1.0:1788986874.998850:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971433344:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986874.998882:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971433344:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986874.998892:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1899 00000100:00080000:1.0:1788986874.998911:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986874.998952:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971433600 00000100:00100000:1.0:1788986874.998957:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971433600 00000100:00100000:1.0:1788986874.998986:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971433472 00000100:00100000:1.0:1788986874.998988:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971433472 00000100:00100000:1.0:1788986874.999008:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1435 00000100:00100000:1.0:1788986874.999015:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971433600:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986874.999042:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971433600:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986874.999048:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1435 00000100:00100000:1.0:1788986874.999060:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1436 00000100:00100000:1.0:1788986874.999066:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971433472:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986874.999132:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971433472:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986874.999138:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1436 00000100:00080000:1.0:1788986874.999157:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986874.999160:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788986875.968817:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986876.928731:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993642112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986876.928830:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986876.929208:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993642112 00000100:00100000:3.0:1788986876.929220:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993642112 00000100:00100000:3.0:1788986876.929305:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:3.0:1788986876.929317:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993642112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986876.929362:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986876.929422:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993642112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986876.929431:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00080000:1.0:1788986876.929512:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986876.929560:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993642112:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986876.992631:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986877.954286:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993642624:0@lo:400:kworker.0 00000100:00100000:1.0:1788986877.954355:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986877.954417:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788986877.954424:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993642496:0@lo:400:kworker.0 00000100:00100000:1.0:1788986877.954450:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986877.954482:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993642624 00000100:00100000:1.0:1788986877.954490:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993642624 00000100:00100000:1.0:1788986877.954534:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1788986877.954543:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a76789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993642624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986877.954603:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a76789050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993642624:12345-0@lo:400:kworker.0 Request processed in 60us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986877.954609:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1437 00000100:00100000:1.0:1788986877.954796:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993642624:0@lo:400:kworker.0 00000100:00100000:0.0:1788986877.954883:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993642368:0@lo:400:kworker.0 00000100:00100000:0.0:1788986877.954912:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986877.954936:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993642880:0@lo:400:kworker.0 00000100:00100000:0.0:1788986877.954956:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986877.954973:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788986877.954978:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993642240:0@lo:400:kworker.0 00000100:00100000:0.0:1788986877.955002:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986877.955022:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993642752:0@lo:400:kworker.0 00000100:00100000:0.0:1788986877.955039:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986877.955085:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993642496 00000100:00100000:0.0:1788986877.955277:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993642496 00000100:00100000:0.0:1788986877.955312:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993642368 00000100:00100000:0.0:1788986877.955315:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993642368 00000100:00100000:0.0:1788986877.955328:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993642752 00000100:00100000:0.0:1788986877.955331:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993642752 00000100:00100000:0.0:1788986877.955346:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1900 00000100:00100000:0.0:1788986877.955353:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993642496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986877.955390:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993642496:12345-0@lo:400:kworker.0 Request processed in 37us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986877.955396:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1900 00000100:00100000:0.0:1788986877.955409:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1901 00000100:00100000:0.0:1788986877.955414:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993642368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986877.955441:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993642368:12345-0@lo:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986877.955446:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1901 00000100:00100000:0.0:1788986877.955456:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1902 00000100:00100000:0.0:1788986877.955461:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993642752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986877.955482:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993642752:12345-0@lo:400:kworker.0 Request processed in 21us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986877.955487:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1902 00000100:00100000:0.0:1788986877.955513:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993642752:0@lo:400:kworker.0 00000100:00100000:0.0:1788986877.955522:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993642368:0@lo:400:kworker.0 00000100:00100000:3.0:1788986877.955652:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993642240 00000100:00100000:3.0:1788986877.955657:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993642240 00000100:00100000:3.0:1788986877.955692:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1455 00000100:00100000:3.0:1788986877.955698:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993642240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986877.955740:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993642240:12345-0@lo:400:kworker.0 Request processed in 42us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986877.955746:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1455 00000100:00100000:2.0:1788986877.955819:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993642240:0@lo:400:kworker.0 00000100:00100000:1.0:1788986877.955959:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993642880 00000100:00100000:1.0:1788986877.955963:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993642880 00000100:00100000:1.0:1788986877.955999:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1438 00000100:00100000:1.0:1788986877.956006:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993642880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986877.956048:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993642880:12345-0@lo:400:kworker.0 Request processed in 43us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986877.958272:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1438 00000100:00080000:1.0:1788986877.958325:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986877.958330:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986877.958374:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993642496:0@lo:400:kworker.0 00000100:00100000:3.0:1788986877.958554:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993642880:0@lo:400:kworker.0 00010000:00010000:0.0:1788986878.016478:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986878.464629:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993643008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986878.464695:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986878.465288:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993643008 00000100:00100000:2.0:1788986878.465298:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993643008 00000100:00100000:2.0:1788986878.465362:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1788986878.465373:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993643008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986878.465411:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986878.465479:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe57480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993643008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986878.465485:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:0.0:1788986878.465654:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993643008:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986879.044671:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986880.064423:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986880.112181:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986880.112430:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986880.112798:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971433728 00000100:00100000:1.0:1788986880.112812:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971433728 00000100:00100000:1.0:1788986880.112923:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1456 00000100:00100000:1.0:1788986880.112937:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971433728:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986880.113047:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971433728:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 113us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986880.113056:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1456 00000100:00100000:2.0:1788986880.113272:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971433856 00000100:00100000:2.0:1788986880.113279:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971433856 00000100:00100000:2.0:1788986880.113340:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1903 00000100:00100000:2.0:1788986880.113350:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971433856:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986880.113399:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971433856:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 51us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986880.113407:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1903 00000100:00080000:0.0:1788986880.114783:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986880.127874:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986880.127925:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986880.128266:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971433984 00000100:00100000:3.0:1788986880.128279:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971433984 00000100:00100000:3.0:1788986880.128372:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971434112 00000100:00100000:3.0:1788986880.128376:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971434112 00000100:00100000:3.0:1788986880.128411:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1439 00000100:00100000:3.0:1788986880.128424:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971433984:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986880.128515:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971433984:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 94us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986880.128524:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1439 00000100:00100000:2.0:1788986880.128548:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1440 00000100:00100000:2.0:1788986880.128562:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971434112:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986880.128612:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971434112:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 54us (685us total) trans 0 rc 0/0 00000100:00080000:0.0:1788986880.128660:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986880.128666:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986880.138405:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1440 00010000:00010000:2.0:1788986881.088441:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986882.048353:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986882.048377:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993643136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986882.048451:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986882.048694:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993643136 00000100:00100000:2.0:1788986882.048703:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993643136 00000100:00100000:2.0:1788986882.048776:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:2.0:1788986882.048787:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993643136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986882.048820:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986882.048888:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993643136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986882.048895:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:1.0:1788986882.048985:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993643136:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986882.049211:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986882.112402:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986882.308973:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986882.309054:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971434240 00000100:00100000:1.0:1788986882.309064:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971434240 00000100:00100000:1.0:1788986882.309167:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1139 00000100:00100000:1.0:1788986882.309179:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58582:x1875885971434240:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986882.309270:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58582:x1875885971434240:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 94us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986882.309278:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1139 00000100:00080000:2.0:1788986882.309611:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986882.317764:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986882.317798:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971434368 00000100:00100000:3.0:1788986882.317808:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971434368 00000100:00100000:3.0:1788986882.317877:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 627 00000100:00100000:3.0:1788986882.317887:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58582:x1875885971434368:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986882.318270:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58582:x1875885971434368:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 383us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986882.318278:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 627 00000100:00080000:3.0:1788986882.318298:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986882.322694:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986882.323018:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971434496 00000100:00100000:2.0:1788986882.323029:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971434496 00000100:00100000:2.0:1788986882.323245:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 628 00000100:00100000:2.0:1788986882.323261:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58582:x1875885971434496:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986882.323713:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58582:x1875885971434496:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 455us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986882.323721:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 628 00000100:00080000:3.0:1788986882.323911:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986882.327483:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986882.327521:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971434624 00000100:00100000:3.0:1788986882.327530:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971434624 00000100:00100000:3.0:1788986882.327592:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1140 00000100:00100000:3.0:1788986882.327605:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58582:x1875885971434624:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986882.328335:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58582:x1875885971434624:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 730us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986882.328345:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1140 00000100:00100000:3.0:1788986882.338557:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986882.338723:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971434752 00000100:00100000:0.0:1788986882.338741:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971434752 00000100:00100000:0.0:1788986882.338789:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1141 00000100:00100000:0.0:1788986882.338798:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58582:x1875885971434752:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986882.339000:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58582:x1875885971434752:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 201us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986882.339008:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1141 00000100:00100000:3.0:1788986882.348660:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986882.349358:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971434880 00000100:00100000:2.0:1788986882.349367:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971434880 00000100:00100000:2.0:1788986882.349412:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 629 00000100:00100000:2.0:1788986882.349420:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58582:x1875885971434880:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986882.349739:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58582:x1875885971434880:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 317us (1086us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986882.349747:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 629 00000100:00100000:0.0:1788986882.359905:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986882.359940:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971435008 00000100:00100000:0.0:1788986882.359948:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971435008 00000100:00100000:0.0:1788986882.359991:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 630 00000100:00100000:0.0:1788986882.360000:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58582:x1875885971435008:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986882.362887:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58582:x1875885971435008:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 2878us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986882.362899:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 630 00000100:00100000:0.0:1788986882.369723:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986882.371041:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971435136 00000100:00100000:2.0:1788986882.371054:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971435136 00000100:00100000:2.0:1788986882.371135:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1142 00000100:00100000:2.0:1788986882.371145:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58582:x1875885971435136:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986882.371579:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58582:x1875885971435136:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 434us (1863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986882.371587:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1142 00000100:00100000:1.0:1788986883.072270:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993643520:0@lo:400:kworker.0 00000100:00100000:1.0:1788986883.072332:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986883.072384:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986883.072390:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993643648:0@lo:400:kworker.0 00000100:00100000:1.0:1788986883.072411:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986883.072442:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993643648 00000100:00100000:1.0:1788986883.072449:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993643648 00000100:00100000:1.0:1788986883.072493:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1441 00000100:00100000:1.0:1788986883.072501:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993643648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986883.072541:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993643264:0@lo:400:kworker.0 00000100:00100000:1.0:1788986883.072547:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993643648:12345-0@lo:400:kworker.0 Request processed in 47us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986883.072553:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1441 00000100:00100000:3.0:1788986883.072591:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986883.072605:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993643648:0@lo:400:kworker.0 00000100:00100000:3.0:1788986883.072615:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993643776:0@lo:400:kworker.0 00000100:00100000:3.0:1788986883.072636:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986883.072666:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788986883.072672:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993643392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986883.072693:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986883.072712:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993643904:0@lo:400:kworker.0 00000100:00100000:3.0:1788986883.072733:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986883.072758:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993643520 00000100:00100000:3.0:1788986883.072762:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993643520 00000100:00100000:3.0:1788986883.072795:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993643776 00000100:00100000:3.0:1788986883.072798:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993643776 00000100:00100000:3.0:1788986883.072833:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993643392 00000100:00100000:3.0:1788986883.072836:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993643392 00000100:00100000:1.0:1788986883.079285:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1904 00000100:00100000:1.0:1788986883.079305:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993643520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986883.079402:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993643520:12345-0@lo:400:kworker.0 Request processed in 104us (7069us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986883.079409:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1904 00000100:00100000:1.0:1788986883.079435:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1905 00000100:00100000:1.0:1788986883.079442:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993643776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986883.079490:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993643776:12345-0@lo:400:kworker.0 Request processed in 49us (6853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986883.079496:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1905 00000100:00100000:1.0:1788986883.079508:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1906 00000100:00100000:1.0:1788986883.079516:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993643392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986883.079545:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993643392:12345-0@lo:400:kworker.0 Request processed in 31us (6851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986883.079551:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1906 00000100:00100000:1.0:1788986883.079614:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993643520:0@lo:400:kworker.0 00000100:00100000:1.0:1788986883.080791:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993643904 00000100:00100000:1.0:1788986883.080800:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993643904 00000100:00100000:1.0:1788986883.080843:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1788986883.080851:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993643904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986883.080896:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993643904:12345-0@lo:400:kworker.0 Request processed in 46us (8162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986883.080902:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1442 00000100:00100000:1.0:1788986883.080927:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993643264 00000100:00100000:1.0:1788986883.080932:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993643264 00000100:00100000:1.0:1788986883.080958:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:1.0:1788986883.080964:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993643264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986883.080999:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993643264:12345-0@lo:400:kworker.0 Request processed in 35us (8407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986883.081004:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1788986883.081731:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993643392:0@lo:400:kworker.0 00000100:00100000:3.0:1788986883.081746:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe43480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993643904:0@lo:400:kworker.0 00000100:00100000:3.0:1788986883.081755:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993643264:0@lo:400:kworker.0 00000100:00100000:3.0:1788986883.081766:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993643776:0@lo:400:kworker.0 00000100:00080000:3.0:1788986883.081799:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986883.081804:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986883.138489:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986883.584282:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986883.584304:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993644032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986883.584372:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986883.584492:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993644032 00000100:00100000:0.0:1788986883.584500:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993644032 00000100:00100000:0.0:1788986883.584549:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:0.0:1788986883.584570:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993644032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986883.584602:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986883.584647:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993644032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986883.584654:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1788986883.584782:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993644032:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986884.122867:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986884.122939:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971435264 00000100:00100000:1.0:1788986884.122949:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971435264 00000100:00100000:1.0:1788986884.123032:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1143 00000100:00100000:1.0:1788986884.123043:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58596:x1875885971435264:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986884.123061:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986884.123108:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a21e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1647 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986884.123169:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a225 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986884.123183:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986884.123195:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986884.123225:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:1.0:1788986884.123229:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986884.123247:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a225 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986884.123272:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a21e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1647 expref: 9 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986884.123290:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a225 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1647 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986884.123298:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:1.0:1788986884.123301:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986884.123304:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031a00, rc 0) 00000100:00100000:1.0:1788986884.123357:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58596:x1875885971435264:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 315us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986884.123363:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1143 00000100:00080000:0.0:1788986884.123543:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986884.139327:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986884.139614:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971435520 00000100:00100000:3.0:1788986884.139623:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971435520 00000100:00100000:3.0:1788986884.139682:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1144 00000100:00100000:3.0:1788986884.139693:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58596:x1875885971435520:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986884.139808:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986884.139833:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a225 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1647 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.139854:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a1c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1632 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.140318:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:3.0:1788986884.140328:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986884.140354:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a22c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.140367:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.140377:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.166060:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788986884.205516:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967728 is committed 00000004:00010000:3.0:1788986884.206352:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e66da6a6 reply state 00000000921124a7 transno 4294967728 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986884.206367:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986884.206380:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00010000:00080000:3.0:1788986884.206473:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788986884.206488:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58596:x1875885971435520:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 66794us (67410us total) trans 4294967728 rc 0/0 00000100:00100000:3.0:1788986884.206497:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1144 00010000:00010000:3.0:1788986884.206635:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a22c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.206644:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a22c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.206651:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a22c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.206656:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986884.206661:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a22c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.206667:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a22c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.206681:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986884.206683:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986884.206688:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a22c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.206698:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a22c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986884.294486:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986884.294571:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971435648 00000100:00100000:0.0:1788986884.294580:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971435648 00000100:00100000:0.0:1788986884.294637:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1145 00000100:00100000:0.0:1788986884.294647:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58600:x1875885971435648:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788986884.294668:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986884.294689:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a233 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d164e expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.294747:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a23a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.294760:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a23a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.294770:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a23a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.294783:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a241 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.294789:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.294794:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.295159:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a248 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.295169:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.295176:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986884.295456:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:2.0:1788986884.295461:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986884.295483:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a248 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295498:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a23a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295504:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a23a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295510:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a23a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295516:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986884.295520:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a23a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295527:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a23a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295539:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:2.0:1788986884.295542:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986884.295546:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a23a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295560:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a23a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295574:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a241 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295580:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a241 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295585:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295591:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986884.295593:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a241 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295598:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a241 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295605:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a4823bc00) 00010000:00010000:2.0:1788986884.295608:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986884.295610:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a241 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295615:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a241 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295645:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a233 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d164e expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295660:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a248 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d164e expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.295667:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:2.0:1788986884.295670:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986884.295673:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eee00, rc 0) 00000100:00100000:2.0:1788986884.295743:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58600:x1875885971435648:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 1097us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986884.295751:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1145 00000100:00100000:0.0:1788986884.299608:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986884.299692:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971435904 00000100:00100000:3.0:1788986884.299702:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971435904 00000100:00100000:3.0:1788986884.299755:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1146 00000100:00100000:3.0:1788986884.299765:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a42ccc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58600:x1875885971435904:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:3.0:1788986884.299784:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986884.299803:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a24f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1655 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.300430:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a256 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.300446:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a256 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.300457:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a256 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.300471:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a25d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.300478:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.300485:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788986884.301339:0:15241:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x24:0x0], index 1: 0 00010000:00010000:3.0:1788986884.301596:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.301609:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.301618:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.301649:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a256 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.301656:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a256 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.301661:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a256 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.301666:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986884.301670:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a256 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.301678:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a256 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.301687:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:3.0:1788986884.301690:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986884.301695:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a256 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.301700:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a256 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986884.301719:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001cc32964 reply state 000000001215473d transno 4294967729 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986884.301727:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788986884.301756:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a24f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1655 expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.301770:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1655 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.301777:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986884.301779:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788986884.301782:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3800, rc 0) 00000100:00100000:3.0:1788986884.301976:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a42ccc050 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58600:x1875885971435904:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 2211us (2375us total) trans 4294967729 rc 0/0 00000100:00100000:3.0:1788986884.301984:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1146 00010000:00010000:2.0:1788986884.307523:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a25d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.307540:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a25d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.307548:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a25d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.307563:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986884.307568:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a25d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.307575:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a25d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.307591:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a55745e00) 00010000:00010000:2.0:1788986884.307594:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986884.307599:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a25d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.307604:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a25d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986884.308204:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986884.308432:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971436160 00000100:00100000:3.0:1788986884.308442:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971436160 00000100:00100000:3.0:1788986884.308504:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1147 00000100:00100000:3.0:1788986884.308515:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:58600:x1875885971436160:12345-192.168.206.21@tcp:36:touch.60003 00010000:00010000:3.0:1788986884.308574:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986884.308593:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1655 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.308607:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986884.308615:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986884.308651:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a272 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.308662:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.308672:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986884.308811:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000097b00ae6 reply state 00000000b8466543 transno 4294967730 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986884.308820:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986884.308914:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58600:x1875885971436160:12345-192.168.206.21@tcp:36:touch.60003 Request processed in 400us (714us total) trans 4294967730 rc 0/0 00000100:00100000:3.0:1788986884.308921:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1147 00010000:00010000:0.0:1788986884.311678:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a272 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.311693:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a272 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.311700:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a272 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.311707:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986884.311711:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a272 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.311719:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a272 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.311733:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:0.0:1788986884.311736:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986884.311741:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a272 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.311750:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a272 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986884.312027:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986884.312118:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971436288 00000100:00100000:2.0:1788986884.312126:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971436288 00000100:00100000:2.0:1788986884.312173:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1148 00000100:00100000:2.0:1788986884.312184:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:58600:x1875885971436288:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:2.0:1788986884.312203:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986884.312221:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a279 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d165c expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.312276:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a279 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d165c expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.312289:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a279 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5e:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d165c expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986884.312305:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986884.312308:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788986884.312311:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788986884.312369:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58600:x1875885971436288:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 187us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986884.312376:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1148 00000100:00100000:3.0:1788986884.315774:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986884.315974:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971436416 00000100:00100000:2.0:1788986884.315982:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971436416 00000100:00100000:2.0:1788986884.316061:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 631 00000100:00080000:0.0:1788986884.316066:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986884.316071:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971436416:12345-192.168.206.21@tcp:2:touch.60003 00000100:00100000:2.0:1788986884.316407:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971436416:12345-192.168.206.21@tcp:2:touch.60003 Request processed in 336us (641us total) trans 4294967368 rc 0/0 00000100:00100000:2.0:1788986884.316415:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 631 00000100:00100000:3.0:1788986884.319277:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986884.319394:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971436672 00000100:00100000:1.0:1788986884.319404:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971436672 00000100:00100000:1.0:1788986884.319460:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 113 00000100:00100000:1.0:1788986884.319469:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58600:x1875885971436672:12345-192.168.206.21@tcp:35:touch.60003 00000100:00100000:1.0:1788986884.320290:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58600:x1875885971436672:12345-192.168.206.21@tcp:35:touch.60003 Request processed in 820us (1019us total) trans 4294967731 rc 0/0 00000100:00100000:1.0:1788986884.320298:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 113 00000100:00100000:0.0:1788986884.363366:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986884.363457:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971436800 00000100:00100000:3.0:1788986884.363467:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971436800 00000100:00100000:3.0:1788986884.363519:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1149 00000100:00100000:3.0:1788986884.363531:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58604:x1875885971436800:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:3.0:1788986884.363563:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986884.363584:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a280 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1663 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363643:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a287 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363657:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a287 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363669:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a287 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363684:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a28e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363692:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363698:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363775:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a295 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363784:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363791:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986884.363822:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5e:0x0]: returning size 0 00000004:00200000:3.0:1788986884.363826:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986884.363844:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363855:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a295 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363864:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a287 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363874:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a287 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.363880:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a287 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.364771:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986884.364778:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a287 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.364787:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a287 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.364800:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:3.0:1788986884.364803:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986884.364808:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a287 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.364814:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a287 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.364829:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a28e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.364835:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a28e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.364841:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a28e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.364846:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986884.364849:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a28e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.364855:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a28e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.364876:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a55745100) 00010000:00010000:3.0:1788986884.364879:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986884.364883:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a28e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.365004:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a28e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.365228:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a280 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1663 expref: 13 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.365243:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a295 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1663 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.365251:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:3.0:1788986884.365254:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788986884.365256:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986884.365323:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58604:x1875885971436800:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 1794us (1967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986884.365331:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1149 00000100:00100000:3.0:1788986884.369989:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986884.370642:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971436928 00000100:00100000:1.0:1788986884.370652:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971436928 00000100:00100000:1.0:1788986884.370781:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 632 00000100:00100000:1.0:1788986884.370792:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971436928:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:1.0:1788986884.370811:0:8478:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986884.370831:0:8478:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a29c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d166a expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788986884.370855:0:8478:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x24:0x0] initial LVB size: 0, mtime: 0x6aa1c604, atime: 0x6aa1c604, ctime: 0x6aa1c604, blocks: 0x1 00010000:00010000:1.0:1788986884.370894:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=2668s v=(0 0) 00010000:00010000:1.0:1788986884.370899:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986884.370909:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a29c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d166a expref: 7 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986884.370926:0:8478:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a29c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d166a expref: 7 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986884.370938:0:8478:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986884.370996:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971436928:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 206us (1021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986884.371003:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 632 00000100:00100000:2.0:1788986884.375317:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986884.375419:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971437184 00000100:00100000:3.0:1788986884.375504:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971437184 00000100:00100000:3.0:1788986884.375600:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1150 00000100:00100000:3.0:1788986884.375611:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58604:x1875885971437184:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:3.0:1788986884.375660:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986884.375686:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a295 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5e:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1663 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.375708:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a279 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x5e:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d165c expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.375720:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff9b0a45acaa00) 00010000:00010000:3.0:1788986884.375730:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986884.375750:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2a3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.375762:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.375772:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.375786:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.375793:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.375799:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.375918:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2b1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.375930:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.375947:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788986884.376760:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].36, 64 off10496 00000004:00080000:3.0:1788986884.376770:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2668279679887ns, next at 2669279677700ns, rc = 0 00010000:00010000:3.0:1788986884.376826:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a2b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.376838:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.376845:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a2b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.376852:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a2b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.376859:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a2b8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.376866:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a2b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377350:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986884.377374:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2b1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377381:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2b1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377387:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377394:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986884.377398:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2b1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377405:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2b1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377416:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:3.0:1788986884.377418:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986884.377424:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2b1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377430:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2b1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5e:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377449:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2a3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377455:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2a3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377461:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377466:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986884.377469:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2a3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377479:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2a3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377486:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:3.0:1788986884.377489:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986884.377492:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2a3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.377497:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2a3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986884.377507:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000024aa6c6b reply state 00000000da088652 transno 4294967732 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986884.377515:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986884.377649:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58604:x1875885971437184:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 2038us (2338us total) trans 4294967732 rc 0/0 00000100:00100000:3.0:1788986884.377658:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1150 00010000:00010000:0.0:1788986884.377852:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986884.378216:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a2b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.378225:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986884.378228:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a2b8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.378234:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a2b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.378244:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5e:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:0.0:1788986884.378247:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788986884.378250:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a2b8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.378256:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a2b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5e:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986884.378272:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986884.378274:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986884.378276:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986884.383613:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.383630:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.383639:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.383645:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986884.383650:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.383661:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.383677:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a55745f00) 00010000:00010000:3.0:1788986884.383680:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986884.383685:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986884.383692:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986885.186982:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986885.235451:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986885.235483:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986885.235505:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986885.235527:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986885.235564:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971437312 00000100:00100000:1.0:1788986885.235572:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971437312 00000100:00100000:1.0:1788986885.235612:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1458 00000100:00100000:1.0:1788986885.235621:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971437312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986885.235741:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971437312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 120us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986885.235749:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1458 00000100:00100000:1.0:1788986885.235778:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971437568 00000100:00100000:1.0:1788986885.235781:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971437568 00000100:00100000:1.0:1788986885.235811:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971437696 00000100:00100000:1.0:1788986885.235814:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971437696 00000100:00100000:1.0:1788986885.235833:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1443 00000100:00100000:1.0:1788986885.235838:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971437568:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986885.235862:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971437568:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986885.235868:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1443 00000100:00100000:1.0:1788986885.235878:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1444 00000100:00100000:1.0:1788986885.235889:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971437696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986885.235907:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971437696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986885.235912:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1444 00000100:00100000:1.0:1788986885.235928:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971437440 00000100:00100000:1.0:1788986885.235930:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971437440 00000100:00100000:1.0:1788986885.235951:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1907 00000100:00100000:1.0:1788986885.235956:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:2348:x1875885971437440:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986885.235980:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:2348:x1875885971437440:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986885.235987:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1907 00000100:00080000:1.0:1788986885.238410:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986885.311584:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986885.311980:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971437824 00000100:00100000:3.0:1788986885.311989:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971437824 00000100:00100000:3.0:1788986885.312287:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1151 00000100:00100000:3.0:1788986885.312303:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58619:x1875885971437824:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986885.312325:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986885.312348:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1671 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.312422:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.312436:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.312451:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986885.312492:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:3.0:1788986885.312497:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986885.312518:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.312557:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1671 expref: 13 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.312579:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1671 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.312589:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:3.0:1788986885.312593:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986885.312597:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2c00, rc 0) 00000100:00100000:3.0:1788986885.314337:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58619:x1875885971437824:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 2031us (2785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986885.314347:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1151 00000100:00100000:0.0:1788986885.325662:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986885.326119:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971438080 00000100:00100000:3.0:1788986885.326130:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971438080 00000100:00100000:3.0:1788986885.326186:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1152 00000100:00100000:3.0:1788986885.326195:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:58619:x1875885971438080:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986885.326242:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986885.326267:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1671 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.326287:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a248 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d164e expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.326297:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:3.0:1788986885.326309:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986885.326332:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.326343:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.326353:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788986885.384253:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967731 is committed 00000001:00080000:2.0:1788986885.384269:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967733 is committed 00000004:00080000:2.0:1788986885.384277:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 100 committed 00000004:00010000:3.0:1788986885.384383:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002280f49b reply state 00000000baf91b49 transno 4294967733 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986885.384397:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986885.384411:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00010000:00080000:3.0:1788986885.384501:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788986885.384529:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58619:x1875885971438080:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 58321us (58859us total) trans 4294967733 rc 0/0 00000100:00100000:3.0:1788986885.384538:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1152 00010000:00010000:3.0:1788986885.384584:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.384593:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.384600:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.384606:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986885.384610:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.384622:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.384636:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:3.0:1788986885.384639:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986885.384644:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.384650:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986885.384875:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986885.384891:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993644160:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788986885.384939:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986885.384996:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993644160 00000100:00100000:1.0:1788986885.385003:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993644160 00000100:00100000:1.0:1788986885.385046:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 633 00000100:00100000:1.0:1788986885.385055:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993644160:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788986885.385077:0:8478:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:36 count 1 00010000:00010000:1.0:1788986885.385119:0:8478:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986885.385136:0:8478:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a29c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d166a expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986885.385145:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788986885.385149:0:8478:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986885.385153:0:8478:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986885.385178:0:8478:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a29c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d166a expref: 6 pid: 8478 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986885.385191:0:8478:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a29c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d166a expref: 6 pid: 8478 timeout: 2769 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986885.385202:0:8478:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8478:1875885993644288:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986885.385240:0:8478:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a457dc300 going to sleep for 11 seconds 00000100:00080000:1.0:1788986885.385251:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986885.390040:0:8478:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe42300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8478:1875885993644288:192.168.206.21@tcp:104: 00010000:00010000:2.0:1788986885.390069:0:8478:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986885.394504:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986885.396903:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971438208 00000100:00100000:3.0:1788986885.396917:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971438208 00010000:00010000:3.0:1788986885.396971:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a29c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d166a expref: 7 pid: 8478 timeout: 2769 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986885.397025:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 462 00000100:00100000:3.0:1788986885.397034:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971438208:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986885.397047:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986885.397053:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a29c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d166a expref: 7 pid: 8478 timeout: 2769 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.397066:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a29c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d166a expref: 7 pid: 8478 timeout: 2769 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.397118:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a7404e9/0xc20d828fcf54a29c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x24:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d166a expref: 7 pid: 8478 timeout: 2769 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.397138:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986885.397143:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986885.397149:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.397158:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.397183:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986885.397234:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971438208:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 201us (2738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986885.397241:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 462 00010000:00010000:2.0:1788986885.397800:0:8478:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986885.397811:0:8478:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986885.397822:0:8478:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986885.397829:0:8478:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986885.397848:0:8478:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788986885.398456:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993644160:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13401us (13515us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788986885.398466:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 633 00000004:00080000:1.0:1788986885.398792:0:3320:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7fe40380/2, rc 0, transno 4294967369 00000100:00100000:1.0:1788986885.398799:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993644160:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788986885.398921:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986885.398928:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.398937:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986885.398952:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.398963:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.398981:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.398994:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019618814/0xc20d828fcf54a2d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8478 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.399023:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986885.399025:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986885.399026:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986885.468207:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986885.468327:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971438336 00000100:00100000:3.0:1788986885.468336:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971438336 00000100:00100000:3.0:1788986885.468389:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1153 00000100:00100000:3.0:1788986885.468400:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58623:x1875885971438336:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:3.0:1788986885.468422:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986885.468442:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1678 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.468499:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2e2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.468521:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.468532:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.468570:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2e9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.468578:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.468589:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.468876:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a2f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.468899:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.468907:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986885.468929:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:3.0:1788986885.468932:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986885.469258:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a2f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469271:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2e2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469278:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2e2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469285:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469291:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986885.469294:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2e2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469302:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2e2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469313:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:3.0:1788986885.469316:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986885.469320:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469326:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a2e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469340:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2e9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469346:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2e9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469352:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469357:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986885.469360:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2e9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469365:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2e9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469372:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a55745f00) 00010000:00010000:3.0:1788986885.469375:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986885.469378:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2e9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469383:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2e9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469418:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1678 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469432:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a2f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1678 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986885.469439:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986885.469441:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986885.469443:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2e00, rc 0) 00000100:00100000:3.0:1788986885.469516:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58623:x1875885971438336:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 1117us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986885.469523:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1153 00010000:00010000:0.0:1788986886.208495:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986886.751465:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986886.751511:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971438464 00000100:00100000:3.0:1788986886.751523:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971438464 00000100:00100000:3.0:1788986886.751760:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1154 00000100:00100000:3.0:1788986886.751774:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58637:x1875885971438464:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986886.751799:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986886.751824:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d167f expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986886.752007:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986886.752024:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986886.752042:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986886.752136:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:3.0:1788986886.752141:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986886.752164:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986886.752192:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a2f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d167f expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986886.752212:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d167f expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986886.752221:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:3.0:1788986886.752224:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986886.752228:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2600, rc 0) 00000100:00100000:3.0:1788986886.752298:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58637:x1875885971438464:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 527us (846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986886.752305:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1154 00000100:00100000:3.0:1788986886.761121:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986886.761193:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971438720 00000100:00100000:2.0:1788986886.761207:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971438720 00000100:00080000:1.0:1788986886.761270:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986886.761284:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1155 00000100:00100000:2.0:1788986886.761299:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58637:x1875885971438720:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:2.0:1788986886.761364:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986886.761398:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a2fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d167f expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986886.761425:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a2f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1678 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986886.761438:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:2.0:1788986886.761453:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986886.761483:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a305 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986886.761498:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986886.761510:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986886.764369:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000f556c698 reply state 00000000929e44ef transno 4294967734 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986886.764393:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986886.764411:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000100:00100000:2.0:1788986886.764568:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58637:x1875885971438720:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 3267us (3486us total) trans 4294967734 rc 0/0 00000100:00100000:2.0:1788986886.764581:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1155 00010000:00010000:3.0:1788986886.771568:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a305 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986886.771591:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a305 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986886.771600:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986886.771609:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986886.771615:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a305 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986886.771624:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a305 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986886.771643:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:3.0:1788986886.771647:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986886.771653:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a305 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986886.771660:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a305 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788986886.803366:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967369 is committed 00000001:00080000:0.0:1788986886.803394:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967368 is committed 00000100:00100000:0.0:1788986886.910838:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986886.912635:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971438848 00000100:00100000:1.0:1788986886.912651:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971438848 00000100:00100000:1.0:1788986886.912738:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1156 00000100:00100000:1.0:1788986886.912751:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58649:x1875885971438848:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986886.912893:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58649:x1875885971438848:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 145us (2070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986886.912901:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1156 00000100:00100000:3.0:1788986886.914855:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986886.915237:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971438976 00000100:00100000:1.0:1788986886.915248:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971438976 00000100:00100000:1.0:1788986886.915316:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 634 00000100:00100000:1.0:1788986886.915327:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58649:x1875885971438976:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986886.915837:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58649:x1875885971438976:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 508us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986886.915845:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 634 00000100:00100000:2.0:1788986886.936885:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986886.936932:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971439104 00000100:00100000:2.0:1788986886.936944:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971439104 00000100:00100000:2.0:1788986886.937013:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 635 00000100:00100000:2.0:1788986886.937025:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58649:x1875885971439104:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986886.941119:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58649:x1875885971439104:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 4066us (4229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986886.941150:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 635 00000100:00080000:2.0:1788986886.941206:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986886.955452:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986886.955504:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971439232 00000100:00100000:3.0:1788986886.955517:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971439232 00000100:00100000:3.0:1788986886.955741:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1157 00000100:00100000:3.0:1788986886.955753:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58649:x1875885971439232:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986886.959933:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58649:x1875885971439232:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 4150us (4462us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986886.959953:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1157 00000100:00100000:2.0:1788986886.966860:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986886.966900:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971439360 00000100:00100000:2.0:1788986886.966910:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971439360 00000100:00100000:2.0:1788986886.966963:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1158 00000100:00100000:2.0:1788986886.966971:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58649:x1875885971439360:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986886.967127:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58649:x1875885971439360:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 155us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986886.967133:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1158 00000100:00100000:2.0:1788986886.975798:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986886.975843:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971439488 00000100:00100000:2.0:1788986886.975858:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971439488 00000100:00100000:2.0:1788986886.975996:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 636 00000100:00100000:2.0:1788986886.976009:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58649:x1875885971439488:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986886.976499:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58649:x1875885971439488:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 490us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986886.976509:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 636 00000100:00100000:2.0:1788986886.980054:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986886.981435:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971439616 00000100:00100000:1.0:1788986886.981451:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971439616 00000100:00100000:1.0:1788986886.981858:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 637 00000100:00100000:1.0:1788986886.981871:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58649:x1875885971439616:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986886.983815:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58649:x1875885971439616:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 1937us (3763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986886.983829:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 637 00000100:00100000:2.0:1788986886.988083:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986886.988150:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971439744 00000100:00100000:1.0:1788986886.988163:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971439744 00000100:00100000:1.0:1788986886.988361:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1159 00000100:00100000:1.0:1788986886.988375:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58649:x1875885971439744:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986886.988915:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58649:x1875885971439744:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 542us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986886.988926:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1159 00000100:00100000:2.0:1788986887.050400:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986887.050594:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971439872 00000100:00100000:3.0:1788986887.050611:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971439872 00000100:00100000:3.0:1788986887.050720:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1160 00000100:00100000:3.0:1788986887.050734:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:58653:x1875885971439872:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:3.0:1788986887.050760:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986887.050786:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a30c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1686 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.050875:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a313 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.050894:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a313 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.050909:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a313 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.050927:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a31a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.050935:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a31a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.050943:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a31a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051661:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a321 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051677:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051686:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986887.051716:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:3.0:1788986887.051722:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986887.051749:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a321 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051765:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a313 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051773:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a313 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051781:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a313 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051787:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986887.051792:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a313 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051801:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a313 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051815:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:3.0:1788986887.051818:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986887.051823:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a313 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051830:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a313 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051848:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a31a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051855:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a31a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051921:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a31a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051928:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986887.051931:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a31a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051938:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a31a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051947:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a55745e00) 00010000:00010000:3.0:1788986887.051950:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986887.051953:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a31a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051959:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a31a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.051996:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a30c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1686 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.052076:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a321 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1686 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.052085:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:3.0:1788986887.052127:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986887.052130:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3c00, rc 0) 00000100:00100000:3.0:1788986887.052221:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58653:x1875885971439872:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 1490us (1834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986887.052231:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1160 00000100:00100000:2.0:1788986887.054672:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986887.055487:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971440128 00000100:00100000:0.0:1788986887.055502:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971440128 00000100:00100000:0.0:1788986887.055620:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1161 00000100:00100000:0.0:1788986887.055633:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58653:x1875885971440128:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:0.0:1788986887.055661:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986887.055687:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a328 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d168d expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.056027:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a32f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.056045:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a32f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.056058:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a32f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.056074:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a336 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.056081:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a336 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.056119:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a336 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986887.056857:0:15241:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x25:0x0], index 0: 0 00010000:00010000:0.0:1788986887.057125:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a33d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.057139:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a33d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.057149:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a33d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.057196:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a32f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.057204:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a32f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.057211:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a32f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.057218:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986887.057224:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a32f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.057233:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a32f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.057246:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:0.0:1788986887.057250:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986887.057255:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a32f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.057267:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a32f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986887.057281:0:15241:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000004c40e784 reply state 00000000e3697b38 transno 4294967735 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a336 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986887.057291:0:15241:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788986887.057616:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a328 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d168d expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.057635:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a33d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d168d expref: 10 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986887.057643:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:0.0:1788986887.057647:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986887.057649:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788986887.057733:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:58653:x1875885971440128:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 2103us (3073us total) trans 4294967735 rc 0/0 00000100:00100000:0.0:1788986887.057798:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1161 00010000:00010000:3.0:1788986887.063391:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a336 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.063477:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a336 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.063487:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a336 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.063494:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986887.063500:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a336 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.063509:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a336 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.063530:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a4823ba00) 00010000:00010000:3.0:1788986887.063533:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986887.063548:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a336 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986887.063556:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a336 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986887.065204:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986887.065466:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971440256 00000100:00100000:1.0:1788986887.065481:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971440256 00000100:00100000:1.0:1788986887.065619:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 638 00000100:00100000:1.0:1788986887.065633:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58653:x1875885971440256:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:1.0:1788986887.065659:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986887.065689:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf54a34b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1694 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788986887.065727:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788986887.065761:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=2670s v=(0 0) 00010000:00010000:1.0:1788986887.065767:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986887.065778:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf54a34b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1694 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986887.065801:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf54a34b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1694 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986887.065818:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986887.065901:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58653:x1875885971440256:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 271us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986887.065909:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 638 00000100:00080000:2.0:1788986887.066115:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986887.079186:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986887.079341:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971440384 00000100:00100000:3.0:1788986887.079357:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971440384 00002000:00100000:2.0:1788986887.079606:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x25:0x0] (0->1048575) req@ffff9b0942eeb100 x1875885971440384/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:53/0 lens 488/0 e 0 to 0 dl 1788986898 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1788986887.079622:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0942eeb100 with x1875885971440384 ext(0->1048575) 00002000:00010000:2.0:1788986887.079631:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0942eeb100 00000100:00100000:2.0:1788986887.079702:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 29 00000100:00100000:2.0:1788986887.079714:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971440384:12345-192.168.206.21@tcp:4:dd.60003 00000100:00100000:2.0:1788986887.121965:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971440384:12345-192.168.206.21@tcp:4:dd.60003 Request processed in 42238us (42783us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788986887.121986:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 29 00002000:00100000:2.0:1788986887.122002:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x25:0x0] (0->1048575) req@ffff9b0942eeb100 x1875885971440384/t4294967370(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:53/0 lens 488/448 e 0 to 0 dl 1788986898 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:2.0:1788986887.122014:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0942eeb100 with x1875885971440384 ext(0->1048575) 00002000:00010000:2.0:1788986887.122024:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9b0942eeb100 00000100:00100000:0.0:1788986887.127217:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986887.127555:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971440512 00000100:00100000:1.0:1788986887.127568:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971440512 00000100:00100000:1.0:1788986887.127638:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1162 00000100:00100000:1.0:1788986887.127649:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:58653:x1875885971440512:12345-192.168.206.21@tcp:44:dd.60003 00000001:00080000:2.0:1788986887.163546:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967735 is committed 00000100:00100000:0.0:1788986887.163838:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58653:x1875885971440512:12345-192.168.206.21@tcp:44:dd.60003 Request processed in 36183us (36627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986887.163852:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1162 00000100:00100000:0.0:1788986887.169633:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993644416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986887.169726:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986887.169784:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993644416 00000100:00100000:3.0:1788986887.169794:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993644416 00000100:00080000:0.0:1788986887.169832:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986887.169872:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:3.0:1788986887.169883:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993644416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986887.169909:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49217536 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986887.170042:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986887.170073:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971440640 00000100:00100000:2.0:1788986887.170078:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971440640 00000100:00100000:3.0:1788986887.170125:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993644416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 244us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986887.170135:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:1.0:1788986887.170266:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993644416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986887.170391:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 639 00000100:00100000:2.0:1788986887.170403:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971440640:12345-192.168.206.21@tcp:16:dd.60003 00000001:00080000:0.0:1788986887.213067:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967370 is committed 00000100:00100000:3.0:1788986887.213701:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971440640:12345-192.168.206.21@tcp:16:dd.60003 Request processed in 43291us (43653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986887.213716:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 639 00000100:00100000:1.0:1788986887.221908:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986887.222425:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971440896 00000100:00100000:2.0:1788986887.222437:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971440896 00000100:00100000:2.0:1788986887.222550:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 114 00000100:00100000:2.0:1788986887.222563:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58653:x1875885971440896:12345-192.168.206.21@tcp:35:dd.60003 00000100:00100000:2.0:1788986887.223342:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:58653:x1875885971440896:12345-192.168.206.21@tcp:35:dd.60003 Request processed in 779us (1446us total) trans 4294967736 rc 0/0 00000100:00100000:2.0:1788986887.223352:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 114 00010000:00010000:3.0:1788986887.232374:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986888.194049:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993644928:0@lo:400:kworker.0 00000100:00100000:0.0:1788986888.194176:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986888.194465:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993644544:0@lo:400:kworker.0 00000100:00100000:2.0:1788986888.194515:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986888.194563:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993645056:0@lo:400:kworker.0 00000100:00100000:2.0:1788986888.194592:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986888.194646:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993644544 00000100:00100000:2.0:1788986888.194656:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993644544 00000100:00100000:2.0:1788986888.194723:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1459 00000100:00100000:2.0:1788986888.194734:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993644544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986888.194800:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993644544:12345-0@lo:400:kworker.0 Request processed in 67us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986888.194808:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1459 00000100:00100000:2.0:1788986888.194849:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993645056 00000100:00100000:2.0:1788986888.194853:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993645056 00000100:00100000:2.0:1788986888.194899:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1908 00000100:00100000:2.0:1788986888.194907:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993645056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986888.194956:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993645056:12345-0@lo:400:kworker.0 Request processed in 51us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986888.194963:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1908 00000100:00080000:2.0:1788986888.194988:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986888.195038:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993644544:0@lo:400:kworker.0 00000100:00100000:2.0:1788986888.195053:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993645056:0@lo:400:kworker.0 00000100:00100000:0.0:1788986888.195350:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993644672:0@lo:400:kworker.0 00000100:00100000:0.0:1788986888.195389:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986888.195422:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993645184:0@lo:400:kworker.0 00000100:00100000:0.0:1788986888.195445:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986888.195468:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986888.195476:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993644800:0@lo:400:kworker.0 00000100:00100000:0.0:1788986888.195498:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986888.195542:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993644928 00000100:00100000:0.0:1788986888.195546:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993644928 00000100:00100000:0.0:1788986888.195581:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993645184 00000100:00100000:0.0:1788986888.195584:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993645184 00000100:00100000:0.0:1788986888.195614:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1788986888.195621:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993644928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986888.195663:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993644928:12345-0@lo:400:kworker.0 Request processed in 43us (1489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986888.195670:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1445 00000100:00100000:0.0:1788986888.195685:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1788986888.195691:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993645184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986888.195724:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993645184:12345-0@lo:400:kworker.0 Request processed in 33us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986888.195730:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1446 00000100:00100000:0.0:1788986888.195762:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967369 gen 2 00000004:00080000:0.0:1788986888.195768:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7fe40380, transno 4294967369 00000100:00100000:0.0:1788986888.195781:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eeaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993645184:0@lo:400:kworker.0 00000100:00100000:2.0:1788986888.196363:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993644672 00000100:00100000:2.0:1788986888.196369:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993644672 00000100:00100000:2.0:1788986888.196403:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993644800 00000100:00100000:2.0:1788986888.196406:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993644800 00000100:00100000:2.0:1788986888.196430:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1788986888.196438:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993644672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986888.196495:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993644672:12345-0@lo:400:kworker.0 Request processed in 58us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986888.196501:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1909 00000100:00100000:2.0:1788986888.196513:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1910 00000100:00100000:2.0:1788986888.196519:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993644800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986888.196557:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993644800:12345-0@lo:400:kworker.0 Request processed in 39us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986888.196563:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1910 00000100:00080000:2.0:1788986888.196595:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986888.196601:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986888.196628:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993644800:0@lo:400:kworker.0 00000100:00100000:2.0:1788986888.196639:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993644672:0@lo:400:kworker.0 00000100:00100000:0.0:1788986888.196865:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993644928:0@lo:400:kworker.0 00010000:00010000:0.0:1788986888.256433:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788986888.465101:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967736 is committed 00000100:00100000:1.0:1788986888.704491:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986888.706335:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993645312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986888.706435:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986888.706586:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993645312 00000100:00100000:3.0:1788986888.706598:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993645312 00000100:00100000:3.0:1788986888.706665:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:3.0:1788986888.706676:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993645312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986888.706722:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986888.707210:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993645312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986888.707220:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1788986888.708243:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993645312:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986889.280202:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788986889.689812:0:100205:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2673592720565ns, next at 2651350439273ns, rc = 0 00000004:00080000:2.0:1788986889.689960:0:100205:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2673592869522ns, next at 2669279677700ns, rc = 0 00000004:00080000:1.0:1788986889.702227:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 101 committed 00000004:00080000:1.0:1788986889.702265:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 99 committed 00010000:00010000:0.0:1788986890.304692:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986890.356327:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986890.356380:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986890.356416:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986890.356473:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986890.356505:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971441152 00000100:00100000:2.0:1788986890.356516:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971441152 00000100:00100000:2.0:1788986890.356605:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1911 00000100:00100000:2.0:1788986890.356617:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971441152:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986890.356717:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971441152:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 102us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986890.356725:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1911 00000100:00100000:2.0:1788986890.356755:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971441280 00000100:00100000:2.0:1788986890.356759:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971441280 00000100:00100000:2.0:1788986890.356788:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971441408 00000100:00100000:2.0:1788986890.356791:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971441408 00000100:00100000:2.0:1788986890.356815:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1447 00000100:00100000:2.0:1788986890.356822:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971441280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986890.356851:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971441280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986890.356857:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1447 00000100:00100000:2.0:1788986890.356870:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1448 00000100:00100000:2.0:1788986890.356876:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971441408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986890.356904:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971441408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986890.356910:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1448 00000100:00080000:2.0:1788986890.356928:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986890.356932:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986890.356935:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986890.357258:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971441024 00000100:00100000:1.0:1788986890.357265:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971441024 00000100:00100000:1.0:1788986890.357309:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1460 00000100:00100000:1.0:1788986890.357317:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971441024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986890.357346:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971441024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986890.357353:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1460 00010000:00010000:3.0:1788986891.339450:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986891.339572:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986891.342989:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971441536 00000100:00100000:3.0:1788986891.343001:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971441536 00000100:00100000:3.0:1788986891.343075:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1163 00000100:00100000:3.0:1788986891.343105:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58846:x1875885971441536:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986891.343212:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58846:x1875885971441536:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 127us (3645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986891.343220:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1163 00000100:00100000:1.0:1788986891.350836:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986891.350926:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971441664 00000100:00100000:0.0:1788986891.350953:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971441664 00000100:00100000:0.0:1788986891.351020:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 640 00000100:00100000:0.0:1788986891.351031:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58846:x1875885971441664:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986891.351470:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58846:x1875885971441664:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 439us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986891.351479:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 640 00000100:00100000:0.0:1788986891.353324:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986891.353431:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971441792 00000100:00100000:1.0:1788986891.353442:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971441792 00000100:00100000:1.0:1788986891.353501:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 641 00000100:00100000:1.0:1788986891.353523:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58846:x1875885971441792:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986891.353956:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58846:x1875885971441792:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 444us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986891.353965:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 641 00000100:00100000:0.0:1788986891.358951:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986891.359049:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971441920 00000100:00100000:3.0:1788986891.359068:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971441920 00000100:00100000:3.0:1788986891.359219:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1164 00000100:00100000:3.0:1788986891.359236:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58846:x1875885971441920:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986891.359839:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58846:x1875885971441920:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 606us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986891.359848:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1164 00000100:00100000:0.0:1788986891.368555:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986891.368646:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971442048 00000100:00100000:1.0:1788986891.368659:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971442048 00000100:00100000:1.0:1788986891.368731:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1165 00000100:00100000:1.0:1788986891.368743:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58846:x1875885971442048:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986891.368871:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58846:x1875885971442048:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 130us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986891.368879:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1165 00000100:00100000:0.0:1788986891.372445:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986891.372948:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971442176 00000100:00100000:3.0:1788986891.372962:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971442176 00000100:00100000:3.0:1788986891.373039:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 642 00000100:00100000:3.0:1788986891.373052:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58846:x1875885971442176:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986891.374943:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:58846:x1875885971442176:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 1882us (2501us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986891.374956:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 642 00000100:00100000:0.0:1788986891.378596:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986891.378712:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971442304 00000100:00100000:1.0:1788986891.378723:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971442304 00000100:00100000:1.0:1788986891.378795:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 643 00000100:00100000:1.0:1788986891.378806:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58846:x1875885971442304:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986891.379298:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:58846:x1875885971442304:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 491us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986891.379307:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 643 00000100:00100000:0.0:1788986891.382896:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986891.383357:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971442432 00000100:00100000:3.0:1788986891.383369:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971442432 00000100:00100000:3.0:1788986891.383445:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1166 00000100:00100000:3.0:1788986891.383457:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58846:x1875885971442432:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986891.384429:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58846:x1875885971442432:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 969us (1539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986891.384439:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1166 00000100:00100000:0.0:1788986891.454024:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986891.454433:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971442688 00000100:00100000:1.0:1788986891.454447:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971442688 00000100:00100000:1.0:1788986891.454521:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1167 00000100:00100000:1.0:1788986891.454533:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:58850:x1875885971442688:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:1.0:1788986891.454592:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986891.454625:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a33d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d168d expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.454647:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9b0a4823b200) 00010000:00010000:1.0:1788986891.454659:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986891.454687:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a352 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.454702:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a352 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.454712:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a352 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.454727:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a359 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.454733:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a359 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.454739:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a359 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.455914:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a360 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.455931:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a360 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.455947:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a360 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788986891.463206:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].37, 64 off10560 00000004:00080000:1.0:1788986891.463231:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2675366140884ns, next at 2676366136521ns, rc = 0 00010000:00010000:1.0:1788986891.463413:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a367 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463430:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a367 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463442:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a367 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463455:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a367 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463462:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a367 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463470:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a367 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463493:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986891.463529:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a360 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463537:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a360 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463544:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a360 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463549:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986891.463554:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a360 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463561:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a360 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463572:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:1.0:1788986891.463575:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986891.463580:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a360 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463589:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a360 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5f:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463610:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a352 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463615:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a352 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463621:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a352 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463626:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986891.463628:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a352 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463634:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a352 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463641:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:1.0:1788986891.463643:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986891.463647:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a352 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986891.463652:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a352 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x5a:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986891.463662:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000033a27d5d reply state 00000000912dc49a transno 4294967737 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a359 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986891.463670:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986891.463779:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:58850:x1875885971442688:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 9246us (9760us total) trans 4294967737 rc 0/0 00000100:00100000:1.0:1788986891.463788:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1167 00010000:00010000:2.0:1788986891.466983:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986891.466996:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a367 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986891.467008:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986891.467012:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a367 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986891.467024:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a367 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986891.467043:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5f:0x0].0x0 (ffff9b0a45316100) 00010000:00010000:2.0:1788986891.467047:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788986891.467053:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a367 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986891.467060:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a367 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5f:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986891.467086:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986891.467101:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986891.467103:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986891.478580:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a359 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986891.478603:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a359 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986891.478611:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a359 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986891.478618:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986891.478623:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a359 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986891.478630:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a359 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986891.478648:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x7c633847 (ffff9b0a45316500) 00010000:00010000:2.0:1788986891.478651:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986891.478657:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a359 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986891.478662:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a359 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x5a:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986892.288424:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993645440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986892.288498:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986892.288677:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993645440 00000100:00100000:3.0:1788986892.288687:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993645440 00000100:00100000:3.0:1788986892.288754:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:3.0:1788986892.288763:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993645440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986892.288804:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788986892.288847:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993645440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986892.288854:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00080000:0.0:1788986892.289022:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986892.289062:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993645440:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986892.361129:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986893.313226:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993645568:0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.313294:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986893.313337:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993646080:0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.313364:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986893.313388:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986893.313394:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993645952:0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.313416:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986893.313443:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993645696:0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.313464:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986893.313481:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993646208:0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.313501:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986893.313528:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986893.313533:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993645824:0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.313552:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986893.313581:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993645568 00000100:00100000:3.0:1788986893.313587:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993645568 00000100:00100000:3.0:1788986893.313624:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1788986893.313632:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993645568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.313674:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993645568:12345-0@lo:400:kworker.0 Request processed in 43us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986893.313680:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1788986893.313707:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993646080 00000100:00100000:3.0:1788986893.313710:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993646080 00000100:00100000:3.0:1788986893.313739:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993645696 00000100:00100000:3.0:1788986893.313742:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993645696 00000100:00100000:3.0:1788986893.313757:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993645824 00000100:00100000:3.0:1788986893.313759:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993645824 00000100:00100000:3.0:1788986893.313772:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1912 00000100:00100000:3.0:1788986893.313777:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993646080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.313805:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993646080:12345-0@lo:400:kworker.0 Request processed in 28us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986893.313811:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1912 00000100:00100000:3.0:1788986893.313821:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1788986893.313826:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993645696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.313853:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993645696:12345-0@lo:400:kworker.0 Request processed in 27us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986893.313859:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1913 00000100:00100000:3.0:1788986893.313868:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1788986893.313873:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993645824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.313895:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993645824:12345-0@lo:400:kworker.0 Request processed in 22us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986893.313900:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1914 00000100:00100000:3.0:1788986893.313915:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993645952 00000100:00100000:3.0:1788986893.313918:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993645952 00000100:00100000:3.0:1788986893.313936:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993646208 00000100:00100000:3.0:1788986893.313938:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993646208 00000100:00100000:3.0:1788986893.313956:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1788986893.313961:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993645952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.314061:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993645952:12345-0@lo:400:kworker.0 Request processed in 99us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986893.314067:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1449 00000100:00100000:3.0:1788986893.314080:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1450 00000100:00100000:3.0:1788986893.314086:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993646208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.314136:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993646208:12345-0@lo:400:kworker.0 Request processed in 51us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986893.314143:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1450 00000100:00080000:3.0:1788986893.314169:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986893.314173:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986893.314208:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993645824:0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.314218:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993645696:0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.314226:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993646208:0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.314251:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993645952:0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.314259:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993645568:0@lo:400:kworker.0 00000100:00100000:3.0:1788986893.314268:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993646080:0@lo:400:kworker.0 00010000:00010000:0.0:1788986893.381541:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986893.833064:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993646336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986893.833147:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986893.833226:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993646336 00000100:00100000:2.0:1788986893.833235:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993646336 00000100:00100000:2.0:1788986893.833283:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:2.0:1788986893.833291:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993646336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986893.833323:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986893.833372:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993646336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986893.833380:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:2.0:1788986893.833429:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993646336:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788986893.852544:0:100350:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2677755452294ns, next at 2676366136521ns, rc = 0 00000004:00080000:1.0:1788986893.909315:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 101 committed 00000001:00080000:1.0:1788986893.909347:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967737 is committed 00000004:00080000:1.0:1788986893.909354:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 100 committed 00000100:00100000:1.0:1788986893.909523:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986893.909547:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993646464:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788986893.909651:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986893.909725:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993646464 00000100:00100000:0.0:1788986893.909756:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993646464 00000100:00100000:0.0:1788986893.909848:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 644 00000100:00100000:0.0:1788986893.909867:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993646464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788986893.909905:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:37 count 1 00010000:00010000:0.0:1788986893.909942:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986893.910207:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf54a34b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1694 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986893.910226:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x25:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1788986893.910232:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986893.910240:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986893.910297:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf54a34b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1694 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986893.910339:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf54a34b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1694 expref: 5 pid: 6695 timeout: 2777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986893.910362:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993646592:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986893.913660:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986893.913744:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971442816 00000100:00100000:3.0:1788986893.913752:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971442816 00010000:00010000:3.0:1788986893.913805:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf54a34b lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1694 expref: 6 pid: 6695 timeout: 2777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986893.913853:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 463 00000100:00100000:3.0:1788986893.913864:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971442816:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986893.913877:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986893.913883:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf54a34b lrc: 6/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1694 expref: 6 pid: 6695 timeout: 2777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986893.913897:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf54a34b lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1694 expref: 6 pid: 6695 timeout: 2777 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986893.913922:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986893.913927:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x25:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788986893.913932:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986893.913942:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986893.913961:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986893.914010:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971442816:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 148us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986893.914018:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 463 00000100:00080000:0.0:1788986893.914080:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986893.916570:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5ab38180 going to sleep for 11 seconds 00010000:00010000:1.0:1788986893.916632:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000001199380/0xc20d828fcf54a34b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1694 expref: 5 pid: 6695 timeout: 2777 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986893.916663:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993646592:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788986893.916696:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986893.916709:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986893.916718:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986893.916840:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986893.916860:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986893.916903:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986893.916934:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986893.916944:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986893.916955:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986893.916960:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986893.916981:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986893.917002:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986893.917016:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b921907/0xc20d828fcf54a36e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986893.917039:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986893.917040:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986893.917042:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986893.918017:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993646464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8152us (8361us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788986893.918028:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 644 00000004:00080000:3.0:1788986893.918082:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7fe41c00/2, rc 0, transno 4294967371 00000100:00100000:3.0:1788986893.918112:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993646464:0@lo:6:osp-syn-0-0.0 00000004:00080000:1.0:1788986893.919561:0:100350:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2677822470230ns, next at 2669279677700ns, rc = 0 00000004:00080000:2.0:1788986893.931607:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 102 committed 00010000:00010000:3.0:1788986894.401554:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986895.426659:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986895.476795:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986895.476838:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986895.476864:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986895.476897:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986895.476927:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971443328 00000100:00100000:1.0:1788986895.476936:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971443328 00000100:00100000:1.0:1788986895.476994:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971443200 00000100:00100000:1.0:1788986895.476998:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971443200 00000100:00100000:1.0:1788986895.477024:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1451 00000100:00100000:1.0:1788986895.477035:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971443328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986895.477238:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971442944 00000100:00100000:2.0:1788986895.477243:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971442944 00000100:00100000:2.0:1788986895.477279:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1462 00000100:00100000:2.0:1788986895.477288:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971442944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986895.477319:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971442944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986895.477326:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1462 00000100:00100000:2.0:1788986895.477387:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1452 00000100:00100000:2.0:1788986895.477395:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971443200:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986895.477420:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971443200:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986895.477425:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1452 00000100:00080000:2.0:1788986895.477449:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986895.477454:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986895.477763:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971443072 00000100:00100000:3.0:1788986895.477768:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971443072 00000100:00100000:3.0:1788986895.477816:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1915 00000100:00100000:3.0:1788986895.477823:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971443072:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986895.477863:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971443072:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 41us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986895.477870:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1915 00000100:00100000:1.0:1788986895.477965:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971443328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 103us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986895.477972:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1451 00000100:00080000:2.0:1788986895.478036:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788986896.453896:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986896.484364:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967371 is committed 00000100:00100000:2.0:1788986897.408674:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986897.408704:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993646720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986897.408795:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986897.408925:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993646720 00000100:00100000:3.0:1788986897.408932:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993646720 00000100:00100000:3.0:1788986897.409000:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:3.0:1788986897.409009:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993646720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986897.409042:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986897.409130:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993646720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986897.409137:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:3.0:1788986897.409201:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967371 gen 2 00000004:00080000:3.0:1788986897.409207:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7fe41c00, transno 4294967371 00000100:00100000:3.0:1788986897.409226:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993646720:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986897.409884:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986897.475881:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986898.432409:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993646848:0@lo:400:kworker.0 00000100:00100000:0.0:1788986898.432490:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986898.432500:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986898.432512:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993647232:0@lo:400:kworker.0 00000100:00100000:3.0:1788986898.432534:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993646848 00000100:00100000:3.0:1788986898.432543:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993646848 00000100:00100000:0.0:1788986898.432558:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986898.432585:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993647360:0@lo:400:kworker.0 00000100:00100000:0.0:1788986898.432588:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993647104:0@lo:400:kworker.0 00000100:00100000:3.0:1788986898.432593:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1463 00000100:00100000:3.0:1788986898.432605:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993646848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986898.432625:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986898.432651:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993647360 00000100:00100000:0.0:1788986898.432656:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993647360 00000100:00100000:3.0:1788986898.432663:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993646848:12345-0@lo:400:kworker.0 Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986898.432670:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1463 00000100:00100000:2.0:1788986898.432674:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993646848:0@lo:400:kworker.0 00000100:00100000:2.0:1788986898.432695:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788986898.432703:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993646976:0@lo:400:kworker.0 00000100:00100000:0.0:1788986898.432709:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1916 00000100:00100000:0.0:1788986898.432720:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993647360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986898.432731:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986898.432751:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993647488:0@lo:400:kworker.0 00000100:00100000:0.0:1788986898.432766:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993647360:12345-0@lo:400:kworker.0 Request processed in 47us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986898.432770:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993646976 00000100:00100000:3.0:1788986898.432776:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993646976 00000100:00100000:0.0:1788986898.432776:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1916 00000100:00100000:2.0:1788986898.432783:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986898.432799:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1917 00000100:00100000:0.0:1788986898.432809:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993646976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986898.432898:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993647232 00000100:00100000:3.0:1788986898.432903:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993647232 00000100:00100000:0.0:1788986898.433520:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993646976:12345-0@lo:400:kworker.0 Request processed in 712us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986898.433529:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1917 00000100:00080000:0.0:1788986898.433550:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986898.433648:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993647488 00000100:00100000:1.0:1788986898.433653:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993647488 00000100:00100000:0.0:1788986898.433693:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986898.433740:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993647104 00000100:00100000:0.0:1788986898.433744:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993647104 00000100:00100000:3.0:1788986898.434274:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1453 00000100:00100000:3.0:1788986898.434290:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993647232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986898.434356:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993647232:12345-0@lo:400:kworker.0 Request processed in 70us (1797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986898.434363:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1453 00000100:00100000:0.0:1788986898.434567:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1918 00000100:00100000:0.0:1788986898.434574:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993647104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986898.434608:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993647104:12345-0@lo:400:kworker.0 Request processed in 35us (917us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986898.434614:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1918 00000100:00100000:0.0:1788986898.434652:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993647232:0@lo:400:kworker.0 00000100:00100000:0.0:1788986898.434663:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993647104:0@lo:400:kworker.0 00000100:00080000:3.0:1788986898.434713:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986898.434717:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986898.435079:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1454 00000100:00100000:1.0:1788986898.435106:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993647488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986898.435149:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993647488:12345-0@lo:400:kworker.0 Request processed in 63us (2368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986898.435154:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1454 00000100:00100000:2.0:1788986898.437947:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993647488:0@lo:400:kworker.0 00000100:00100000:2.0:1788986898.437967:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993647360:0@lo:400:kworker.0 00000100:00100000:2.0:1788986898.438009:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993646976:0@lo:400:kworker.0 00010000:00010000:3.0:1788986898.496374:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986898.946582:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986898.946614:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993647616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986898.946689:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986898.946783:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993647616 00000100:00100000:0.0:1788986898.946793:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993647616 00000100:00100000:0.0:1788986898.946850:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1788986898.946861:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993647616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986898.946903:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986898.946951:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993647616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986898.946957:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 975 00000100:00100000:0.0:1788986898.947016:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993647616:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986899.521339:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986900.544211:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986900.593172:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986900.593280:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971443456 00000100:00100000:2.0:1788986900.593291:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971443456 00000100:00100000:2.0:1788986900.593347:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1464 00000100:00100000:2.0:1788986900.593357:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971443456:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986900.593515:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971443456:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 158us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986900.593524:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1464 00000100:00100000:3.0:1788986900.597304:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986900.597356:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986900.597389:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986900.597497:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971443584 00000100:00100000:1.0:1788986900.597507:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971443584 00000100:00100000:1.0:1788986900.597574:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1919 00000100:00100000:1.0:1788986900.597584:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971443584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986900.597654:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971443584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986900.597661:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1919 00000100:00100000:0.0:1788986900.598389:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971443840 00000100:00100000:0.0:1788986900.598397:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971443840 00000100:00100000:0.0:1788986900.598447:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971443712 00000100:00100000:0.0:1788986900.598450:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971443712 00000100:00100000:0.0:1788986900.598484:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1455 00000100:00100000:0.0:1788986900.598493:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971443840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986900.598540:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971443840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 49us (1183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986900.598547:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1455 00000100:00100000:0.0:1788986900.598564:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1456 00000100:00100000:0.0:1788986900.598571:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971443712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986900.598594:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971443712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986900.598601:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1456 00000100:00080000:3.0:1788986900.599302:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986900.599310:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986900.599313:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788986901.568397:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986902.528485:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986902.528521:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993647744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986902.528600:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986902.528926:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993647744 00000100:00100000:3.0:1788986902.528935:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993647744 00000100:00100000:3.0:1788986902.529002:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:3.0:1788986902.529011:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993647744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986902.529045:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986902.529118:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993647744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986902.529124:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1788986902.529255:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993647744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788986902.529509:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986902.593422:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986903.552752:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993648256:0@lo:400:kworker.0 00000100:00100000:0.0:1788986903.552827:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986903.552903:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986903.552910:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993648128:0@lo:400:kworker.0 00000100:00100000:3.0:1788986903.553045:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993648256 00000100:00100000:3.0:1788986903.553053:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993648256 00000100:00100000:3.0:1788986903.553108:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1457 00000100:00100000:3.0:1788986903.553115:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993648256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986903.553223:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993648000:0@lo:400:kworker.0 00000100:00100000:2.0:1788986903.553556:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993647872:0@lo:400:kworker.0 00000100:00100000:3.0:1788986903.560273:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993648256:12345-0@lo:400:kworker.0 Request processed in 7149us (7437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986903.560288:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1457 00000100:00100000:0.0:1788986903.560704:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986903.560787:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993648256:0@lo:400:kworker.0 00000100:00100000:3.0:1788986903.561012:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993648128 00000100:00100000:3.0:1788986903.561020:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993648128 00000100:00100000:3.0:1788986903.561076:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1920 00000100:00100000:3.0:1788986903.561084:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993648128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986903.561158:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993648128:12345-0@lo:400:kworker.0 Request processed in 75us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986903.561165:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1920 00000100:00080000:0.0:1788986903.561319:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986903.561344:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993648128:0@lo:400:kworker.0 00000100:00100000:2.0:1788986903.566329:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986903.566411:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993648384:0@lo:400:kworker.0 00000100:00100000:2.0:1788986903.566462:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986903.566514:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993648384 00000100:00100000:2.0:1788986903.566521:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993648384 00000100:00100000:2.0:1788986903.566598:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1921 00000100:00100000:2.0:1788986903.566609:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993648384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986903.566679:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993648384:12345-0@lo:400:kworker.0 Request processed in 73us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986903.566687:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1921 00000100:00100000:2.0:1788986903.566747:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993648384:0@lo:400:kworker.0 00000100:00100000:3.0:1788986903.566843:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993647872 00000100:00100000:3.0:1788986903.566849:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993647872 00000100:00100000:3.0:1788986903.566884:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:3.0:1788986903.566892:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993647872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986903.566943:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993647872:12345-0@lo:400:kworker.0 Request processed in 53us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986903.566950:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00080000:0.0:1788986903.571973:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986903.572049:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986903.572115:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993648512:0@lo:400:kworker.0 00000100:00100000:0.0:1788986903.572150:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986903.572207:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993648512 00000100:00100000:0.0:1788986903.572216:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993648512 00000100:00100000:0.0:1788986903.572269:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1458 00000100:00100000:0.0:1788986903.572279:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993648512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986903.572331:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993648512:12345-0@lo:400:kworker.0 Request processed in 54us (179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986903.572338:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1458 00000100:00080000:0.0:1788986903.572358:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986903.572385:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993648512:0@lo:400:kworker.0 00000100:00100000:2.0:1788986903.572776:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993647872:0@lo:400:kworker.0 00000100:00100000:3.0:1788986903.576901:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993648000 00000100:00100000:3.0:1788986903.576915:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993648000 00000100:00100000:3.0:1788986903.578763:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1922 00000100:00100000:3.0:1788986903.578777:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993648000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986903.578892:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993648000:12345-0@lo:400:kworker.0 Request processed in 118us (6846us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986903.578899:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1922 00000100:00100000:1.0:1788986903.578991:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993648000:0@lo:400:kworker.0 00010000:00010000:1.0:1788986903.616358:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986904.064327:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993648640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986904.064390:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986904.064555:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993648640 00000100:00100000:3.0:1788986904.064563:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993648640 00000100:00100000:3.0:1788986904.064616:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:3.0:1788986904.064625:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993648640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986904.064656:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986904.064713:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993648640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986904.064720:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:2.0:1788986904.064839:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993648640:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986904.642746:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986905.664373:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986905.712670:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986905.712714:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986905.712749:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986905.712785:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986905.712858:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971444096 00000100:00100000:0.0:1788986905.712870:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971444096 00000100:00100000:0.0:1788986905.712950:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1923 00000100:00100000:0.0:1788986905.712961:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971444096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986905.713043:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971444096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986905.713050:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1923 00000100:00100000:1.0:1788986905.713353:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971443968 00000100:00100000:1.0:1788986905.713372:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971443968 00000100:00100000:1.0:1788986905.713410:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1466 00000100:00100000:1.0:1788986905.713417:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971443968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986905.713463:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971443968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 46us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986905.713470:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1466 00000100:00080000:2.0:1788986905.713732:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986905.713793:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971444352 00000100:00100000:3.0:1788986905.713798:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971444352 00000100:00100000:3.0:1788986905.713844:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971444224 00000100:00100000:3.0:1788986905.713847:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971444224 00000100:00100000:3.0:1788986905.713877:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1459 00000100:00100000:3.0:1788986905.713884:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971444352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986905.713932:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971444352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 47us (1216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986905.713938:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1459 00000100:00100000:3.0:1788986905.713951:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1460 00000100:00100000:3.0:1788986905.713957:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971444224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986905.713980:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971444224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (1195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986905.713986:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1460 00000100:00080000:2.0:1788986905.714146:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986905.714149:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788986906.688808:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986907.648400:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993648768:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986907.648486:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986907.648696:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993648768 00000100:00100000:3.0:1788986907.648704:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993648768 00000100:00100000:3.0:1788986907.648766:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:3.0:1788986907.648776:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993648768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986907.648808:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986907.648863:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993648768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986907.648870:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:1.0:1788986907.649372:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993648768:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986907.649602:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788986907.712464:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986908.674086:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993649280:0@lo:400:kworker.0 00000100:00100000:1.0:1788986908.674174:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986908.674235:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986908.674242:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993649152:0@lo:400:kworker.0 00000100:00100000:1.0:1788986908.674268:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986908.674300:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993649152 00000100:00100000:1.0:1788986908.674306:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993649152 00000100:00100000:1.0:1788986908.674363:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1924 00000100:00100000:1.0:1788986908.674373:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993649152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986908.674435:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943706d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993649152:12345-0@lo:400:kworker.0 Request processed in 64us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986908.674442:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1924 00000100:00080000:1.0:1788986908.674464:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986908.674494:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe42300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993649152:0@lo:400:kworker.0 00000100:00100000:3.0:1788986908.674645:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993649280 00000100:00100000:3.0:1788986908.674650:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993649280 00000100:00100000:3.0:1788986908.674692:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1461 00000100:00100000:3.0:1788986908.674699:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993649280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986908.674740:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993649280:12345-0@lo:400:kworker.0 Request processed in 42us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986908.674746:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1461 00000100:00100000:0.0:1788986908.675065:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993649024:0@lo:400:kworker.0 00000100:00100000:0.0:1788986908.675117:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986908.675151:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993649536:0@lo:400:kworker.0 00000100:00100000:0.0:1788986908.675175:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986908.675193:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788986908.675198:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993648896:0@lo:400:kworker.0 00000100:00100000:0.0:1788986908.675226:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986908.675247:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993649408:0@lo:400:kworker.0 00000100:00100000:0.0:1788986908.675268:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986908.675295:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993649024 00000100:00100000:0.0:1788986908.675299:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993649024 00000100:00100000:0.0:1788986908.675320:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993649408 00000100:00100000:0.0:1788986908.675323:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993649408 00000100:00100000:0.0:1788986908.675344:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1925 00000100:00100000:0.0:1788986908.675351:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993649024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986908.675386:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993649024:12345-0@lo:400:kworker.0 Request processed in 35us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986908.675392:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1925 00000100:00100000:0.0:1788986908.675405:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1926 00000100:00100000:0.0:1788986908.675411:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993649408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986908.675450:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993649408:12345-0@lo:400:kworker.0 Request processed in 40us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986908.675456:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1926 00000100:00100000:0.0:1788986908.675485:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993649408:0@lo:400:kworker.0 00000100:00100000:0.0:1788986908.675495:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe40380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993649024:0@lo:400:kworker.0 00000100:00100000:1.0:1788986908.675620:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993649536 00000100:00100000:1.0:1788986908.675624:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993649536 00000100:00100000:1.0:1788986908.675658:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1462 00000100:00100000:1.0:1788986908.675664:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993649536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986908.675709:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993649536:12345-0@lo:400:kworker.0 Request processed in 44us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986908.675716:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1462 00000100:00080000:1.0:1788986908.675731:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986908.675734:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986908.675754:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993649280:0@lo:400:kworker.0 00000100:00100000:2.0:1788986908.675822:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993649536:0@lo:400:kworker.0 00000100:00100000:3.0:1788986908.676267:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993648896 00000100:00100000:3.0:1788986908.676272:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993648896 00000100:00100000:3.0:1788986908.676307:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1467 00000100:00100000:3.0:1788986908.676314:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993648896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986908.676360:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993648896:12345-0@lo:400:kworker.0 Request processed in 47us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986908.676367:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1467 00000100:00100000:2.0:1788986908.676456:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe41c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993648896:0@lo:400:kworker.0 00010000:00010000:3.0:1788986908.736832:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986909.187711:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788986909.187732:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993649664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986909.187791:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986909.188085:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993649664 00000100:00100000:0.0:1788986909.188126:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993649664 00000100:00100000:0.0:1788986909.188200:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:0.0:1788986909.188210:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993649664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986909.188241:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986909.188297:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993649664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986909.188312:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:2.0:1788986909.188512:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993649664:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788986909.760514:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986909.881226:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986909.882865:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971444480 00000100:00100000:1.0:1788986909.882883:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971444480 00000100:00100000:1.0:1788986909.882991:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1168 00000100:00100000:1.0:1788986909.883004:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59068:x1875885971444480:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986909.883168:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59068:x1875885971444480:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 166us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986909.883175:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1168 00000100:00080000:2.0:1788986909.884776:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986909.889378:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986909.892742:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971444608 00000100:00100000:1.0:1788986909.892757:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971444608 00000100:00100000:1.0:1788986909.892856:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 645 00000100:00100000:1.0:1788986909.892867:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59068:x1875885971444608:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986909.893298:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59068:x1875885971444608:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 432us (3928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986909.893306:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 645 00000100:00080000:2.0:1788986909.894140:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986909.897726:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986909.897829:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971444736 00000100:00100000:1.0:1788986909.897846:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971444736 00000100:00100000:1.0:1788986909.897972:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 646 00000100:00100000:1.0:1788986909.897982:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59068:x1875885971444736:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986909.898360:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59068:x1875885971444736:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 380us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986909.898368:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 646 00000100:00080000:2.0:1788986909.899695:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986909.901835:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986909.902820:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971444864 00000100:00100000:2.0:1788986909.903079:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971444864 00000100:00100000:2.0:1788986909.903268:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1169 00000100:00100000:2.0:1788986909.903279:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59068:x1875885971444864:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986909.904468:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59068:x1875885971444864:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 1186us (2642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986909.904478:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1169 00000100:00100000:0.0:1788986909.911914:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986909.912228:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971444992 00000100:00100000:3.0:1788986909.912238:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971444992 00000100:00100000:3.0:1788986909.912302:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1170 00000100:00100000:3.0:1788986909.912311:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59068:x1875885971444992:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986909.912409:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59068:x1875885971444992:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 99us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986909.912427:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1170 00000100:00100000:0.0:1788986909.914639:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986909.914716:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971445120 00000100:00100000:3.0:1788986909.914724:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971445120 00000100:00100000:3.0:1788986909.914776:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 647 00000100:00100000:3.0:1788986909.914786:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59068:x1875885971445120:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986909.915491:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59068:x1875885971445120:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 704us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986909.915500:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 647 00000100:00100000:0.0:1788986909.920757:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986909.920839:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971445248 00000100:00100000:3.0:1788986909.920848:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971445248 00000100:00100000:3.0:1788986909.920906:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 648 00000100:00100000:3.0:1788986909.920916:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59068:x1875885971445248:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986909.921677:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59068:x1875885971445248:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 758us (924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986909.921686:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 648 00000100:00100000:0.0:1788986909.931890:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986909.932864:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971445376 00000100:00100000:2.0:1788986909.932877:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971445376 00000100:00100000:2.0:1788986909.932946:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1171 00000100:00100000:2.0:1788986909.932957:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59068:x1875885971445376:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986909.933442:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59068:x1875885971445376:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 485us (1559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986909.933451:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1171 00000100:00100000:0.0:1788986909.979955:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986909.980207:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971445504 00000100:00100000:2.0:1788986909.980218:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971445504 00000100:00100000:2.0:1788986909.980281:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1172 00000100:00100000:2.0:1788986909.980302:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59069:x1875885971445504:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:2.0:1788986909.980322:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986909.980343:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a375 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d169b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986909.980407:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54a37c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986909.980434:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54a37c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986909.980446:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54a37c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986909.980481:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00000004:00200000:2.0:1788986909.980485:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986909.980502:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54a37c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986909.980526:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0a00/0xc20d828fcf54a375 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d169b expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986909.980543:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54a37c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d169b expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986909.980557:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:2.0:1788986909.980559:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986909.980563:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0800, rc 0) 00000100:00100000:2.0:1788986909.980620:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59069:x1875885971445504:12345-192.168.206.21@tcp:101:rm.0 Request processed in 320us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986909.980626:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1172 00000100:00100000:0.0:1788986909.986919:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986909.987047:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971445760 00000100:00100000:1.0:1788986909.987057:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971445760 00000100:00100000:1.0:1788986909.987144:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1173 00000100:00100000:1.0:1788986909.987154:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59069:x1875885971445760:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986909.987176:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986909.987197:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a383 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16a2 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986909.987285:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00010000:00010000:1.0:1788986909.987524:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a383 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16a2 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986909.987538:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788986909.987541:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788986909.987546:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a383 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16a2 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986909.987561:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986909.988024:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59069:x1875885971445760:12345-192.168.206.21@tcp:101:rm.0 Request processed in 869us (1110us total) trans 4294967738 rc 301/301 00000100:00100000:1.0:1788986909.988033:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1173 00000100:00100000:0.0:1788986910.010432:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986910.010475:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971445888 00000100:00100000:0.0:1788986910.010485:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971445888 00000100:00100000:0.0:1788986910.010533:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:0.0:1788986910.010542:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59069:x1875885971445888:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:0.0:1788986910.033485:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59069:x1875885971445888:12345-192.168.206.21@tcp:37:rm.0 Request processed in 22935us (23065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986910.033498:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 115 00000100:00100000:0.0:1788986910.041800:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986910.042008:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971446144 00000100:00100000:1.0:1788986910.042022:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971446144 00000100:00100000:1.0:1788986910.042117:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:1.0:1788986910.042128:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59069:x1875885971446144:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:1.0:1788986910.043159:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59069:x1875885971446144:12345-192.168.206.21@tcp:35:rm.0 Request processed in 1030us (1367us total) trans 4294967739 rc 0/0 00000100:00100000:1.0:1788986910.043173:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 116 00000100:00100000:0.0:1788986910.053302:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986910.053365:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971446400 00000100:00100000:1.0:1788986910.053375:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971446400 00000100:00100000:1.0:1788986910.053442:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1174 00000100:00100000:1.0:1788986910.053452:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59069:x1875885971446400:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:1.0:1788986910.053500:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788986910.053527:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54a37c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d169b expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.053546:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a321 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x5a:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1686 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.053559:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:1.0:1788986910.053576:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a43d49200/0xc20d828fcf54a02d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d15d0 expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.053586:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316300) 00010000:00010000:1.0:1788986910.053591:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986910.053628:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a391 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.053641:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a391 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.053650:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a391 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.053662:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a398 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.053669:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a398 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.053674:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a398 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.053972:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a39f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.053982:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a39f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.053990:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a39f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986910.054782:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x5a:0x0]: returning size 16384 00010000:00010000:1.0:1788986910.054802:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a39f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054811:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a39f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054818:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a39f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054824:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986910.054829:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a39f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054837:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a39f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054852:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x5a:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:1.0:1788986910.054855:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986910.054860:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a39f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054866:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a39f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x5a:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054887:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a391 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054894:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a391 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054900:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a391 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054904:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986910.054907:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a391 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054913:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a391 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054920:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316600) 00010000:00010000:1.0:1788986910.054923:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986910.054925:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a391 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986910.054931:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a391 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986910.054949:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000019609d7a reply state 0000000026223f9e transno 4294967740 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a398 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986910.054957:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986910.055030:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59069:x1875885971446400:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1578us (1745us total) trans 4294967740 rc 0/0 00000100:00100000:1.0:1788986910.055039:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1174 00010000:00010000:3.0:1788986910.058711:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a398 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986910.058728:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a398 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986910.058736:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a398 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986910.058743:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986910.058748:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a398 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986910.058756:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a398 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986910.058771:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a45316a00) 00010000:00010000:3.0:1788986910.058774:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986910.058778:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a398 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986910.058785:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a398 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986910.784222:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986910.839874:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986910.839919:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986910.839957:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986910.839984:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971446528 00000100:00100000:2.0:1788986910.839992:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971446528 00000100:00100000:2.0:1788986910.840038:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1468 00000100:00100000:2.0:1788986910.840048:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971446528:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986910.840132:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971446528:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986910.840139:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1468 00000100:00100000:2.0:1788986910.840191:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986910.840361:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971446656 00000100:00100000:0.0:1788986910.840366:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971446656 00000100:00100000:0.0:1788986910.840404:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1927 00000100:00100000:0.0:1788986910.840421:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971446656:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986910.840477:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2349:x1875885971446656:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 57us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986910.840492:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1927 00000100:00100000:1.0:1788986910.840696:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971446912 00000100:00100000:1.0:1788986910.840702:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971446912 00000100:00100000:1.0:1788986910.840736:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971446784 00000100:00100000:1.0:1788986910.840739:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971446784 00000100:00100000:1.0:1788986910.840760:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1463 00000100:00100000:1.0:1788986910.840767:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971446912:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986910.840801:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971446912:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (881us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986910.840808:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1463 00000100:00100000:1.0:1788986910.840821:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1464 00000100:00100000:1.0:1788986910.840827:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971446784:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986910.840849:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971446784:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986910.840855:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1464 00010000:00010000:1.0:1788986911.808430:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986912.770395:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993649792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986912.770470:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986912.773704:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993649792 00000100:00100000:3.0:1788986912.773715:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993649792 00000100:00100000:3.0:1788986912.773834:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:3.0:1788986912.773844:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993649792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986912.773883:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986912.773960:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993649792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (3489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986912.773967:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:3.0:1788986912.774022:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993649792:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986912.778105:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986912.833187:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788986913.139021:0:100666:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffce1176e90 20000000:00000080:0.0:1788986913.139896:0:100666:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a809ac400 uarg=0000000000000000 10000000:01000000:0.0:1788986913.139952:0:100666:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986913.139974:0:100666:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986913.139990:0:100666:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a01f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a018 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986913.139999:0:100666:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986913.140043:0:100666:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a01f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a018 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986913.140057:0:100666:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a01f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a018 expref: 18 pid: 5849 timeout: 2797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986913.140072:0:100666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8099b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100666:1875885993649920:0@lo:104: 00000100:00100000:0.0:1788986913.140153:0:100666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986913.140199:0:100666:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788986913.140277:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993649920 00000100:00100000:1.0:1788986913.140285:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993649920 00000100:00100000:1.0:1788986913.140331:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 393 00000100:00100000:1.0:1788986913.140341:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:100666:x1875885993649920:12345-0@lo:104: 00010000:00010000:1.0:1788986913.140354:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a01f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140425:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986913.140432:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:100666:x1875885993649920:12345-0@lo:104: Request processed in 92us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986913.140438:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 393 00010000:00010000:1.0:1788986913.140461:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986913.140467:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a01f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140474:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48a00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788986913.140478:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a01f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140486:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a01f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788986913.140493:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a01f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986913.140499:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788986913.140524:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a01f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140530:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788986913.140547:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a01f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140560:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54a018 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a01f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140574:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986913.140575:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986913.140577:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986913.140593:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993650048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788986913.140624:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986913.140661:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993650048 00000100:00100000:1.0:1788986913.140665:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993650048 00010000:00010000:1.0:1788986913.140681:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a01f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a018 expref: 19 pid: 5849 timeout: 2797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986913.140703:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1788986913.140709:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45611050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993650048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986913.140720:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986913.140725:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a01f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a018 expref: 19 pid: 5849 timeout: 2797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140734:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a01f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a018 expref: 19 pid: 5849 timeout: 2797 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140750:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140759:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140777:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140784:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140791:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140797:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140802:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986913.140806:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140813:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140822:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986913.140831:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986913.140860:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45611050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993650048:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986913.140866:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 464 00000100:00100000:1.0:1788986913.140956:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993650048:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986913.141133:0:100666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a01f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a018 expref: 18 pid: 5849 timeout: 2797 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986913.141143:0:100666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8099b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100666:1875885993649920:0@lo:104: 00010000:00010000:2.0:1788986913.141159:0:100666:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986913.141172:0:100666:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986913.141177:0:100666:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986913.141183:0:100666:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee000/0xc20d828fcf54a3a6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100666 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986913.795382:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993650304:0@lo:400:kworker.0 00000100:00100000:3.0:1788986913.795473:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986913.795542:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986913.795550:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993650432:0@lo:400:kworker.0 00000100:00100000:3.0:1788986913.795577:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986913.795617:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993650304 00000100:00100000:3.0:1788986913.795626:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993650304 00000100:00100000:3.0:1788986913.795704:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1788986913.795715:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993650304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986913.798311:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993650176:0@lo:400:kworker.0 00000100:00100000:2.0:1788986913.798426:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986913.798525:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993650688:0@lo:400:kworker.0 00000100:00100000:2.0:1788986913.798559:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986913.798598:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986913.798606:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993650560:0@lo:400:kworker.0 00000100:00100000:2.0:1788986913.798631:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986913.798670:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993650432 00000100:00100000:2.0:1788986913.798679:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993650432 00000100:00100000:2.0:1788986913.798728:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993650688 00000100:00100000:2.0:1788986913.798731:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993650688 00000100:00100000:2.0:1788986913.798842:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1465 00000100:00100000:2.0:1788986913.798853:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993650432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986913.799051:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993650432:12345-0@lo:400:kworker.0 Request processed in 199us (3471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986913.799060:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1465 00000100:00100000:2.0:1788986913.799083:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1466 00000100:00100000:2.0:1788986913.799124:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993650688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986913.799165:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993650688:12345-0@lo:400:kworker.0 Request processed in 76us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986913.799172:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1466 00000100:00100000:2.0:1788986913.799193:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993650176 00000100:00100000:2.0:1788986913.799196:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993650176 00000100:00100000:2.0:1788986913.799222:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993650560 00000100:00100000:2.0:1788986913.799225:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993650560 00000100:00100000:2.0:1788986913.799243:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1929 00000100:00100000:2.0:1788986913.799249:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993650176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986913.799342:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993650304:12345-0@lo:400:kworker.0 Request processed in 3629us (3868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986913.799351:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1928 00000100:00100000:3.0:1788986913.799369:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1930 00000100:00100000:3.0:1788986913.799375:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993650560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986913.800349:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993650432:0@lo:400:kworker.0 00000100:00100000:1.0:1788986913.800470:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993650304:0@lo:400:kworker.0 00000100:00100000:1.0:1788986913.800524:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993650688:0@lo:400:kworker.0 00000100:00100000:2.0:1788986913.800689:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993650176:12345-0@lo:400:kworker.0 Request processed in 1438us (2262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986913.800700:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1929 00000100:00100000:2.0:1788986913.800737:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993650176:0@lo:400:kworker.0 00000100:00080000:2.0:1788986913.800837:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986913.800844:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986913.803178:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993650560:12345-0@lo:400:kworker.0 Request processed in 3778us (4519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986913.803196:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1930 00000100:00100000:0.0:1788986913.803592:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993650560:0@lo:400:kworker.0 00010000:00010000:0.0:1788986913.857522:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788986914.153748:0:100714:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd4523cba0 20000000:00000080:3.0:1788986914.153774:0:100714:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80855400 uarg=0000000000000000 10000000:01000000:3.0:1788986914.153849:0:100714:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788986914.155337:0:100714:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54a3ad lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986914.155364:0:100714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54a3ad lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986914.155380:0:100714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54a3ad lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986914.155387:0:100714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54a3ad lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986914.155406:0:100714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54a3ad lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986914.155416:0:100714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54a3ad lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986914.155424:0:100714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986914.155429:0:100714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54a3ad lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986914.155438:0:100714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54a3ad lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986914.155456:0:100714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54a3ad lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986914.155465:0:100714:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54a3ad lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986914.155478:0:100714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54a3ad lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100714 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986914.304520:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993650816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986914.304617:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986914.304728:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993650816 00000100:00100000:2.0:1788986914.304739:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993650816 00000100:00100000:2.0:1788986914.304799:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:2.0:1788986914.304811:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993650816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986914.304871:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986914.304931:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993650816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986914.304938:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:2.0:1788986914.305003:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993650816:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788986914.354339:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967740 is committed 00010000:00010000:0.0:1788986914.881029:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788986914.944292:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986914.944302:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986914.944309:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986914.944379:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986914.944403:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986914.944416:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986914.944772:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993650944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986914.944874:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986914.944951:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986914.945339:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993650944 00000100:00100000:1.0:1788986914.945359:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993650944 00000100:00100000:1.0:1788986914.947812:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:1.0:1788986914.947848:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993650944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986914.947872:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986914.947897:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a3bb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a3b4 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986914.947934:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a3bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a3b4 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986914.947946:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a3bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a3b4 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986914.947956:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788986914.948059:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993650944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (3185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986914.948164:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d66300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993650944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986914.948187:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a3bb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986914.948198:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a3bb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986914.948223:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986914.948230:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a3bb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986914.948238:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a3bb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986914.960986:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00010000:00010000:2.0:1788986915.905305:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986915.960951:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986915.961010:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986915.961038:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986915.961181:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986915.961223:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971447296 00000100:00100000:2.0:1788986915.961236:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971447296 00000100:00100000:2.0:1788986915.961311:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971447424 00000100:00100000:2.0:1788986915.961315:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971447424 00000100:00100000:2.0:1788986915.961341:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1467 00000100:00100000:2.0:1788986915.961353:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971447296:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986915.961460:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971447296:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 108us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986915.961469:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1467 00000100:00100000:2.0:1788986915.961491:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1468 00000100:00100000:2.0:1788986915.961498:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971447424:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986915.961531:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971447424:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986915.961537:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1468 00000100:00080000:2.0:1788986915.961559:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986915.961564:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986915.961975:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971447168 00000100:00100000:1.0:1788986915.961982:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971447168 00000100:00100000:1.0:1788986915.962047:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1931 00000100:00100000:1.0:1788986915.962054:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971447168:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986915.962146:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971447168:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 91us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986915.962167:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1931 00000100:00100000:3.0:1788986915.964899:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971447040 00000100:00100000:3.0:1788986915.964916:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971447040 00000100:00100000:3.0:1788986915.965086:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1470 00000100:00100000:3.0:1788986915.965119:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971447040:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986915.965276:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971447040:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 161us (4340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986915.965287:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1470 00000100:00080000:2.0:1788986915.965861:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788986916.929366:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986917.601203:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986917.601296:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971447552 00000100:00100000:1.0:1788986917.601306:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971447552 00000100:00100000:1.0:1788986917.601389:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1175 00000100:00100000:1.0:1788986917.601400:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59182:x1875885971447552:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986917.601420:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986917.601441:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a3c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16a9 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.601499:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a3c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.601511:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a3c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.601524:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a3c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986917.601556:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788986917.601561:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986917.601580:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a3c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.601602:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a3c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16a9 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.601621:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a3c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16a9 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.601635:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316500) 00010000:00010000:1.0:1788986917.601639:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986917.601642:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788986917.601711:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59182:x1875885971447552:12345-192.168.206.21@tcp:101:rm.0 Request processed in 312us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986917.601718:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1175 00000100:00080000:2.0:1788986917.602027:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986917.607642:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986917.607738:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971447680 00000100:00100000:1.0:1788986917.607746:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971447680 00000100:00100000:1.0:1788986917.607796:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1176 00000100:00100000:1.0:1788986917.607806:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59182:x1875885971447680:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986917.607824:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986917.607849:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a3d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16b0 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.607900:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a3d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.607912:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a3d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.607922:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a3d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.607934:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a3de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.607941:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a3de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.607952:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a3de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608166:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a3d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608173:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a3d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608180:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a3d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608185:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986917.608194:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a3d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608201:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a3d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608213:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316500) 00010000:00010000:1.0:1788986917.608216:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986917.608220:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a3d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608226:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a3d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608237:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a3de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608243:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a3de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608250:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a3de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608255:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986917.608257:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a3de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608263:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a3de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608269:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a45316100) 00010000:00010000:1.0:1788986917.608271:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986917.608274:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a3de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608279:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a3de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608305:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a3d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16b0 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608313:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316500) 00010000:00010000:1.0:1788986917.608316:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986917.608319:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a3d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16b0 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986917.608327:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788986917.608384:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59182:x1875885971447680:12345-192.168.206.21@tcp:101:rm.0 Request processed in 579us (750us total) trans 0 rc 301/301 00000100:00100000:1.0:1788986917.608395:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1176 00000100:00100000:0.0:1788986917.672068:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986917.672169:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986917.672298:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971447808 00000100:00100000:2.0:1788986917.672328:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971447808 00000100:00100000:2.0:1788986917.672415:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971448064 00000100:00100000:2.0:1788986917.672419:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971448064 00000100:00100000:2.0:1788986917.672458:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1177 00000100:00100000:2.0:1788986917.672470:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971447808:12345-192.168.206.21@tcp:41:mkdir.0 00000004:00000024:2.0:1788986917.672535:0:5855:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:2.0:1788986917.672629:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971447808:12345-192.168.206.21@tcp:41:mkdir.0 Request processed in 160us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986917.672637:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1177 00000100:00100000:2.0:1788986917.672662:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1178 00000100:00100000:2.0:1788986917.672668:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59186:x1875885971448064:12345-192.168.206.21@tcp:36:mkdir.0 00010000:00010000:2.0:1788986917.672713:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986917.672746:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a3c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16a9 expref: 6 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.672769:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316500) 00010000:00010000:2.0:1788986917.672782:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986917.673027:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3e5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.673042:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.673052:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.673063:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3ec lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.673070:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.673075:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986917.674058:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00010000:00010000:2.0:1788986917.674072:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3e5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.674081:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3e5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.674127:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.674134:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986917.674138:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3e5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.674150:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3e5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.674162:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986917.674165:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986917.674170:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3e5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.674175:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3e5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986917.674194:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000001bf53f76 reply state 0000000020de2674 transno 4294967741 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986917.674204:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986917.674275:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59186:x1875885971448064:12345-192.168.206.21@tcp:36:mkdir.0 Request processed in 1604us (2103us total) trans 4294967741 rc 0/0 00000100:00100000:2.0:1788986917.674285:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1178 00010000:00010000:2.0:1788986917.679753:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3ec lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.679772:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3ec lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.679779:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.679785:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986917.679790:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3ec lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.679803:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3ec lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.679821:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986917.679824:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986917.679829:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3ec lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.679835:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3ec lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986917.751053:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986917.751187:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971448192 00000100:00100000:2.0:1788986917.751196:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971448192 00000100:00100000:2.0:1788986917.751425:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1179 00000100:00100000:2.0:1788986917.751437:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59190:x1875885971448192:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:2.0:1788986917.751459:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986917.751479:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16b7 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.751532:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.751544:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.751556:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986917.751589:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788986917.751593:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986917.751611:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.751632:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a3f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16b7 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.751649:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16b7 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.751657:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:2.0:1788986917.751660:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788986917.751663:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0200, rc 0) 00000100:00100000:2.0:1788986917.751719:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59190:x1875885971448192:12345-192.168.206.21@tcp:101:chown.0 Request processed in 284us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986917.751726:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1179 00000100:00100000:0.0:1788986917.754764:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986917.754951:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971448320 00000100:00100000:3.0:1788986917.754960:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971448320 00000100:00100000:3.0:1788986917.755017:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1180 00000100:00100000:3.0:1788986917.755027:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59190:x1875885971448320:12345-192.168.206.21@tcp:101:chown.0 00010000:00010000:3.0:1788986917.755050:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986917.755071:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a401 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16be expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755158:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a408 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755172:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755183:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755198:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a40f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755205:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a40f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755212:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a40f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755316:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a416 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755324:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755331:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986917.755365:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:3.0:1788986917.755380:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986917.755402:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a416 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755413:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a408 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755420:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a408 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755427:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755437:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986917.755441:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a408 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755448:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a408 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755459:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:3.0:1788986917.755462:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986917.755467:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a408 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755472:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a408 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755487:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a40f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755493:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a40f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755498:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a40f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755503:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986917.755506:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a40f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755512:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a40f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755521:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a55745d00) 00010000:00010000:3.0:1788986917.755523:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986917.755526:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a40f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755530:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a40f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755561:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a401 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16be expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755574:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a416 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16be expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986917.755580:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:3.0:1788986917.755582:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986917.755584:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986917.755660:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59190:x1875885971448320:12345-192.168.206.21@tcp:101:chown.0 Request processed in 635us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986917.755667:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1180 00000100:00100000:3.0:1788986917.762142:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986917.762228:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971448576 00000100:00100000:0.0:1788986917.762238:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971448576 00000100:00100000:0.0:1788986917.762302:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1181 00000100:00100000:0.0:1788986917.762313:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59190:x1875885971448576:12345-192.168.206.21@tcp:36:chown.0 00010000:00010000:0.0:1788986917.762360:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986917.762396:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a416 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16be expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986917.762416:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:0.0:1788986917.762427:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986917.762452:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a41d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986917.762464:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a41d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986917.762474:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a41d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986917.803082:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000222a6592 reply state 00000000255dfe06 transno 4294967742 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a41d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986917.803120:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788986917.803141:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000100:00100000:1.0:1788986917.803285:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59190:x1875885971448576:12345-192.168.206.21@tcp:36:chown.0 Request processed in 40968us (41146us total) trans 4294967742 rc 0/0 00000100:00100000:1.0:1788986917.803295:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1181 00000001:00080000:3.0:1788986917.805181:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967742 is committed 00010000:00010000:2.0:1788986917.807901:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a41d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.807916:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a41d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.807924:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a41d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.807930:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986917.807935:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a41d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.807942:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a41d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.807958:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:2.0:1788986917.807961:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986917.807966:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a41d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986917.807971:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a41d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986917.888572:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993651072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986917.888644:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986917.889102:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993651072 00000100:00100000:3.0:1788986917.889110:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993651072 00000100:00100000:3.0:1788986917.889166:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:3.0:1788986917.889175:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993651072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986917.889213:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986917.889269:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993651072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986917.889276:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:2.0:1788986917.889596:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993651072:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986917.890728:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986917.955011:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788986918.778591:0:100912:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff25634fa0 20000000:00000080:1.0:1788986918.778606:0:100912:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a761c4400 uarg=0000000000000000 10000000:01000000:1.0:1788986918.778646:0:100912:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986918.778665:0:100912:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986918.778682:0:100912:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a3bb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a3b4 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986918.778691:0:100912:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986918.778727:0:100912:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a3bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a3b4 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986918.778741:0:100912:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a3bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a3b4 expref: 18 pid: 5849 timeout: 2802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986918.778755:0:100912:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100912:1875885993651200:0@lo:104: 00000100:00100000:1.0:1788986918.778816:0:100912:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986918.778979:0:100912:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a6b2f90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788986918.780426:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993651200 00000100:00100000:0.0:1788986918.780438:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993651200 00000100:00100000:0.0:1788986918.780494:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:0.0:1788986918.780504:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:100912:x1875885993651200:12345-0@lo:104: 00010000:00010000:0.0:1788986918.780519:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a3bb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986918.780705:0:100912:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:100912:1875885993651200:0@lo:104: 00010000:00010000:2.0:1788986918.780726:0:100912:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986918.780797:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788986918.780804:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:100912:x1875885993651200:12345-0@lo:104: Request processed in 301us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986918.780810:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00010000:00010000:3.0:1788986918.781227:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986918.781236:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a3bb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.781248:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986918.781253:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a3bb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.781262:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a3bb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986918.781273:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a3bb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986918.781279:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986918.781578:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a3bb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.781591:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986918.781624:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a3bb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.781631:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1400/0xc20d828fcf54a3b4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a3bb expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.781649:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986918.781651:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986918.781652:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986918.781698:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986918.781716:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993651328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986918.781772:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986918.781872:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993651328 00000100:00100000:3.0:1788986918.781880:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993651328 00010000:00010000:3.0:1788986918.781910:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a3bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a3b4 expref: 19 pid: 5849 timeout: 2802 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986918.781949:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1788986918.781957:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993651328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986918.781968:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986918.781973:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a3bb lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a3b4 expref: 19 pid: 5849 timeout: 2802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.781983:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a3bb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a3b4 expref: 19 pid: 5849 timeout: 2802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.781996:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a3bb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a3b4 expref: 19 pid: 5849 timeout: 2802 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.782010:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.782023:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.782040:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.782047:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.782053:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.782064:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.782070:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986918.782074:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.782081:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.782118:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986918.782128:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986918.782163:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993651328:12345-0@lo:103:ldlm_bl.0 Request processed in 207us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986918.782171:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 465 00000100:00100000:3.0:1788986918.782204:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993651328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986918.782374:0:100912:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986918.782382:0:100912:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986918.782388:0:100912:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030200/0xc20d828fcf54a424 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100912 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986918.912300:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993651840:0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.912385:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986918.912438:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788986918.912445:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993651456:0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.912468:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986918.912485:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993651968:0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.912509:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986918.912535:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993651584:0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.912559:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986918.912578:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986918.912584:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993651712:0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.912608:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986918.912638:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993651840 00000100:00100000:3.0:1788986918.912646:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993651840 00000100:00100000:3.0:1788986918.912694:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993651456 00000100:00100000:3.0:1788986918.912697:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993651456 00000100:00100000:3.0:1788986918.912713:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993651584 00000100:00100000:3.0:1788986918.912716:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993651584 00000100:00100000:3.0:1788986918.912730:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1788986918.912737:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993651840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.912781:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993651840:12345-0@lo:400:kworker.0 Request processed in 44us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986918.912787:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1932 00000100:00100000:3.0:1788986918.912802:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1788986918.912809:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993651456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.912833:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993651456:12345-0@lo:400:kworker.0 Request processed in 25us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986918.913067:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1933 00000100:00100000:3.0:1788986918.913083:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1934 00000100:00100000:3.0:1788986918.913118:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993651584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.913157:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993651584:12345-0@lo:400:kworker.0 Request processed in 68us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986918.913163:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1934 00000100:00100000:3.0:1788986918.913186:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993651968 00000100:00100000:3.0:1788986918.913190:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993651968 00000100:00100000:3.0:1788986918.913217:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993651712 00000100:00100000:3.0:1788986918.913221:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993651712 00000100:00100000:0.0:1788986918.913342:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993651584:0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.913450:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1469 00000100:00100000:3.0:1788986918.913458:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993651968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.913490:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993651968:12345-0@lo:400:kworker.0 Request processed in 34us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986918.913496:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1469 00000100:00100000:3.0:1788986918.913508:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1470 00000100:00100000:3.0:1788986918.913514:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993651712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.913544:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993651712:12345-0@lo:400:kworker.0 Request processed in 30us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986918.913550:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1470 00000100:00080000:3.0:1788986918.913705:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986918.913710:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986918.913737:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993651712:0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.913761:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993651456:0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.913771:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993651968:0@lo:400:kworker.0 00000100:00100000:3.0:1788986918.913779:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993651840:0@lo:400:kworker.0 00010000:00010000:3.0:1788986918.976169:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986919.424529:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993652096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986919.424605:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986919.424969:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993652096 00000100:00100000:2.0:1788986919.424978:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993652096 00000100:00100000:2.0:1788986919.425040:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:2.0:1788986919.425053:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993652096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986919.425124:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986919.425195:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993652096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 147us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986919.425207:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:0.0:1788986919.425310:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993652096:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788986919.599731:0:100960:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcde089b70 20000000:00000080:1.0:1788986919.599755:0:100960:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a761c4c00 uarg=0000000000000000 10000000:01000000:1.0:1788986919.599808:0:100960:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986919.599830:0:100960:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a42b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 100960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986919.599847:0:100960:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a42b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 100960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986919.599860:0:100960:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a42b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 100960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986919.599868:0:100960:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a42b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986919.599876:0:100960:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a42b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 100960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986919.599885:0:100960:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a42b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986919.599892:0:100960:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986919.599897:0:100960:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a42b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 100960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986919.599906:0:100960:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a42b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 100960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986919.599919:0:100960:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a42b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986919.599931:0:100960:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a42b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986919.599938:0:100960:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a42b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 100960 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986920.000213:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788986920.000265:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788986920.000270:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788986920.000275:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788986920.000316:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986920.000328:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986920.000340:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986920.000374:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8099a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993652224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788986920.000432:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986920.000486:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094390b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788986920.000544:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993652224 00000100:00100000:1.0:1788986920.000550:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993652224 00000100:00100000:1.0:1788986920.000639:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1471 00000100:00100000:1.0:1788986920.000655:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993652224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986920.000668:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986920.000680:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a439 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a432 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986920.000701:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a439 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a432 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986920.000711:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a439 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a432 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986920.000720:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031a00, rc 0) 00000100:00100000:1.0:1788986920.000760:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993652224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986920.000766:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1471 00000100:00100000:0.0:1788986920.000831:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8099a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993652224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986920.000844:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986920.000852:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986920.000870:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986920.000874:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986920.000882:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986921.045290:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986921.073470:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986921.073500:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986921.073528:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986921.073555:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971448832 00000100:00100000:3.0:1788986921.073563:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971448832 00000100:00100000:3.0:1788986921.073614:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1935 00000100:00100000:3.0:1788986921.073622:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971448832:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986921.073701:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971448832:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 78us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986921.073708:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1935 00000100:00100000:3.0:1788986921.073735:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971449088 00000100:00100000:3.0:1788986921.073739:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971449088 00000100:00100000:3.0:1788986921.073767:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1471 00000100:00100000:3.0:1788986921.073773:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971449088:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986921.073801:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971449088:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986921.073808:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1471 00000100:00100000:3.0:1788986921.073826:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971448704 00000100:00100000:3.0:1788986921.073829:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971448704 00000100:00100000:3.0:1788986921.073852:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1472 00000100:00100000:3.0:1788986921.073859:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971448704:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986921.073881:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971448704:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 22us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986921.073887:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1472 00000100:00080000:3.0:1788986921.073910:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986921.073914:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986921.076766:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986921.076863:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971448960 00000100:00100000:3.0:1788986921.076874:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971448960 00000100:00100000:3.0:1788986921.076960:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1472 00000100:00100000:3.0:1788986921.076972:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971448960:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986921.077047:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971448960:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986921.077056:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1472 00000100:00080000:1.0:1788986921.077644:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986922.051085:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986922.620434:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986922.621117:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971449216 00000100:00100000:1.0:1788986922.621133:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971449216 00000100:00100000:1.0:1788986922.621977:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:1.0:1788986922.621992:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:5589:x1875885971449216:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986922.622013:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986922.622051:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0200/0xc20d828fcf54a3fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16b7 expref: 6 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986922.622075:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45aca300) 00010000:00010000:1.0:1788986922.622128:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986922.623361:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:5589:x1875885971449216:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 1354us (2923us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986922.623377:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 18 00000100:00100000:0.0:1788986923.008991:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986923.009016:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993652352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986923.009122:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986923.009189:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993652352 00000100:00100000:0.0:1788986923.009198:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993652352 00000100:00100000:0.0:1788986923.009266:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1788986923.009275:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993652352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986923.009454:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986923.009504:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993652352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 230us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986923.009512:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00080000:0.0:1788986923.009644:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986923.009692:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993652352:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986923.072215:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986923.390871:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986923.390984:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971449344 00000100:00100000:3.0:1788986923.390996:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971449344 00000100:00100000:3.0:1788986923.391078:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1182 00000100:00100000:3.0:1788986923.391126:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59295:x1875885971449344:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:3.0:1788986923.391154:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986923.391186:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16c5 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.391262:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a447 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.391276:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a447 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.391288:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a447 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986923.391325:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788986923.391329:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986923.391360:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a447 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.391382:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16c5 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.391403:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a447 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16c5 expref: 6 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.391412:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:3.0:1788986923.391415:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986923.391418:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3800, rc 0) 00000100:00100000:3.0:1788986923.391472:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59295:x1875885971449344:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 384us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986923.391480:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1182 00000100:00080000:0.0:1788986923.393045:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986923.393913:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986923.394022:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971449472 00000100:00100000:0.0:1788986923.394030:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971449472 00000100:00100000:0.0:1788986923.394083:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1183 00000100:00100000:0.0:1788986923.394120:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59295:x1875885971449472:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986923.394138:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986923.394155:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a44e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16cc expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394218:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a455 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394232:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a455 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394243:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a455 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394258:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a45c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394266:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a45c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394273:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a45c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394586:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394596:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394605:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986923.394650:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:0.0:1788986923.394655:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986923.394675:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394688:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a455 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394694:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a455 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394701:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a455 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394710:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986923.394714:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a455 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394722:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a455 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394735:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:0.0:1788986923.394738:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986923.394742:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a455 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394748:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a455 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394761:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a45c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394766:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a45c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394772:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a45c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394777:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efa00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986923.394780:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a45c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394787:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a45c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394798:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a4823bd00) 00010000:00010000:0.0:1788986923.394801:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986923.394804:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a45c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394822:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a45c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394852:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a44e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16cc expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394865:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16cc expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.394872:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:0.0:1788986923.394875:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986923.394877:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986923.394939:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59295:x1875885971449472:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 821us (1030us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986923.394947:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1183 00000100:00100000:3.0:1788986923.400558:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986923.400659:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971449728 00000100:00100000:0.0:1788986923.400669:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971449728 00000100:00100000:0.0:1788986923.400722:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1184 00000100:00100000:0.0:1788986923.400732:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59295:x1875885971449728:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:0.0:1788986923.400785:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986923.400825:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16cc expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.400850:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:0.0:1788986923.400861:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986923.400889:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a46a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.400905:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a46a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.400915:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a46a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986923.447605:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003c6e4a47 reply state 00000000844c424f transno 4294967743 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a46a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986923.447622:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788986923.447638:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000100:00100000:0.0:1788986923.447732:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59295:x1875885971449728:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 46997us (47179us total) trans 4294967743 rc 0/0 00000100:00100000:0.0:1788986923.447742:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1184 00000001:00080000:0.0:1788986923.447788:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967743 is committed 00010000:00010000:3.0:1788986923.448937:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a46a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.448950:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a46a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.448958:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a46a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.448963:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986923.448968:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a46a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.448976:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a46a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.448989:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a4823bc00) 00010000:00010000:3.0:1788986923.448993:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986923.448997:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a46a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.449004:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a46a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986923.525840:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986923.527129:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971449856 00000100:00100000:2.0:1788986923.527141:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971449856 00000100:00100000:2.0:1788986923.527191:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1185 00000100:00100000:2.0:1788986923.527199:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59299:x1875885971449856:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986923.527222:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986923.527242:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a471 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16d3 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.527299:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54a478 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.527321:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54a478 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.527331:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54a478 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.527354:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a47f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.527361:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a47f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.527369:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a47f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.530799:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a486 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.530820:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.530832:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986923.531018:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:2.0:1788986923.531023:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986923.531043:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a486 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531057:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54a478 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531064:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54a478 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531071:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54a478 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531077:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986923.531081:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54a478 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531106:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54a478 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531120:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:2.0:1788986923.531123:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986923.531128:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54a478 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531134:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54a478 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531145:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a47f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531151:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a47f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531156:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a47f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531161:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986923.531163:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a47f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531169:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a47f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531177:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986923.531179:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986923.531182:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a47f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531188:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a47f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531234:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a471 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16d3 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531249:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a486 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16d3 expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.531256:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:2.0:1788986923.531258:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986923.531261:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788986923.531330:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59299:x1875885971449856:12345-192.168.206.21@tcp:101:touch.0 Request processed in 4130us (5497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986923.531349:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1185 00000100:00100000:2.0:1788986923.542368:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986923.542436:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971450112 00000100:00100000:0.0:1788986923.542447:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971450112 00000100:00100000:0.0:1788986923.542514:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1186 00000100:00100000:0.0:1788986923.542526:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59299:x1875885971450112:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788986923.542547:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986923.542571:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a48d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16da expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.542965:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a494 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.542981:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a494 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.542992:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a494 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.543040:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a49b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.543049:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a49b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.543056:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a49b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788986923.544170:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x25:0x0], index 1: 0 00010000:00010000:0.0:1788986923.545116:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.545140:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.545153:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.545193:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a494 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.545205:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a494 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.545294:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a494 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.545300:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986923.545305:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a494 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.545312:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a494 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.545324:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:0.0:1788986923.545327:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986923.545332:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a494 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.545347:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a494 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986923.545360:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000d1b94856 reply state 000000000a7c0765 transno 4294967744 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a49b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986923.545368:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788986923.545401:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a48d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16da expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.545486:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16da expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.545499:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9b0a4823bd00) 00010000:00010000:0.0:1788986923.545502:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986923.545504:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee000, rc 0) 00000100:00100000:0.0:1788986923.545580:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59299:x1875885971450112:12345-192.168.206.21@tcp:101:touch.0 Request processed in 3056us (3219us total) trans 4294967744 rc 0/0 00000100:00100000:0.0:1788986923.545589:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1186 00010000:00010000:1.0:1788986923.549233:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a49b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.549248:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a49b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.549256:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a49b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.549262:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986923.549267:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a49b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.549276:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a49b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.549292:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a4823b600) 00010000:00010000:1.0:1788986923.549295:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986923.549300:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a49b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.549306:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef600/0xc20d828fcf54a49b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986923.551284:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986923.551375:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971450368 00000100:00100000:1.0:1788986923.551388:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971450368 00000100:00100000:1.0:1788986923.551446:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1187 00000100:00100000:1.0:1788986923.551458:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59299:x1875885971450368:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:1.0:1788986923.551521:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986923.551629:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16da expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.551647:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9b0a4823bd00) 00010000:00010000:1.0:1788986923.551658:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986923.551707:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a4b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.551720:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.551730:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986923.551862:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000337e6396 reply state 0000000024b4bdde transno 4294967745 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986923.551872:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986923.551976:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59299:x1875885971450368:12345-192.168.206.21@tcp:36:touch.0 Request processed in 519us (704us total) trans 4294967745 rc 0/0 00000100:00100000:1.0:1788986923.551986:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1187 00010000:00010000:3.0:1788986923.556412:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a4b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.556429:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a4b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.556437:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a4b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.556443:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986923.556448:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a4b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.556456:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a4b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.556472:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9b0a45316d00) 00010000:00010000:3.0:1788986923.556475:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986923.556480:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a4b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.556486:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a4b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986923.558501:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986923.558617:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971450496 00000100:00100000:2.0:1788986923.558629:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971450496 00000100:00100000:2.0:1788986923.558711:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1188 00000100:00100000:2.0:1788986923.558726:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59299:x1875885971450496:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986923.558757:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986923.558787:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a4b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16e1 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.558865:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a4b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16e1 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.558883:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a4b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x61:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16e1 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986923.558911:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:2.0:1788986923.558914:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788986923.558918:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1a00, rc 0) 00000100:00100000:2.0:1788986923.558984:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59299:x1875885971450496:12345-192.168.206.21@tcp:101:touch.0 Request processed in 261us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986923.558991:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1188 00000100:00100000:0.0:1788986923.564693:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986923.564851:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971450624 00000100:00100000:1.0:1788986923.564860:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971450624 00000100:00100000:1.0:1788986923.564926:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 649 00000100:00100000:1.0:1788986923.564936:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971450624:12345-192.168.206.21@tcp:2:touch.0 00000100:00100000:1.0:1788986923.565365:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971450624:12345-192.168.206.21@tcp:2:touch.0 Request processed in 429us (678us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1788986923.565374:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 649 00000100:00080000:0.0:1788986923.565556:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986923.575213:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986923.575311:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971450880 00000100:00100000:2.0:1788986923.575321:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971450880 00000100:00100000:2.0:1788986923.575390:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 117 00000100:00100000:2.0:1788986923.575400:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59299:x1875885971450880:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:2.0:1788986923.575981:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59299:x1875885971450880:12345-192.168.206.21@tcp:35:touch.0 Request processed in 580us (774us total) trans 4294967746 rc 0/0 00000100:00100000:2.0:1788986923.575989:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 117 00000100:00100000:2.0:1788986923.681666:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986923.681769:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971451008 00000100:00100000:0.0:1788986923.681779:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971451008 00000100:00100000:0.0:1788986923.681845:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1189 00000100:00100000:0.0:1788986923.681855:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59303:x1875885971451008:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986923.681878:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986923.681897:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a4be lrc: 2/0,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16e8 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.681964:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a4c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.681978:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a4c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.681988:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a4c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682007:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a4cc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682015:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a4cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682021:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a4cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682151:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54a4d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682161:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54a4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682168:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54a4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986923.682207:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x61:0x0]: returning size 0 00000004:00200000:0.0:1788986923.682212:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986923.682232:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54a4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682244:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54a4d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682253:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a4c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682259:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a4c5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682270:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a4c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682276:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986923.682280:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a4c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682288:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a4c5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682298:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:0.0:1788986923.682301:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986923.682306:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a4c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682312:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a4c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682326:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a4cc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682332:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a4cc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682348:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a4cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682353:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986923.682356:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a4cc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682366:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a4cc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682372:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a4823b800) 00010000:00010000:0.0:1788986923.682375:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986923.682378:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a4cc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682383:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a4cc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682411:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a4be lrc: 0/0,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16e8 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682425:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54a4d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16e8 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.682432:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:0.0:1788986923.682434:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788986923.682437:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eec00, rc 0) 00000100:00100000:0.0:1788986923.682494:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59303:x1875885971451008:12345-192.168.206.21@tcp:101:rm.0 Request processed in 640us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986923.682502:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1189 00000100:00100000:3.0:1788986923.685768:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986923.690879:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971451136 00000100:00100000:0.0:1788986923.690896:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971451136 00000100:00100000:0.0:1788986923.690978:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 650 00000100:00100000:0.0:1788986923.690988:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971451136:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986923.691008:0:6698:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986923.691026:0:6698:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf54a4da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16ef expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986923.691052:0:6698:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x25:0x0] initial LVB size: 0, mtime: 0x6aa1c62b, atime: 0x6aa1c62b, ctime: 0x6aa1c62b, blocks: 0x1 00010000:00010000:0.0:1788986923.691071:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=2707s v=(0 0) 00010000:00010000:0.0:1788986923.691076:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986923.691085:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf54a4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16ef expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.691129:0:6698:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf54a4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16ef expref: 7 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.691142:0:6698:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef200, rc 0) 00000100:00100000:0.0:1788986923.691222:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971451136:12345-192.168.206.21@tcp:101:rm.0 Request processed in 235us (5465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986923.691229:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 650 00000100:00100000:1.0:1788986923.694404:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986923.694481:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971451392 00000100:00100000:0.0:1788986923.694491:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971451392 00000100:00100000:0.0:1788986923.694545:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1190 00000100:00100000:0.0:1788986923.694555:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59303:x1875885971451392:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1788986923.694599:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788986923.694625:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54a4d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x61:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16e8 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.694663:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a4b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x61:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16e1 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.694675:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9b0a45acaf00) 00010000:00010000:0.0:1788986923.694691:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986923.694711:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a4e1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.694724:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a4e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.694733:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a4e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.694746:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a4e8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.694752:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a4e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.694758:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a4e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.695013:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a4ef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.695021:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a4ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.695028:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a4ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788986923.695528:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].37, 64 off10560 00000004:00080000:0.0:1788986923.695539:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2707598449458ns, next at 2708598447408ns, rc = 0 00010000:00010000:0.0:1788986923.695596:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.695606:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.695613:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.695620:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.695627:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4f6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986923.699037:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699188:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986923.699224:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a4ef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699231:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a4ef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699238:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a4ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699244:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986923.699248:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a4ef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699255:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a4ef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699268:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9b0a4823bd00) 00010000:00010000:1.0:1788986923.699272:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788986923.699277:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a4ef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699283:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a4ef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x61:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699304:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a4e1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699310:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a4e1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699316:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a4e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699320:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986923.699323:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a4e1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699329:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a4e1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699348:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:1.0:1788986923.699351:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986923.699354:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a4e1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.699360:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a4e1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986923.699370:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e61ef8e5 reply state 000000004d52cb03 transno 4294967747 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a4e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986923.699384:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788986923.699474:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943706300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59303:x1875885971451392:12345-192.168.206.21@tcp:36:rm.0 Request processed in 4916us (5074us total) trans 4294967747 rc 0/0 00000100:00100000:1.0:1788986923.699483:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1190 00010000:00010000:3.0:1788986923.699947:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986923.699954:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.699961:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986923.699964:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4f6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.699972:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x61:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.699983:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x61:0x0].0x0 (ffff9b0a4823bd00) 00010000:00010000:3.0:1788986923.699985:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986923.699988:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4f6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.699993:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a4f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x61:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986923.700009:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986923.700011:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986923.700013:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986923.703419:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a4e8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.703437:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a4e8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.703445:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a4e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.703451:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986923.703455:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a4e8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.703463:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a4e8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.703480:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a4823b300) 00010000:00010000:1.0:1788986923.703483:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986923.703488:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a4e8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986923.703494:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a4e8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986924.034536:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993652736:0@lo:400:kworker.0 00000100:00100000:0.0:1788986924.034614:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986924.034664:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986924.034670:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993652864:0@lo:400:kworker.0 00000100:00100000:0.0:1788986924.034697:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986924.034832:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993652480:0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.034866:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986924.034898:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993652992:0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.034919:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986924.034939:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788986924.034944:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993652608:0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.034963:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986924.034979:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993653120:0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.034996:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986924.035024:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993652864 00000100:00100000:3.0:1788986924.035030:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993652864 00000100:00100000:3.0:1788986924.035070:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993653120 00000100:00100000:3.0:1788986924.035073:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993653120 00000100:00100000:3.0:1788986924.035136:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:3.0:1788986924.035146:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993652864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.035202:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993652864:12345-0@lo:400:kworker.0 Request processed in 57us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986924.035210:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:3.0:1788986924.035239:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1474 00000100:00100000:3.0:1788986924.035246:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993653120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.035280:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993653120:12345-0@lo:400:kworker.0 Request processed in 35us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986924.035286:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1474 00000100:00100000:3.0:1788986924.035304:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993652736 00000100:00100000:3.0:1788986924.035308:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993652736 00000100:00100000:3.0:1788986924.035331:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993652992 00000100:00100000:3.0:1788986924.035334:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993652992 00000100:00100000:3.0:1788986924.035365:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993652608 00000100:00100000:3.0:1788986924.035368:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993652608 00000100:00100000:3.0:1788986924.035384:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1936 00000100:00100000:3.0:1788986924.035391:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993652736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.035428:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993652736:12345-0@lo:400:kworker.0 Request processed in 38us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986924.035434:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1936 00000100:00100000:3.0:1788986924.035447:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1937 00000100:00100000:3.0:1788986924.035453:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993652992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.035479:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993652992:12345-0@lo:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986924.035485:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1937 00000100:00100000:3.0:1788986924.035496:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1938 00000100:00100000:3.0:1788986924.035501:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993652608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.035526:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993652608:12345-0@lo:400:kworker.0 Request processed in 25us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986924.035531:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1938 00000100:00080000:3.0:1788986924.035552:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986924.035557:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986924.035605:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993652608:0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.035617:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993653120:0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.035626:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993652992:0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.035655:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993652864:0@lo:400:kworker.0 00000100:00100000:3.0:1788986924.035665:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993652736:0@lo:400:kworker.0 00000100:00100000:0.0:1788986924.035901:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993652480 00000100:00100000:0.0:1788986924.035905:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993652480 00000100:00100000:0.0:1788986924.035939:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1473 00000100:00100000:0.0:1788986924.035946:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993652480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986924.035983:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993652480:12345-0@lo:400:kworker.0 Request processed in 37us (1116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986924.035989:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1473 00000100:00100000:3.0:1788986924.036203:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993652480:0@lo:400:kworker.0 00010000:00010000:3.0:1788986924.099036:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986924.544349:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986924.544373:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993653248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986924.544447:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986924.544529:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993653248 00000100:00100000:2.0:1788986924.544538:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993653248 00000100:00100000:2.0:1788986924.544589:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1788986924.544601:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993653248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986924.544637:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986924.544688:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993653248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986924.544695:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1788986924.544755:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993653248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986924.888311:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986924.888417:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971451520 00000100:00100000:0.0:1788986924.888430:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971451520 00000100:00100000:0.0:1788986924.888504:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1191 00000100:00100000:0.0:1788986924.888517:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59318:x1875885971451520:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986924.888548:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986924.888575:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a4fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16f6 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986924.888655:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a504 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986924.888672:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986924.888688:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986924.888732:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:0.0:1788986924.888736:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986924.888759:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a504 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986924.888787:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a4fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16f6 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986924.890246:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a504 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16f6 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986924.890266:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:0.0:1788986924.890269:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986924.890274:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee400, rc 0) 00000100:00100000:0.0:1788986924.890374:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59318:x1875885971451520:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 1858us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986924.890384:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1191 00000100:00100000:3.0:1788986924.904629:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986924.904675:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971451776 00000100:00100000:3.0:1788986924.904688:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971451776 00000100:00100000:3.0:1788986924.904754:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1192 00000100:00100000:3.0:1788986924.904766:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59318:x1875885971451776:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986924.904837:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986924.904875:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a504 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16f6 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.904906:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a486 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16d3 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.904919:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45acac00) 00010000:00010000:3.0:1788986924.904933:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986924.904966:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a50b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.904982:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a50b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.904994:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a50b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788986924.975558:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967747 is committed 00000004:00080000:0.0:1788986924.975577:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 103 committed 00000001:00080000:0.0:1788986924.975608:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967748 is committed 00000100:00100000:0.0:1788986924.975768:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993653376:0@lo:6:osp-syn-1-0.0 00000004:00010000:3.0:1788986924.975942:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000e93fb019 reply state 00000000e378e539 transno 4294967748 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a50b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986924.975961:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986924.975982:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00010000:00080000:3.0:1788986924.976160:0:5855:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788986924.976183:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59318:x1875885971451776:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 71415us (71564us total) trans 4294967748 rc 0/0 00000100:00100000:3.0:1788986924.976195:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1192 00010000:00010000:3.0:1788986924.976434:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a50b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.976446:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a50b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.976456:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a50b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.976465:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986924.976471:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a50b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.976482:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a50b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.976509:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745c00) 00010000:00010000:3.0:1788986924.976513:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986924.976521:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a50b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.976529:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a50b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986924.976933:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986924.977537:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993653376 00000100:00100000:1.0:1788986924.977551:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993653376 00000100:00100000:1.0:1788986924.977644:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00000100:00100000:1.0:1788986924.977657:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993653376:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788986924.977694:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:37 count 1 00010000:00010000:1.0:1788986924.977724:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986924.977747:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf54a4da lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16ef expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986924.977757:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788986924.977762:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986924.977767:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986924.977817:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf54a4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16ef expref: 6 pid: 6698 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986924.977833:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf54a4da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16ef expref: 6 pid: 6698 timeout: 2808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986924.977849:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993653504:192.168.206.21@tcp:104: 00000100:00100000:1.0:1788986924.977931:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788986924.983736:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993653504:192.168.206.21@tcp:104: 00010000:00010000:1.0:1788986924.983785:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986924.985449:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986924.985618:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971451904 00000100:00100000:3.0:1788986924.985632:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971451904 00010000:00010000:3.0:1788986924.985689:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf54a4da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16ef expref: 7 pid: 6698 timeout: 2808 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986924.985744:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 466 00000100:00100000:3.0:1788986924.985755:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971451904:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788986924.985773:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986924.985781:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf54a4da lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16ef expref: 7 pid: 6698 timeout: 2808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.986348:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf54a4da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16ef expref: 7 pid: 6698 timeout: 2808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.986393:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b55ab2e9/0xc20d828fcf54a4da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x25:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16ef expref: 7 pid: 6698 timeout: 2808 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.986413:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986924.986418:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986924.986425:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.986438:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986924.986539:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986924.986621:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971451904:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 865us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986924.986631:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 466 00010000:00010000:1.0:1788986924.986707:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986924.986720:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986924.986734:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986924.986742:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986924.986771:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986924.986830:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986924.986839:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.986849:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986924.986854:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.986877:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.986891:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.986904:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048d99ca4/0xc20d828fcf54a512 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986924.986928:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986924.986930:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986924.986932:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986924.988052:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993653376:12345-0@lo:6:osp-syn-1-0.0 Request processed in 10392us (11115us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788986924.988066:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00000004:00080000:0.0:1788986924.988253:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a80c1aa00/2, rc 0, transno 4294967371 00000100:00100000:0.0:1788986924.988262:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993653376:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788986925.040952:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986925.041666:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971452032 00000100:00100000:1.0:1788986925.041682:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971452032 00000100:00100000:1.0:1788986925.041791:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1193 00000100:00100000:1.0:1788986925.041806:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59322:x1875885971452032:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:1.0:1788986925.041840:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986925.041868:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a519 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d16fd expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.041952:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a520 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.041987:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a520 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042003:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a520 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042022:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a527 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042030:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042037:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042533:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a52e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042544:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a52e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042552:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a52e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986925.042587:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:1.0:1788986925.042593:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986925.042617:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a52e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042630:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a520 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042641:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a520 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042649:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a520 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042655:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986925.042660:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a520 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042668:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a520 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042681:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:1.0:1788986925.042685:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986925.042690:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a520 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042696:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a520 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042713:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a527 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042718:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a527 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042723:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a527 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042728:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986925.042732:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a527 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042737:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a527 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042744:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a45316e00) 00010000:00010000:1.0:1788986925.042746:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986925.042749:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a527 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042754:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a527 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042793:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a519 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16fd expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042807:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a52e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16fd expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.042815:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45316b00) 00010000:00010000:1.0:1788986925.042818:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788986925.042820:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00100000:1.0:1788986925.042898:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59322:x1875885971452032:12345-192.168.206.21@tcp:101:touch.0 Request processed in 1094us (1961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986925.042906:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1193 00000100:00080000:3.0:1788986925.046020:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986925.053544:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986925.053750:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971452288 00000100:00100000:0.0:1788986925.053764:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971452288 00000100:00100000:0.0:1788986925.053840:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1194 00000100:00100000:0.0:1788986925.053853:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59322:x1875885971452288:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:0.0:1788986925.053883:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986925.053915:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a535 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1704 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986925.054567:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a53c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986925.054588:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a53c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986925.054605:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a53c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986925.054623:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a543 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986925.054631:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986925.055036:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788986925.063881:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x26:0x0], index 0: 0 00010000:00010000:1.0:1788986925.065862:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a54a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.065896:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a54a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.065912:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a54a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.065982:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a53c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.065992:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a53c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.066001:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a53c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.066009:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986925.066014:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a53c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.066022:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a53c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.066036:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45316b00) 00010000:00010000:1.0:1788986925.066039:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986925.066046:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a53c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.066053:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a53c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986925.066072:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008975a89b reply state 00000000ae38aecd transno 4294967749 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986925.066085:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986925.066418:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a535 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1704 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.066438:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a54a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1704 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.066446:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:1.0:1788986925.066449:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986925.066451:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788986925.066563:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59322:x1875885971452288:12345-192.168.206.21@tcp:101:touch.0 Request processed in 12711us (13033us total) trans 4294967749 rc 0/0 00000100:00100000:1.0:1788986925.066575:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1194 00000100:00100000:3.0:1788986925.070940:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986925.071133:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971452544 00000100:00100000:0.0:1788986925.071147:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971452544 00000100:00100000:0.0:1788986925.071217:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1195 00000100:00100000:0.0:1788986925.071229:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59322:x1875885971452544:12345-192.168.206.21@tcp:36:touch.0 00010000:00010000:0.0:1788986925.071303:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986925.071351:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a54a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1704 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986925.071379:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:0.0:1788986925.071393:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986925.071452:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54a558 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986925.071467:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54a558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986925.071479:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54a558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986925.071664:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002f32c1e2 reply state 000000000b321e0e transno 4294967750 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54a558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986925.071675:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986925.071774:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a543 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.071786:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a543 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.071795:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a543 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986925.071801:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59322:x1875885971452544:12345-192.168.206.21@tcp:36:touch.0 Request processed in 572us (874us total) trans 4294967750 rc 0/0 00010000:00010000:1.0:1788986925.071805:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986925.071812:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a543 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986925.071815:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1195 00010000:00010000:1.0:1788986925.071826:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a543 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.071841:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a4823b800) 00010000:00010000:1.0:1788986925.071845:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986925.071849:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a543 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.071855:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a543 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.075507:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54a558 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.075533:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54a558 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.075543:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54a558 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.075551:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986925.075558:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54a558 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.075567:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54a558 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.075590:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9b0a4823b600) 00010000:00010000:3.0:1788986925.075593:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986925.075600:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54a558 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.075612:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef200/0xc20d828fcf54a558 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986925.077005:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986925.077378:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971452672 00000100:00100000:2.0:1788986925.077394:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971452672 00000100:00100000:2.0:1788986925.077472:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1196 00000100:00100000:2.0:1788986925.077487:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59322:x1875885971452672:12345-192.168.206.21@tcp:101:touch.0 00010000:00010000:2.0:1788986925.077522:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986925.077554:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a55f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d170b expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986925.077746:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a55f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d170b expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986925.077768:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a55f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d170b expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986925.077794:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:2.0:1788986925.077798:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788986925.077862:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1400, rc 0) 00000100:00100000:2.0:1788986925.077945:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59322:x1875885971452672:12345-192.168.206.21@tcp:101:touch.0 Request processed in 461us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986925.077953:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1196 00000100:00100000:0.0:1788986925.081380:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986925.081615:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971452800 00000100:00100000:3.0:1788986925.081628:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971452800 00000100:00100000:3.0:1788986925.081792:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 652 00000100:00080000:0.0:1788986925.081921:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986925.081967:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971452800:12345-192.168.206.21@tcp:2:touch.0 00000100:00100000:3.0:1788986925.082545:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971452800:12345-192.168.206.21@tcp:2:touch.0 Request processed in 580us (1178us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788986925.086144:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 652 00000100:00100000:0.0:1788986925.086479:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986925.086599:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971453056 00000100:00100000:3.0:1788986925.086612:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971453056 00000100:00100000:2.0:1788986925.088891:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 118 00000100:00100000:2.0:1788986925.088930:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59322:x1875885971453056:12345-192.168.206.21@tcp:35:touch.0 00000100:00100000:2.0:1788986925.089578:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59322:x1875885971453056:12345-192.168.206.21@tcp:35:touch.0 Request processed in 650us (3099us total) trans 4294967751 rc 0/0 00000100:00100000:2.0:1788986925.089591:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 118 00010000:00010000:3.0:1788986925.120426:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986925.145354:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986925.145556:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971453184 00000100:00100000:1.0:1788986925.145570:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971453184 00000100:00100000:1.0:1788986925.145768:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1197 00000100:00100000:1.0:1788986925.145782:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59326:x1875885971453184:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:1.0:1788986925.145815:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986925.145844:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a566 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1712 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.145927:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a56d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.145945:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a56d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.145959:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a56d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.145989:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a574 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.145998:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146006:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146181:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a57b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146192:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146199:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986925.146244:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x62:0x0]: returning size 0 00000004:00200000:1.0:1788986925.146249:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986925.146275:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146289:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a57b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146298:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a56d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146305:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a56d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146312:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a56d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146318:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986925.146323:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a56d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146343:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a56d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146360:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45316b00) 00010000:00010000:1.0:1788986925.146363:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986925.146370:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a56d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146376:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a56d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146395:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a574 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146401:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a574 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146407:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146413:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986925.146416:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a574 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146422:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a574 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146431:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a45316f00) 00010000:00010000:1.0:1788986925.146433:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986925.146436:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a574 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146447:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a574 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146482:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a566 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1712 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146499:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a57b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1712 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.146507:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:1.0:1788986925.146509:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986925.146512:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788986925.146600:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59326:x1875885971453184:12345-192.168.206.21@tcp:101:rm.0 Request processed in 821us (1270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986925.146608:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1197 00000100:00100000:0.0:1788986925.154572:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986925.157033:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971453312 00000100:00100000:3.0:1788986925.157052:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971453312 00000100:00100000:3.0:1788986925.157247:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 653 00000100:00100000:3.0:1788986925.157260:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971453312:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986925.157284:0:6697:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986925.157310:0:6697:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006f34e941/0xc20d828fcf54a582 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1719 expref: -99 pid: 6697 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788986925.157359:0:6697:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x26:0x0] initial LVB size: 0, mtime: 0x6aa1c62c, atime: 0x6aa1c62c, ctime: 0x6aa1c62c, blocks: 0x1 00010000:00010000:3.0:1788986925.157388:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=2709s v=(0 0) 00010000:00010000:3.0:1788986925.157394:0:6697:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986925.157404:0:6697:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006f34e941/0xc20d828fcf54a582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1719 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.157427:0:6697:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006f34e941/0xc20d828fcf54a582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1719 expref: 7 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.157443:0:6697:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788986925.157524:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971453312:12345-192.168.206.21@tcp:101:rm.0 Request processed in 266us (2966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986925.157532:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 653 00000100:00100000:2.0:1788986925.164664:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986925.164770:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971453568 00000100:00100000:3.0:1788986925.164783:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971453568 00000100:00100000:3.0:1788986925.164925:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1198 00000100:00100000:3.0:1788986925.164939:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59326:x1875885971453568:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788986925.165008:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986925.165057:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a57b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x62:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1712 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.165154:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a55f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x62:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d170b expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.165169:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9b0a45aca900) 00010000:00010000:3.0:1788986925.165185:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986925.165230:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a589 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.165247:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.165262:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.165279:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a590 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.165287:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.165294:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.165429:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a597 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.165438:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.165445:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788986925.166143:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].38, 64 off10624 00000004:00080000:3.0:1788986925.166158:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2709069067911ns, next at 2710069064978ns, rc = 0 00010000:00010000:3.0:1788986925.166247:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a59e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166259:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a59e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166269:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a59e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166280:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a59e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166287:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a59e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166293:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a59e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166315:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986925.166357:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a597 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166364:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a597 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166370:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a597 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166376:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986925.166381:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a597 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166388:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a597 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166398:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:3.0:1788986925.166401:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986925.166406:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a597 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166416:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a597 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x62:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166442:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166448:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a589 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166454:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a589 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166459:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986925.166462:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a589 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166468:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a589 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166477:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45316b00) 00010000:00010000:3.0:1788986925.166479:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986925.166482:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a589 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986925.166488:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a589 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986925.166499:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000002ccdc2bd reply state 0000000082850062 transno 4294967752 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986925.166509:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986925.166624:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59326:x1875885971453568:12345-192.168.206.21@tcp:36:rm.0 Request processed in 1685us (1972us total) trans 4294967752 rc 0/0 00000100:00100000:3.0:1788986925.166634:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1198 00010000:00010000:1.0:1788986925.166805:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986925.166813:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a59e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.166819:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986925.166823:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a59e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.166830:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a59e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.166839:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x62:0x0].0x0 (ffff9b0a55745500) 00010000:00010000:1.0:1788986925.166842:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788986925.166846:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a59e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.166852:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a59e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x62:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.166868:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986925.166870:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986925.166871:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986925.169969:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.169997:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a590 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.170006:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.170081:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986925.170271:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.170282:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a590 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.170304:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a55745700) 00010000:00010000:1.0:1788986925.170307:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986925.170313:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a590 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986925.170321:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a590 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986926.144945:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986926.220399:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986926.220442:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971453824 00000100:00100000:2.0:1788986926.220454:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971453824 00000100:00100000:2.0:1788986926.220530:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1939 00000100:00100000:2.0:1788986926.220541:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:2349:x1875885971453824:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986926.220640:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+11:2349:x1875885971453824:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 100us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986926.220647:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1939 00000100:00100000:2.0:1788986926.220693:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986926.222690:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986926.222736:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986926.222790:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971454080 00000100:00100000:2.0:1788986926.223954:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971454080 00000100:00100000:2.0:1788986926.224134:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971453952 00000100:00100000:2.0:1788986926.224139:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971453952 00000100:00100000:2.0:1788986926.224280:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1475 00000100:00100000:2.0:1788986926.224294:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971454080:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986926.224427:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971454080:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 138us (3734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986926.224435:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1475 00000100:00100000:2.0:1788986926.224458:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1476 00000100:00100000:2.0:1788986926.224466:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971453952:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986926.224496:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971453952:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 31us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986926.224502:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1476 00000100:00100000:2.0:1788986926.224557:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971453696 00000100:00100000:2.0:1788986926.224562:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971453696 00000100:00100000:2.0:1788986926.224590:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1474 00000100:00100000:2.0:1788986926.224596:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971453696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986926.224623:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971453696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (1947us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986926.224629:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1474 00000100:00080000:2.0:1788986926.224661:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986926.411306:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986926.412056:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971454208 00000100:00100000:0.0:1788986926.412075:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971454208 00000100:00100000:0.0:1788986926.412187:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1199 00000100:00100000:0.0:1788986926.412210:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59340:x1875885971454208:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:0.0:1788986926.412249:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986926.412285:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a5a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1720 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986926.412379:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a5ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986926.412398:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a5ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986926.412410:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a5ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986926.412460:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:0.0:1788986926.412465:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986926.412489:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a5ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986926.412519:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee000/0xc20d828fcf54a5a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1720 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986926.412545:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a5ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1720 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986926.412555:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45316b00) 00010000:00010000:0.0:1788986926.412558:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788986926.412563:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788986926.413152:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59340:x1875885971454208:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 444us (1357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986926.413163:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1199 00000100:00100000:0.0:1788986926.420697:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986926.420987:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971454464 00000100:00100000:3.0:1788986926.421000:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971454464 00000100:00100000:3.0:1788986926.421164:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1200 00000100:00100000:3.0:1788986926.421176:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59340:x1875885971454464:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986926.421249:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986926.421284:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a5ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1720 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.421308:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a52e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16fd expref: 11 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.421332:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45316b00) 00010000:00010000:3.0:1788986926.421346:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986926.421379:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a5b3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.421396:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a5b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.421407:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a5b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986926.421723:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000003b3d4b21 reply state 000000007cba0719 transno 4294967753 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a5b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986926.421736:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986926.421747:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000100:00100000:3.0:1788986926.423304:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59340:x1875885971454464:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 2116us (2609us total) trans 4294967753 rc 0/0 00000100:00100000:3.0:1788986926.423319:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1200 00010000:00010000:3.0:1788986926.427153:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a5b3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.427182:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a5b3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.427192:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a5b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.427199:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986926.427205:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a5b3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.427214:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a5b3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.427235:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:3.0:1788986926.427239:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788986926.427246:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a5b3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.427253:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2c00/0xc20d828fcf54a5b3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986926.552501:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986926.552721:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971454592 00000100:00100000:1.0:1788986926.552735:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971454592 00000100:00100000:1.0:1788986926.552822:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1201 00000100:00100000:1.0:1788986926.552833:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59352:x1875885971454592:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986926.552967:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59352:x1875885971454592:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 136us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986926.552976:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1201 00000100:00100000:2.0:1788986926.558619:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986926.558707:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971454720 00000100:00100000:3.0:1788986926.558720:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971454720 00000100:00100000:3.0:1788986926.558911:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 654 00000100:00100000:3.0:1788986926.558926:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59352:x1875885971454720:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986926.559668:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59352:x1875885971454720:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 742us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986926.564334:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 654 00000100:00100000:2.0:1788986926.568235:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986926.568370:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971454848 00000100:00100000:3.0:1788986926.568384:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971454848 00000100:00100000:3.0:1788986926.568487:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 655 00000100:00100000:3.0:1788986926.568501:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59352:x1875885971454848:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:3.0:1788986926.569346:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59352:x1875885971454848:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 843us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986926.569357:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 655 00000100:00100000:0.0:1788986926.573613:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986926.573705:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971454976 00000100:00100000:2.0:1788986926.573718:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971454976 00000100:00100000:2.0:1788986926.573788:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1202 00000100:00100000:2.0:1788986926.573900:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59352:x1875885971454976:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986926.575690:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59352:x1875885971454976:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 1779us (2079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986926.581147:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1202 00000100:00100000:0.0:1788986926.587393:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986926.593173:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971455104 00000100:00100000:2.0:1788986926.593194:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971455104 00000100:00100000:2.0:1788986926.593291:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1203 00000100:00100000:2.0:1788986926.593304:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59352:x1875885971455104:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986926.593472:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59352:x1875885971455104:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 169us (6093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986926.593481:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1203 00000100:00100000:3.0:1788986926.608054:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986926.608272:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971455232 00000100:00100000:0.0:1788986926.608286:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971455232 00000100:00100000:0.0:1788986926.608371:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 656 00000100:00100000:0.0:1788986926.608382:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59352:x1875885971455232:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986926.608846:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59352:x1875885971455232:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 464us (804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986926.608856:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 656 00000100:00100000:0.0:1788986926.618340:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986926.618405:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971455360 00000100:00100000:0.0:1788986926.618416:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971455360 00000100:00100000:0.0:1788986926.618479:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 657 00000100:00100000:0.0:1788986926.618490:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59352:x1875885971455360:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986926.624014:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59352:x1875885971455360:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 5509us (5683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986926.624030:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 657 00000100:00100000:0.0:1788986926.626685:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986926.627341:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971455488 00000100:00100000:3.0:1788986926.627357:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971455488 00000100:00100000:3.0:1788986926.627541:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1204 00000100:00100000:3.0:1788986926.627554:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59352:x1875885971455488:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986926.629435:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59352:x1875885971455488:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 1874us (2755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986926.629521:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1204 00000100:00100000:0.0:1788986926.672950:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986926.673150:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971455616 00000100:00100000:2.0:1788986926.673163:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971455616 00000100:00100000:2.0:1788986926.673257:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1205 00000100:00100000:2.0:1788986926.673270:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59356:x1875885971455616:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788986926.673301:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986926.673339:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a5ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1727 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.673432:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a5c1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.673467:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a5c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.673486:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a5c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.673506:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a5c8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.673514:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.673521:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674189:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a5cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674202:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a5cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674212:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a5cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986926.674264:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:2.0:1788986926.674269:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986926.674296:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a5cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674312:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a5c1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674319:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a5c1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674338:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674344:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986926.674350:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a5c1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674359:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a5c1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674374:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:2.0:1788986926.674377:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986926.674383:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a5c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674395:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a5c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674409:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a5c8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674416:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a5c8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674422:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a5c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.674427:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986926.674431:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a5c8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.675358:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a5c8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.675373:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a45acaa00) 00010000:00010000:2.0:1788986926.675376:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986926.675381:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a5c8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.675389:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1800/0xc20d828fcf54a5c8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.675626:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0600/0xc20d828fcf54a5ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1727 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.675647:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a5cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1727 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.675657:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:2.0:1788986926.675660:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788986926.675662:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1000, rc 0) 00000100:00100000:2.0:1788986926.676079:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59356:x1875885971455616:12345-192.168.206.21@tcp:101:dd.0 Request processed in 2808us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986926.676113:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1205 00000100:00100000:1.0:1788986926.681227:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986926.681340:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971455872 00000100:00100000:2.0:1788986926.681353:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971455872 00000100:00100000:2.0:1788986926.681427:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1206 00000100:00100000:2.0:1788986926.681440:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59356:x1875885971455872:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:2.0:1788986926.681470:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986926.681502:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54a5d6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d172e expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.681668:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a5dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.681688:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a5dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.681703:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a5dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.681720:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a5e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.681728:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.681740:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788986926.682451:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x26:0x0], index 1: 0 00010000:00010000:2.0:1788986926.682646:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a5eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.682660:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a5eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.682669:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a5eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.682708:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a5dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.682715:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a5dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.682723:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a5dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.682729:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986926.682734:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a5dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.682742:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a5dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.682754:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:2.0:1788986926.682758:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986926.682763:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a5dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.682770:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1a00/0xc20d828fcf54a5dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986926.682787:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000008f6441f5 reply state 0000000087db22f1 transno 4294967754 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986926.682796:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788986926.682833:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0000/0xc20d828fcf54a5d6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d172e expref: 15 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.682848:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a5eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d172e expref: 14 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.682856:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:2.0:1788986926.682858:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986926.682861:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1200, rc 0) 00000100:00100000:2.0:1788986926.682955:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+15:59356:x1875885971455872:12345-192.168.206.21@tcp:101:dd.0 Request processed in 1518us (1744us total) trans 4294967754 rc 0/0 00000100:00100000:2.0:1788986926.682964:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1206 00000100:00100000:1.0:1788986926.688787:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:2.0:1788986926.688888:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a5e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.688905:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a5e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.688913:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a5e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.688925:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986926.688930:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a5e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.688941:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a5e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.688961:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a45aca600) 00010000:00010000:2.0:1788986926.688964:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986926.688971:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a5e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.688978:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1c00/0xc20d828fcf54a5e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986926.689556:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971456000 00000100:00100000:3.0:1788986926.689573:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971456000 00000100:00100000:3.0:1788986926.689648:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 658 00000100:00100000:3.0:1788986926.689661:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59356:x1875885971456000:12345-192.168.206.21@tcp:101:dd.0 00010000:00010000:3.0:1788986926.689687:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986926.689715:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf54a5f9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1735 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788986926.689758:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788986926.689787:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=2710s v=(0 0) 00010000:00010000:3.0:1788986926.689804:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986926.689816:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf54a5f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1735 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.689837:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf54a5f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1735 expref: 7 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.689851:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2c00, rc 0) 00000100:00100000:3.0:1788986926.689939:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59356:x1875885971456000:12345-192.168.206.21@tcp:101:dd.0 Request processed in 281us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986926.689947:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 658 00000100:00100000:1.0:1788986926.717430:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986926.721375:0:6701:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971456128 00000100:00100000:3.0:1788986926.721399:0:6701:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971456128 00002000:00100000:3.0:1788986926.721480:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x26:0x0] (0->1048575) req@ffff9b0943705f80 x1875885971456128/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:92/0 lens 488/0 e 0 to 0 dl 1788986937 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788986926.721493:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0943705f80 with x1875885971456128 ext(0->1048575) 00002000:00010000:3.0:1788986926.721500:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0943705f80 00000100:00100000:3.0:1788986926.721593:0:6701:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 30 00000100:00100000:3.0:1788986926.721605:0:6701:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971456128:12345-192.168.206.21@tcp:4:dd.0 00000100:00100000:2.0:1788986926.763415:0:6701:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:2347:x1875885971456128:12345-192.168.206.21@tcp:4:dd.0 Request processed in 41792us (45981us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788986926.763437:0:6701:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 30 00002000:00100000:2.0:1788986926.763458:0:6701:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x26:0x0] (0->1048575) req@ffff9b0943705f80 x1875885971456128/t4294967372(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:92/0 lens 488/448 e 0 to 0 dl 1788986937 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788986926.763471:0:6701:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0943705f80 with x1875885971456128 ext(0->1048575) 00002000:00010000:2.0:1788986926.763479:0:6701:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0943705f80 00000100:00100000:0.0:1788986926.766442:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986926.766589:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971456256 00000100:00100000:3.0:1788986926.766603:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971456256 00000100:00100000:3.0:1788986926.766681:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1207 00000100:00100000:3.0:1788986926.766694:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+14:59356:x1875885971456256:12345-192.168.206.21@tcp:44:dd.0 00000100:00100000:3.0:1788986926.820774:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+14:59356:x1875885971456256:12345-192.168.206.21@tcp:44:dd.0 Request processed in 54063us (54329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986926.820793:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1207 00000001:00080000:1.0:1788986926.821152:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967750 is committed 00000001:00080000:1.0:1788986926.821173:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967754 is committed 00000004:00080000:1.0:1788986926.821189:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 102 committed 00000100:00100000:2.0:1788986926.822179:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986926.822215:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993653632:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788986926.822310:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986926.822520:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993653632 00000100:00100000:3.0:1788986926.822530:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993653632 00000100:00100000:3.0:1788986926.822654:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:3.0:1788986926.822666:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993653632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788986926.822700:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:38 count 1 00010000:00010000:3.0:1788986926.822936:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.822967:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006f34e941/0xc20d828fcf54a582 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1719 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.822978:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788986926.822983:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788986926.822988:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.823025:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006f34e941/0xc20d828fcf54a582 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1719 expref: 6 pid: 6697 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.823043:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006f34e941/0xc20d828fcf54a582 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1719 expref: 6 pid: 6697 timeout: 2810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986926.823065:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993653760:192.168.206.21@tcp:104: 00000100:00100000:3.0:1788986926.823177:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76320a80 going to sleep for 11 seconds 00000100:00080000:2.0:1788986926.823309:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986926.829428:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986926.829831:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986926.830354:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971456512 00000100:00100000:1.0:1788986926.830366:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971456512 00010000:00010000:1.0:1788986926.830419:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006f34e941/0xc20d828fcf54a582 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1719 expref: 7 pid: 6697 timeout: 2810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986926.830483:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 467 00000100:00100000:1.0:1788986926.830495:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971456512:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986926.830513:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986926.830521:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006f34e941/0xc20d828fcf54a582 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1719 expref: 7 pid: 6697 timeout: 2810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986926.830542:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006f34e941/0xc20d828fcf54a582 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1719 expref: 7 pid: 6697 timeout: 2810 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986926.830576:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986926.830594:0:8524:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788986926.830601:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986926.830612:0:8524:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986926.830637:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986926.830700:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971456512:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 207us (869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986926.830709:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 467 00000100:00100000:2.0:1788986926.831927:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971456384 00000100:00100000:2.0:1788986926.831943:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971456384 00000100:00100000:2.0:1788986926.832012:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 660 00000100:00100000:2.0:1788986926.832023:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:2346:x1875885971456384:12345-192.168.206.21@tcp:16:dd.0 00010000:00010000:3.0:1788986926.834312:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006f34e941/0xc20d828fcf54a582 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1719 expref: 6 pid: 6697 timeout: 2810 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986926.834359:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993653760:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788986926.834394:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.834408:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.834417:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.834432:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.834449:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986926.834471:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788986926.836425:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993653632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 13753us (14106us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788986926.836444:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00010000:00010000:2.0:1788986926.836955:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986926.836968:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.836982:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986926.836987:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.837001:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.837026:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.837034:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c96d4c96/0xc20d828fcf54a600 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986926.837065:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986926.837067:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986926.837068:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788986926.837170:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a7f352d80/2, rc 0, transno 4294967373 00000100:00100000:2.0:1788986926.837179:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993653632:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788986926.912364:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:2346:x1875885971456384:12345-192.168.206.21@tcp:16:dd.0 Request processed in 80324us (82933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986926.912380:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 660 00000001:00080000:3.0:1788986926.914311:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967371 is committed 00000001:00080000:3.0:1788986926.914342:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967370 is committed 00000001:00080000:3.0:1788986926.914351:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967372 is committed 00000100:00100000:0.0:1788986926.915312:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986926.915409:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971456768 00000100:00100000:3.0:1788986926.915423:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971456768 00000100:00100000:3.0:1788986926.915500:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 119 00000100:00100000:3.0:1788986926.915512:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59356:x1875885971456768:12345-192.168.206.21@tcp:35:dd.0 00000100:00100000:3.0:1788986926.916142:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59356:x1875885971456768:12345-192.168.206.21@tcp:35:dd.0 Request processed in 630us (837us total) trans 4294967755 rc 0/0 00000100:00100000:3.0:1788986926.916152:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 119 00010000:00010000:2.0:1788986927.168356:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986927.200975:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967373 is committed 00000001:00080000:3.0:1788986927.201000:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967372 is committed 00000100:00100000:3.0:1788986928.128587:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986928.128620:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993653888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986928.128716:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986928.128842:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993653888 00000100:00100000:0.0:1788986928.128853:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993653888 00000100:00100000:0.0:1788986928.128936:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:0.0:1788986928.128948:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993653888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986928.128997:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986928.129053:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993653888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986928.129060:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:0.0:1788986928.129132:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:0.0:1788986928.129139:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a7f352d80, transno 4294967373 00000100:00100000:0.0:1788986928.129177:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993653888:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986928.129817:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788986928.192292:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986928.310532:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967755 is committed 00000100:00100000:2.0:1788986929.152827:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993654400:0@lo:400:kworker.0 00000100:00100000:2.0:1788986929.152944:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986929.153020:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986929.153026:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993654272:0@lo:400:kworker.0 00000100:00100000:2.0:1788986929.153054:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986929.153114:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993654272 00000100:00100000:2.0:1788986929.153123:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993654272 00000100:00100000:2.0:1788986929.153191:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1940 00000100:00100000:2.0:1788986929.153202:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993654272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986929.153273:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993654272:12345-0@lo:400:kworker.0 Request processed in 74us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986929.153280:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1940 00000100:00080000:2.0:1788986929.153306:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986929.153362:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993654272:0@lo:400:kworker.0 00000100:00100000:1.0:1788986929.158572:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993654144:0@lo:400:kworker.0 00000100:00100000:1.0:1788986929.158672:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986929.158731:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993654656:0@lo:400:kworker.0 00000100:00100000:1.0:1788986929.158756:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986929.158793:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788986929.158801:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993654016:0@lo:400:kworker.0 00000100:00100000:2.0:1788986929.158929:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993654144 00000100:00100000:2.0:1788986929.158941:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993654144 00000100:00100000:2.0:1788986929.158999:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1941 00000100:00100000:2.0:1788986929.159009:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993654144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986929.159082:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993654144:12345-0@lo:400:kworker.0 Request processed in 74us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986929.159108:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1941 00000100:00100000:2.0:1788986929.159222:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993654400 00000100:00100000:2.0:1788986929.159227:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993654400 00000100:00100000:2.0:1788986929.159258:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993654656 00000100:00100000:2.0:1788986929.159261:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993654656 00000100:00100000:2.0:1788986929.159295:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1788986929.159302:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993654400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986929.159357:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993654400:12345-0@lo:400:kworker.0 Request processed in 56us (6413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986929.159364:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:2.0:1788986929.159376:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1478 00000100:00100000:2.0:1788986929.159383:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993654656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986929.159409:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993654656:12345-0@lo:400:kworker.0 Request processed in 27us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986929.159415:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1478 00000100:00080000:2.0:1788986929.159463:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986929.159513:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993654400:0@lo:400:kworker.0 00000100:00100000:1.0:1788986929.159932:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986929.159975:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993654528:0@lo:400:kworker.0 00000100:00100000:1.0:1788986929.160008:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986929.160045:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993654144:0@lo:400:kworker.0 00000100:00100000:1.0:1788986929.160055:0:3319:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967371 gen 2 00000004:00080000:1.0:1788986929.160060:0:3319:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a80c1aa00, transno 4294967371 00000100:00100000:1.0:1788986929.160072:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993654656:0@lo:400:kworker.0 00000100:00100000:3.0:1788986929.162212:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993654528 00000100:00100000:3.0:1788986929.162245:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993654528 00000100:00100000:3.0:1788986929.162423:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1942 00000100:00100000:3.0:1788986929.162448:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993654528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986929.162561:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993654528:12345-0@lo:400:kworker.0 Request processed in 130us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986929.162568:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1942 00000100:00100000:3.0:1788986929.162628:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993654528:0@lo:400:kworker.0 00000100:00100000:2.0:1788986929.163972:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993654016 00000100:00100000:2.0:1788986929.163984:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993654016 00000100:00100000:2.0:1788986929.164049:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1475 00000100:00100000:2.0:1788986929.164058:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993654016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986929.164177:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993654016:12345-0@lo:400:kworker.0 Request processed in 120us (5344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986929.164184:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1475 00000100:00080000:2.0:1788986929.164223:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986929.164256:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993654016:0@lo:400:kworker.0 00010000:00010000:1.0:1788986929.217586:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986929.666359:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993654784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986929.666462:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986929.666643:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993654784 00000100:00100000:3.0:1788986929.666655:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993654784 00000100:00100000:3.0:1788986929.666728:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1788986929.666739:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993654784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986929.666795:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788986929.674892:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993654784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8136us (8412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986929.674915:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:1.0:1788986929.675996:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993654784:0@lo:13:osp-pre-1-0.0 00000004:00080000:1.0:1788986929.845866:0:101356:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2713748772292ns, next at 2710069064978ns, rc = 0 00000004:00080000:1.0:1788986929.846018:0:101356:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2713748928110ns, next at 2708598447408ns, rc = 0 00000004:00080000:2.0:1788986929.960747:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 104 committed 00000004:00080000:2.0:1788986929.960786:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 103 committed 00010000:00010000:2.0:1788986930.241507:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986931.266237:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986931.318045:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986931.318113:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986931.318147:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986931.318200:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986931.318253:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971457024 00000100:00100000:0.0:1788986931.318264:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971457024 00000100:00100000:0.0:1788986931.318366:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1943 00000100:00100000:0.0:1788986931.318379:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971457024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986931.318492:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971457024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 116us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986931.318500:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1943 00000100:00100000:0.0:1788986931.318532:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971457280 00000100:00100000:0.0:1788986931.318536:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971457280 00000100:00100000:0.0:1788986931.318563:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971457152 00000100:00100000:0.0:1788986931.318566:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971457152 00000100:00100000:0.0:1788986931.318588:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1479 00000100:00100000:0.0:1788986931.318595:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971457280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986931.318627:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971457280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986931.318648:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1479 00000100:00100000:0.0:1788986931.318662:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1480 00000100:00100000:0.0:1788986931.318673:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971457152:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986931.318904:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971457152:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986931.318913:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1480 00000100:00100000:0.0:1788986931.318940:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971456896 00000100:00100000:0.0:1788986931.318945:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971456896 00000100:00100000:0.0:1788986931.318976:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1476 00000100:00100000:0.0:1788986931.318983:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971456896:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986931.319010:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971456896:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986931.319016:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1476 00000100:00080000:0.0:1788986931.319048:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986931.319053:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986931.319056:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986931.606644:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986931.606793:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971457408 00000100:00100000:3.0:1788986931.606806:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971457408 00000100:00100000:3.0:1788986931.606887:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1208 00000100:00100000:3.0:1788986931.606900:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59549:x1875885971457408:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986931.607021:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59549:x1875885971457408:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 123us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986931.607029:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1208 00000100:00100000:3.0:1788986931.608688:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986931.608900:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971457536 00000100:00100000:1.0:1788986931.608909:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971457536 00000100:00100000:1.0:1788986931.608977:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 661 00000100:00100000:1.0:1788986931.608987:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59549:x1875885971457536:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986931.609461:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59549:x1875885971457536:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 473us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986931.609469:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 661 00000100:00100000:0.0:1788986931.611974:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986931.612060:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971457664 00000100:00100000:2.0:1788986931.612072:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971457664 00000100:00100000:0.0:1788986931.612267:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 662 00000100:00100000:0.0:1788986931.612281:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59549:x1875885971457664:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986931.612724:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59549:x1875885971457664:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 445us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986931.612734:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 662 00000100:00100000:3.0:1788986931.615647:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986931.615737:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971457792 00000100:00100000:2.0:1788986931.615751:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971457792 00000100:00100000:2.0:1788986931.615820:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1209 00000100:00100000:2.0:1788986931.615832:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59549:x1875885971457792:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986931.616318:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59549:x1875885971457792:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 487us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986931.616327:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1209 00000100:00100000:0.0:1788986931.620803:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986931.621058:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971457920 00000100:00100000:2.0:1788986931.621069:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971457920 00000100:00100000:2.0:1788986931.621159:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1210 00000100:00100000:2.0:1788986931.621170:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59549:x1875885971457920:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986931.621282:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59549:x1875885971457920:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 115us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986931.621290:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1210 00000100:00100000:3.0:1788986931.628135:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986931.628495:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971458048 00000100:00100000:2.0:1788986931.628510:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971458048 00000100:00100000:2.0:1788986931.628583:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 663 00000100:00100000:2.0:1788986931.628595:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59549:x1875885971458048:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986931.629109:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59549:x1875885971458048:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 493us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986931.629120:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 663 00000100:00100000:3.0:1788986931.631504:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986931.631803:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971458176 00000100:00100000:2.0:1788986931.631814:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971458176 00000100:00100000:2.0:1788986931.631880:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 664 00000100:00100000:2.0:1788986931.631890:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59549:x1875885971458176:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986931.633484:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59549:x1875885971458176:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 1584us (1982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986931.633503:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 664 00000100:00100000:3.0:1788986931.636389:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986931.636549:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971458304 00000100:00100000:2.0:1788986931.636562:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971458304 00000100:00100000:2.0:1788986931.636754:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1211 00000100:00100000:2.0:1788986931.636767:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59549:x1875885971458304:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986931.637310:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59549:x1875885971458304:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 544us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986931.637319:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1211 00000100:00100000:0.0:1788986931.697269:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986931.697337:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971458560 00000100:00100000:0.0:1788986931.697349:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971458560 00000100:00100000:0.0:1788986931.697418:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1212 00000100:00100000:0.0:1788986931.697432:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59553:x1875885971458560:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:0.0:1788986931.697508:0:5855:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986931.697548:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1200/0xc20d828fcf54a5eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x63:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d172e expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.697567:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9b0a45aca500) 00010000:00010000:0.0:1788986931.697583:0:5855:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788986931.697614:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a607 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.697642:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a607 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.697654:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a607 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.697671:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a60e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.697679:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a60e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.697685:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a60e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.698238:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a615 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.698251:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.698259:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788986931.700873:0:5855:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].38, 64 off10624 00000004:00080000:0.0:1788986931.700893:0:5855:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2715603803019ns, next at 2716603799123ns, rc = 0 00010000:00010000:0.0:1788986931.704426:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a61c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704458:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a61c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704474:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a61c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704485:0:5855:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a61c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704493:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a61c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704501:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a61c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704528:0:5855:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788986931.704560:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a615 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704568:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a615 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704575:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a615 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704582:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efe00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986931.704588:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a615 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704597:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a615 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704611:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986931.704615:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788986931.704621:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a615 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704641:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efe00/0xc20d828fcf54a615 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x63:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704708:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a607 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704716:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a607 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704722:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a607 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704728:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986931.704731:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a607 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704737:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a607 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704746:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:0.0:1788986931.704749:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986931.704753:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a607 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.704759:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eea00/0xc20d828fcf54a607 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788986931.704771:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000edf09b85 reply state 000000006bda0976 transno 4294967756 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a60e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986931.704781:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788986931.704910:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59553:x1875885971458560:12345-192.168.206.21@tcp:36:rm.0 Request processed in 7475us (7649us total) trans 4294967756 rc 0/0 00000100:00100000:0.0:1788986931.704922:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1212 00010000:00010000:0.0:1788986931.705339:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986931.705346:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a61c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.705353:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986931.705357:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a61c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.705365:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a61c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.705374:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x63:0x0].0x0 (ffff9b0a4823bf00) 00010000:00010000:0.0:1788986931.705377:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788986931.705380:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a61c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.705386:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a61c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x63:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986931.705408:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986931.705411:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986931.705413:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986931.707678:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a60e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986931.707701:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a60e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986931.707711:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a60e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986931.707718:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986931.707724:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a60e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986931.707733:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a60e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986931.707752:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a4823ba00) 00010000:00010000:3.0:1788986931.707756:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986931.707761:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a60e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986931.707768:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee800/0xc20d828fcf54a60e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986932.290435:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986933.248439:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993654912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986933.248508:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986933.248595:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993654912 00000100:00100000:0.0:1788986933.248608:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993654912 00000100:00100000:0.0:1788986933.248700:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:0.0:1788986933.248710:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993654912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986933.248744:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986933.248800:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993654912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986933.248809:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00080000:0.0:1788986933.248834:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986933.248870:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993654912:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986933.313516:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788986933.879343:0:101501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2717782249050ns, next at 2710069064978ns, rc = 0 00000004:00080000:1.0:1788986933.879531:0:101501:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2717782440534ns, next at 2716603799123ns, rc = 0 00000001:00080000:1.0:1788986933.906455:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967756 is committed 00000004:00080000:1.0:1788986933.906471:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 105 committed 00000004:00080000:1.0:1788986933.906498:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 106 committed 00000004:00080000:1.0:1788986933.906504:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 104 committed 00000100:00100000:2.0:1788986933.906706:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986933.906732:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993655040:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788986933.906829:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986933.907082:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993655040 00000100:00100000:0.0:1788986933.907124:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993655040 00000100:00100000:0.0:1788986933.907205:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 665 00000100:00100000:0.0:1788986933.907216:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993655040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788986933.907253:0:6695:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:38 count 1 00010000:00010000:0.0:1788986933.907296:0:6695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986933.907323:0:6695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf54a5f9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1735 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986933.907340:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x26:0x0].0x0 since=7s v=(0 0) 00010000:00010000:0.0:1788986933.907345:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986933.907351:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986933.907385:0:6695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf54a5f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1735 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986933.907402:0:6695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf54a5f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1735 expref: 5 pid: 6695 timeout: 2817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986933.907415:0:6695:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875885993655168:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788986933.907492:0:6695:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c6b840 going to sleep for 11 seconds 00000100:00080000:1.0:1788986933.907773:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986933.910263:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986933.910297:0:6695:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6695:1875885993655168:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788986933.910329:0:6695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986933.910420:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971458688 00000100:00100000:1.0:1788986933.910429:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971458688 00010000:00010000:1.0:1788986933.910495:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf54a5f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1735 expref: 6 pid: 6695 timeout: 2817 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986933.910541:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 468 00000100:00100000:1.0:1788986933.910552:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971458688:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986933.910569:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788986933.910577:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf54a5f9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1735 expref: 6 pid: 6695 timeout: 2817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986933.910591:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf54a5f9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1735 expref: 6 pid: 6695 timeout: 2817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986933.910620:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a07ea54b/0xc20d828fcf54a5f9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1735 expref: 6 pid: 6695 timeout: 2817 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986933.910638:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986933.910643:0:5839:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x26:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788986933.910649:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986933.910660:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986933.910692:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788986933.910755:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971458688:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 204us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986933.910764:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 468 00010000:00010000:3.0:1788986933.910930:0:6695:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986933.910941:0:6695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986933.910952:0:6695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986933.910961:0:6695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788986933.910974:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788986933.910986:0:6695:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788986933.911013:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986933.911021:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986933.911029:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986933.911034:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986933.911043:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986933.911056:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986933.911188:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000470511e8/0xc20d828fcf54a623 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986933.911212:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986933.911214:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986933.911216:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986933.913463:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993655040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6238us (6623us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788986933.913482:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 665 00000004:00080000:2.0:1788986933.914407:0:3319:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a80d3b800/2, rc 0, transno 4294967373 00000100:00100000:2.0:1788986933.914433:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993655040:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1788986934.274624:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993655680:0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.274726:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986934.274803:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788986934.274810:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993655296:0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.274845:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986934.274882:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993655808:0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.274907:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986934.274937:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993655424:0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.274962:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986934.274981:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993655936:0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275002:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986934.275020:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986934.275025:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993655552:0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275046:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986934.275083:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993655680 00000100:00100000:1.0:1788986934.275126:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993655680 00000100:00100000:1.0:1788986934.275184:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993655936 00000100:00100000:1.0:1788986934.275187:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993655936 00000100:00100000:1.0:1788986934.275210:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:1.0:1788986934.275220:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993655680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275292:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993655680:12345-0@lo:400:kworker.0 Request processed in 72us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986934.275301:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:1.0:1788986934.275323:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1482 00000100:00100000:1.0:1788986934.275329:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993655936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275362:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3320:x1875885993655936:12345-0@lo:400:kworker.0 Request processed in 34us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986934.275368:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1482 00000100:00100000:1.0:1788986934.275387:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993655296 00000100:00100000:1.0:1788986934.275391:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993655296 00000100:00100000:1.0:1788986934.275419:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1477 00000100:00100000:1.0:1788986934.275425:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993655296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275456:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993655296:12345-0@lo:400:kworker.0 Request processed in 31us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986934.275462:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1477 00000100:00100000:1.0:1788986934.275492:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993655808 00000100:00100000:1.0:1788986934.275496:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993655808 00000100:00100000:1.0:1788986934.275533:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993655424 00000100:00100000:1.0:1788986934.275536:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993655424 00000100:00100000:1.0:1788986934.275553:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993655552 00000100:00100000:1.0:1788986934.275555:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993655552 00000100:00100000:1.0:1788986934.275570:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1944 00000100:00100000:1.0:1788986934.275576:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993655808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275606:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993655808:12345-0@lo:400:kworker.0 Request processed in 31us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986934.275612:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1944 00000100:00100000:1.0:1788986934.275624:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1945 00000100:00100000:1.0:1788986934.275629:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993655424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275656:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993655424:12345-0@lo:400:kworker.0 Request processed in 28us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986934.275662:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1945 00000100:00100000:1.0:1788986934.275674:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1946 00000100:00100000:1.0:1788986934.275680:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993655552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275706:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993655552:12345-0@lo:400:kworker.0 Request processed in 27us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986934.275711:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1946 00000100:00080000:1.0:1788986934.275759:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986934.275805:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993655552:0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275816:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993655424:0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275826:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993655936:0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275862:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993655296:0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275871:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993655808:0@lo:400:kworker.0 00000100:00100000:1.0:1788986934.275880:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943706680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993655680:0@lo:400:kworker.0 00010000:00010000:0.0:1788986934.339910:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986934.785888:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993656064:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986934.785989:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986934.786333:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993656064 00000100:00100000:0.0:1788986934.786345:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993656064 00000100:00100000:0.0:1788986934.786414:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1788986934.786426:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993656064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986934.786471:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1788986934.786552:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3321:x1875885993656064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986934.786561:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:1.0:1788986934.786658:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993656064:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986935.361181:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986936.384464:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986936.434842:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986936.434891:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986936.434922:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971458944 00000100:00100000:1.0:1788986936.434930:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971458944 00000100:00100000:1.0:1788986936.434984:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1947 00000100:00100000:1.0:1788986936.434994:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971458944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986936.435070:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971458944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 75us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986936.435077:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1947 00000100:00080000:1.0:1788986936.435118:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986936.435294:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971458816 00000100:00100000:3.0:1788986936.435299:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971458816 00000100:00100000:3.0:1788986936.435337:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1478 00000100:00100000:3.0:1788986936.435345:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971458816:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986936.435376:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971458816:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 33us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986936.435443:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1478 00000100:00100000:1.0:1788986936.446256:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986936.446338:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986936.446374:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971459072 00000100:00100000:1.0:1788986936.446383:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971459072 00000100:00100000:1.0:1788986936.446435:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971459200 00000100:00100000:1.0:1788986936.446439:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971459200 00000100:00100000:1.0:1788986936.446463:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1483 00000100:00100000:1.0:1788986936.446474:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971459072:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986936.446538:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971459072:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 66us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986936.446546:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1483 00000100:00100000:1.0:1788986936.446562:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1484 00000100:00100000:1.0:1788986936.446569:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971459200:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986936.446593:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971459200:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986936.446599:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1484 00000100:00080000:1.0:1788986936.446621:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986936.446625:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788986936.936806:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967373 is committed 00010000:00010000:1.0:1788986937.408543:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986938.368485:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986938.368515:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993656192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986938.369391:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986938.369578:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993656192 00000100:00100000:0.0:1788986938.369924:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993656192 00000100:00100000:0.0:1788986938.370010:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1788986938.370021:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993656192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986938.370068:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986938.370167:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993656192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 147us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986938.370174:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1788986938.370679:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993656192:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986938.370782:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986938.432606:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986939.395621:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993656448:0@lo:400:kworker.0 00000100:00100000:2.0:1788986939.395737:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986939.395810:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993656960:0@lo:400:kworker.0 00000100:00100000:2.0:1788986939.395839:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986939.395869:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986939.395875:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993656576:0@lo:400:kworker.0 00000100:00100000:3.0:1788986939.395901:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993656320:0@lo:400:kworker.0 00000100:00100000:2.0:1788986939.395903:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986939.395940:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986939.395967:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993656832:0@lo:400:kworker.0 00000100:00100000:2.0:1788986939.395985:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993656320 00000100:00100000:3.0:1788986939.395989:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986939.395994:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993656320 00000100:00100000:3.0:1788986939.396006:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986939.396011:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993656704:0@lo:400:kworker.0 00000100:00100000:3.0:1788986939.396031:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986939.396051:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1479 00000100:00100000:2.0:1788986939.396061:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993656320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986939.396145:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993656320:12345-0@lo:400:kworker.0 Request processed in 85us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986939.396154:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1479 00000100:00100000:1.0:1788986939.396432:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993656448 00000100:00100000:3.0:1788986939.396435:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993656320:0@lo:400:kworker.0 00000100:00100000:1.0:1788986939.396437:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993656448 00000100:00100000:1.0:1788986939.396468:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993656576 00000100:00100000:1.0:1788986939.396471:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993656576 00000100:00100000:1.0:1788986939.397161:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993656832 00000100:00100000:1.0:1788986939.397168:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993656832 00000100:00100000:1.0:1788986939.397192:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1948 00000100:00100000:1.0:1788986939.397200:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993656448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986939.397280:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993656448:12345-0@lo:400:kworker.0 Request processed in 79us (1542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986939.397288:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1948 00000100:00100000:1.0:1788986939.397307:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1949 00000100:00100000:1.0:1788986939.397313:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993656576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986939.397343:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993656576:12345-0@lo:400:kworker.0 Request processed in 31us (1439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986939.397350:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1949 00000100:00100000:1.0:1788986939.397362:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1788986939.397367:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993656832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986939.397403:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993656832:12345-0@lo:400:kworker.0 Request processed in 36us (1412us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986939.397408:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1950 00000100:00100000:1.0:1788986939.397431:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993656960 00000100:00100000:1.0:1788986939.397435:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993656960 00000100:00100000:1.0:1788986939.397467:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993656704 00000100:00100000:1.0:1788986939.397470:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993656704 00000100:00100000:1.0:1788986939.397490:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:1.0:1788986939.397497:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993656960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986939.399848:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993656960:12345-0@lo:400:kworker.0 Request processed in 2337us (3993us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986939.399867:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:1.0:1788986939.399909:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1486 00000100:00100000:1.0:1788986939.399925:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993656704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986939.399974:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993656704:12345-0@lo:400:kworker.0 Request processed in 57us (3941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986939.399981:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1486 00000100:00100000:1.0:1788986939.400415:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993656704:0@lo:400:kworker.0 00000100:00100000:1.0:1788986939.400430:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993656832:0@lo:400:kworker.0 00000100:00080000:3.0:1788986939.400703:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986939.400711:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986939.403874:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993656576:0@lo:400:kworker.0 00000100:00100000:0.0:1788986939.403904:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993656448:0@lo:400:kworker.0 00000100:00100000:0.0:1788986939.403918:0:3320:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967373 gen 2 00000004:00080000:0.0:1788986939.403925:0:3320:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a80d3b800, transno 4294967373 00000100:00100000:0.0:1788986939.403947:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993656960:0@lo:400:kworker.0 00010000:00010000:2.0:1788986939.456357:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986939.904503:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993657088:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986939.904605:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986939.904898:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993657088 00000100:00100000:2.0:1788986939.904909:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993657088 00000100:00100000:2.0:1788986939.904978:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1788986939.904989:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993657088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986939.905035:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986939.905145:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993657088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986939.905152:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:1.0:1788986939.905420:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993657088:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986940.480554:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986941.511224:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986941.555138:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986941.555208:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986941.555266:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986941.555294:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986941.555459:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971459712 00000100:00100000:0.0:1788986941.555474:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971459712 00000100:00100000:0.0:1788986941.555559:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971459584 00000100:00100000:0.0:1788986941.555563:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971459584 00000100:00100000:0.0:1788986941.555591:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1487 00000100:00100000:0.0:1788986941.555604:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971459712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986941.555711:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971459712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 110us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986941.555721:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1487 00000100:00100000:0.0:1788986941.555742:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1488 00000100:00100000:0.0:1788986941.555749:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971459584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986941.555776:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971459584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986941.555782:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1488 00000100:00100000:2.0:1788986941.556862:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971459456 00000100:00100000:2.0:1788986941.556874:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971459456 00000100:00100000:2.0:1788986941.556952:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1951 00000100:00100000:2.0:1788986941.556962:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971459456:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986941.557032:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971459456:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (1908us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986941.557039:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1951 00000100:00080000:3.0:1788986941.557772:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986941.557782:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986941.557787:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986941.557921:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971459328 00000100:00100000:1.0:1788986941.557930:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971459328 00000100:00100000:1.0:1788986941.557991:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1480 00000100:00100000:1.0:1788986941.558001:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971459328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986941.558055:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971459328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 56us (2788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986941.558062:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1480 00010000:00010000:2.0:1788986942.528838:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986943.488389:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986943.488411:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993657216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986943.488485:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986943.488664:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993657216 00000100:00100000:2.0:1788986943.488672:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993657216 00000100:00100000:2.0:1788986943.488742:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:2.0:1788986943.488752:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993657216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986943.488785:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986943.488839:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993657216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986943.488846:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00080000:3.0:1788986943.490523:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986943.490586:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993657216:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986943.553303:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986944.516250:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993657472:0@lo:400:kworker.0 00000100:00100000:0.0:1788986944.516319:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986944.516385:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993657984:0@lo:400:kworker.0 00000100:00100000:0.0:1788986944.517345:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986944.517479:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788986944.517489:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993657600:0@lo:400:kworker.0 00000100:00100000:0.0:1788986944.517517:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986944.517552:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993657472 00000100:00100000:0.0:1788986944.517559:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993657472 00000100:00100000:0.0:1788986944.517598:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993657600 00000100:00100000:0.0:1788986944.517602:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993657600 00000100:00100000:0.0:1788986944.517635:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1952 00000100:00100000:0.0:1788986944.517643:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993657472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986944.518128:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993657472:12345-0@lo:400:kworker.0 Request processed in 484us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986944.518136:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1952 00000100:00100000:0.0:1788986944.518155:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1953 00000100:00100000:0.0:1788986944.518162:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993657600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986944.518194:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993657600:12345-0@lo:400:kworker.0 Request processed in 33us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986944.518200:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1953 00000100:00100000:0.0:1788986944.518219:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993657984 00000100:00100000:0.0:1788986944.518223:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993657984 00000100:00100000:0.0:1788986944.518264:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1788986944.518270:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993657984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986944.518300:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993657984:12345-0@lo:400:kworker.0 Request processed in 30us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986944.518305:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1788986944.518338:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993657728:0@lo:400:kworker.0 00000100:00100000:0.0:1788986944.518377:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986944.519147:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993657344:0@lo:400:kworker.0 00000100:00100000:2.0:1788986944.519189:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986944.519244:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993657856:0@lo:400:kworker.0 00000100:00100000:2.0:1788986944.519268:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986944.519306:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993657344 00000100:00100000:2.0:1788986944.519311:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993657344 00000100:00100000:2.0:1788986944.519346:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1788986944.519364:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993657344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986944.519418:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993657344:12345-0@lo:400:kworker.0 Request processed in 65us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986944.519425:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1481 00000100:00100000:2.0:1788986944.519466:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993657344:0@lo:400:kworker.0 00000100:00080000:2.0:1788986944.519508:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986944.519513:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986944.519547:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993657600:0@lo:400:kworker.0 00000100:00100000:2.0:1788986944.519692:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993657472:0@lo:400:kworker.0 00000100:00100000:2.0:1788986944.519707:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993657984:0@lo:400:kworker.0 00000100:00100000:2.0:1788986944.519769:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993657728 00000100:00100000:2.0:1788986944.519778:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993657728 00000100:00100000:2.0:1788986944.519817:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1490 00000100:00100000:2.0:1788986944.519831:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993657728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986944.519881:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993657728:12345-0@lo:400:kworker.0 Request processed in 54us (1503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986944.519896:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1490 00000100:00100000:0.0:1788986944.520178:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993657728:0@lo:400:kworker.0 00000100:00100000:0.0:1788986944.520204:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993657856 00000100:00100000:0.0:1788986944.520208:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993657856 00000100:00100000:0.0:1788986944.520266:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1954 00000100:00100000:0.0:1788986944.520273:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993657856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986944.520311:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993657856:12345-0@lo:400:kworker.0 Request processed in 39us (1042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986944.520318:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1954 00000100:00080000:0.0:1788986944.520334:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986944.520365:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993657856:0@lo:400:kworker.0 00010000:00010000:0.0:1788986944.576882:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986945.026029:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993658112:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986945.026134:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986945.026879:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993658112 00000100:00100000:2.0:1788986945.026888:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993658112 00000100:00100000:2.0:1788986945.026943:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1788986945.026952:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993658112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788986945.026985:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986945.027051:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993658112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986945.027057:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:1.0:1788986945.027193:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80906680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993658112:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986945.600607:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986946.628800:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986946.674486:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986946.674581:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986946.674621:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986946.674655:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986946.674695:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971460224 00000100:00100000:1.0:1788986946.674711:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971460224 00000100:00100000:1.0:1788986946.674770:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971460096 00000100:00100000:1.0:1788986946.674773:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971460096 00000100:00100000:1.0:1788986946.674795:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1491 00000100:00100000:1.0:1788986946.674805:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971460224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986946.674869:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971460224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 66us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986946.674891:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1491 00000100:00100000:1.0:1788986946.674910:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1492 00000100:00100000:1.0:1788986946.674916:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971460096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986946.674941:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943706680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971460096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986946.674946:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1492 00000100:00080000:1.0:1788986946.674970:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788986946.674973:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986946.675110:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971459840 00000100:00100000:3.0:1788986946.675115:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971459840 00000100:00100000:3.0:1788986946.675152:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1482 00000100:00100000:3.0:1788986946.675159:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971459840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986946.675185:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971459840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 27us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986946.675191:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1482 00000100:00100000:0.0:1788986946.677024:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971459968 00000100:00100000:0.0:1788986946.677032:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971459968 00000100:00100000:1.0:1788986946.677302:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1955 00000100:00100000:1.0:1788986946.677313:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971459968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986946.677376:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2346:x1875885971459968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (2898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986946.677383:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1955 00000100:00080000:0.0:1788986946.679198:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788986947.648611:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986948.609724:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986948.609746:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993658240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986948.609809:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986948.610709:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993658240 00000100:00100000:0.0:1788986948.610719:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993658240 00000100:00100000:0.0:1788986948.610807:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1788986948.610819:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993658240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986948.610860:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986948.610936:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993658240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986948.610944:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:2.0:1788986948.611057:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993658240:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788986948.611746:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986948.675019:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986949.632504:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993658624:0@lo:400:kworker.0 00000100:00100000:0.0:1788986949.632518:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993658496:0@lo:400:kworker.0 00000100:00100000:2.0:1788986949.632598:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993658368:0@lo:400:kworker.0 00000100:00100000:1.0:1788986949.632685:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993658752:0@lo:400:kworker.0 00000100:00100000:0.0:1788986949.633129:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986949.633155:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993658496 00000100:00100000:3.0:1788986949.633164:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993658496 00000100:00100000:0.0:1788986949.633194:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993659008:0@lo:400:kworker.0 00000100:00100000:3.0:1788986949.633239:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1956 00000100:00100000:0.0:1788986949.633251:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986949.633253:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993658496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986949.633307:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993658496:12345-0@lo:400:kworker.0 Request processed in 60us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986949.633313:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1956 00000100:00100000:3.0:1788986949.633350:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986949.633389:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993658624 00000100:00100000:3.0:1788986949.633393:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993658624 00000100:00100000:3.0:1788986949.633431:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1957 00000100:00100000:3.0:1788986949.633438:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993658624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986949.633491:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993658624:12345-0@lo:400:kworker.0 Request processed in 54us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986949.633497:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1957 00000100:00080000:3.0:1788986949.633514:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986949.633545:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993658624:0@lo:400:kworker.0 00000100:00100000:0.0:1788986949.634049:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993658496:0@lo:400:kworker.0 00000100:00100000:0.0:1788986949.634133:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993659008 00000100:00100000:0.0:1788986949.634138:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993659008 00000100:00100000:0.0:1788986949.634175:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:0.0:1788986949.634182:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993659008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986949.634245:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993659008:12345-0@lo:400:kworker.0 Request processed in 63us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986949.634251:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00080000:0.0:1788986949.634269:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986949.634288:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993659008:0@lo:400:kworker.0 00000100:00100000:2.0:1788986949.634457:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986949.634502:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993658880:0@lo:400:kworker.0 00000100:00100000:2.0:1788986949.634529:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986949.634567:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993658880 00000100:00100000:2.0:1788986949.634571:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993658880 00000100:00100000:2.0:1788986949.634610:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1958 00000100:00100000:2.0:1788986949.634617:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993658880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986949.634658:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993658880:12345-0@lo:400:kworker.0 Request processed in 41us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986949.634664:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1958 00000100:00080000:2.0:1788986949.634679:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788986949.634702:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993658880:0@lo:400:kworker.0 00000100:00100000:0.0:1788986949.634943:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993658368 00000100:00100000:0.0:1788986949.634948:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993658368 00000100:00100000:0.0:1788986949.634984:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1483 00000100:00100000:0.0:1788986949.634992:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993658368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986949.635030:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993658368:12345-0@lo:400:kworker.0 Request processed in 39us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986949.635035:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1483 00000100:00100000:2.0:1788986949.635121:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993658368:0@lo:400:kworker.0 00000100:00100000:1.0:1788986949.635369:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986949.635456:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993658752 00000100:00100000:0.0:1788986949.635461:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993658752 00000100:00100000:0.0:1788986949.635494:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1494 00000100:00100000:0.0:1788986949.635502:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993658752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986949.635549:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993658752:12345-0@lo:400:kworker.0 Request processed in 48us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986949.635555:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1494 00000100:00100000:1.0:1788986949.635664:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993658752:0@lo:400:kworker.0 00000100:00100000:1.0:1788986949.686659:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986949.686796:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971460352 00000100:00100000:3.0:1788986949.686805:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971460352 00000100:00100000:3.0:1788986949.686874:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1213 00000100:00100000:3.0:1788986949.686882:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59771:x1875885971460352:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:3.0:1788986949.686977:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59771:x1875885971460352:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 95us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986949.686984:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1213 00000100:00080000:2.0:1788986949.687602:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986949.689665:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986949.693285:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971460480 00000100:00100000:2.0:1788986949.693304:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971460480 00000100:00100000:2.0:1788986949.693477:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 666 00000100:00100000:2.0:1788986949.693489:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59771:x1875885971460480:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986949.693883:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59771:x1875885971460480:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 395us (4229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986949.693890:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 666 00010000:00010000:2.0:1788986949.696521:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986949.699039:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986949.699154:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971460608 00000100:00100000:2.0:1788986949.699164:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971460608 00000100:00080000:0.0:1788986949.699249:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788986949.701814:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986949.704297:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 667 00000100:00100000:2.0:1788986949.704320:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59771:x1875885971460608:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:2.0:1788986949.705388:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59771:x1875885971460608:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 357us (5635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986949.705401:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 667 00000100:00100000:3.0:1788986949.712907:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986949.712999:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971460736 00000100:00100000:0.0:1788986949.713009:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971460736 00000100:00100000:0.0:1788986949.713075:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1214 00000100:00100000:0.0:1788986949.713085:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59771:x1875885971460736:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:1.0:1788986949.713673:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59771:x1875885971460736:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 588us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986949.713682:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1214 00000100:00100000:3.0:1788986949.717083:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986949.717303:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971460864 00000100:00100000:2.0:1788986949.717312:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971460864 00000100:00100000:2.0:1788986949.717367:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1215 00000100:00100000:2.0:1788986949.717377:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59771:x1875885971460864:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:2.0:1788986949.717466:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59771:x1875885971460864:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 90us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986949.717474:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1215 00000100:00100000:2.0:1788986949.721637:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986949.721868:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971460992 00000100:00100000:1.0:1788986949.721878:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971460992 00000100:00100000:1.0:1788986949.721934:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 668 00000100:00100000:1.0:1788986949.721944:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59771:x1875885971460992:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:1.0:1788986949.722401:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59771:x1875885971460992:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 455us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986949.722410:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 668 00000100:00100000:1.0:1788986949.727873:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986949.727975:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971461120 00000100:00100000:0.0:1788986949.727984:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971461120 00000100:00100000:0.0:1788986949.728040:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 669 00000100:00100000:0.0:1788986949.728050:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59771:x1875885971461120:12345-192.168.206.21@tcp:19:lfs.0 00000100:00100000:0.0:1788986949.728436:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59771:x1875885971461120:12345-192.168.206.21@tcp:19:lfs.0 Request processed in 386us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986949.728443:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 669 00000100:00100000:3.0:1788986949.732650:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986949.732800:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971461248 00000100:00100000:0.0:1788986949.732811:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971461248 00000100:00100000:0.0:1788986949.732875:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1216 00000100:00100000:0.0:1788986949.732887:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59771:x1875885971461248:12345-192.168.206.21@tcp:48:lfs.0 00000100:00100000:0.0:1788986949.733362:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59771:x1875885971461248:12345-192.168.206.21@tcp:48:lfs.0 Request processed in 476us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986949.733370:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1216 00000100:00100000:2.0:1788986950.146331:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986950.146356:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993659136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986950.146435:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986950.146549:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993659136 00000100:00100000:1.0:1788986950.146559:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993659136 00000100:00100000:1.0:1788986950.146624:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1788986950.146634:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993659136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986950.146681:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45809664 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986950.146746:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993659136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986950.146752:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1788986950.146838:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993659136:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986950.724933:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986951.083484:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986951.085044:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971461376 00000100:00100000:0.0:1788986951.085058:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971461376 00000100:00100000:1.0:1788986951.085261:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1217 00000100:00100000:1.0:1788986951.085275:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59785:x1875885971461376:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986951.085294:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986951.085314:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a62a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d173c expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.085381:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.085395:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.085406:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986951.085442:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:1.0:1788986951.085446:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986951.085463:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.085487:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a62a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d173c expref: 9 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.085579:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d173c expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.085588:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:1.0:1788986951.085590:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986951.085594:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986951.085653:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59785:x1875885971461376:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 382us (2177us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986951.085734:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1217 00000100:00080000:0.0:1788986951.086447:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986951.090866:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986951.090935:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971461632 00000100:00100000:3.0:1788986951.090950:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971461632 00000100:00100000:3.0:1788986951.091019:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1218 00000100:00100000:3.0:1788986951.091031:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59785:x1875885971461632:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986951.091139:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986951.091169:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d173c expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.091207:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a5cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1727 expref: 7 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.091226:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a45acab00) 00010000:00010000:3.0:1788986951.091239:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986951.091270:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a638 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.091284:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.091295:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788986951.130469:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967757 is committed 00000004:00010000:2.0:1788986951.130598:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000000975703a reply state 000000009165e018 transno 4294967757 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986951.130613:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788986951.130630:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00010000:00080000:2.0:1788986951.130727:0:5856:0:(ldlm_lib.c:3491:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788986951.130745:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59785:x1875885971461632:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 39713us (39885us total) trans 4294967757 rc 0/0 00000100:00100000:2.0:1788986951.130754:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1218 00010000:00010000:2.0:1788986951.130793:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a638 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.130802:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a638 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.130809:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.130815:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986951.130819:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a638 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.130826:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a638 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.130842:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745100) 00010000:00010000:2.0:1788986951.130845:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986951.130849:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a638 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.130856:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3000/0xc20d828fcf54a638 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986951.221009:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986951.221644:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971461760 00000100:00100000:2.0:1788986951.221654:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971461760 00000100:00100000:3.0:1788986951.221785:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1219 00000100:00100000:3.0:1788986951.221795:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59789:x1875885971461760:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:3.0:1788986951.221818:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986951.221848:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a63f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1743 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.221907:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a646 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.221921:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a646 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.221931:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a646 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.221945:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a64d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.221956:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.221963:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222588:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a654 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222599:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222607:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986951.222630:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:3.0:1788986951.222633:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986951.222651:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a654 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222663:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a646 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222670:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a646 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222677:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a646 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222683:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986951.222687:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a646 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222695:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a646 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222705:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:3.0:1788986951.222707:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986951.222712:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a646 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222719:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a646 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222731:0:15241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a64d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222737:0:15241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a64d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222742:0:15241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a64d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222747:0:15241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986951.222750:0:15241:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a64d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222755:0:15241:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a64d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222763:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a55745300) 00010000:00010000:3.0:1788986951.222765:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986951.222768:0:15241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a64d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222778:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a64d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222804:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a63f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1743 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222819:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a654 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1743 expref: 7 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.222826:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:3.0:1788986951.222828:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788986951.222830:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986951.223008:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59789:x1875885971461760:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 1214us (2006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986951.223025:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1219 00000100:00100000:0.0:1788986951.226905:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986951.227065:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971462016 00000100:00100000:1.0:1788986951.227074:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971462016 00000100:00100000:1.0:1788986951.227165:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1220 00000100:00100000:1.0:1788986951.227174:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59789:x1875885971462016:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:1.0:1788986951.227202:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986951.227223:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a65b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d174a expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.227794:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a662 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.227811:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.227822:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.227914:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a669 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.227923:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.227930:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788986951.232051:0:5854:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x27:0x0], index 0: 0 00010000:00010000:1.0:1788986951.236014:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a670 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.236042:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.236056:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a670 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.236831:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a662 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.237462:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a662 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.237472:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.237479:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986951.237483:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a662 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.237491:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a662 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.237505:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:1.0:1788986951.237508:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986951.237512:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a662 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.237518:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a662 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986951.237813:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007c92466a reply state 0000000033f4f177 transno 4294967758 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986951.237822:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986951.240289:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a65b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d174a expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.240325:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a670 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d174a expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.240342:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9b0a45316f00) 00010000:00010000:1.0:1788986951.240348:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986951.240352:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788986951.240451:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59789:x1875885971462016:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 13276us (13556us total) trans 4294967758 rc 0/0 00000100:00100000:1.0:1788986951.240459:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1220 00010000:00010000:1.0:1788986951.245461:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a669 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.245482:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a669 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.245491:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a669 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.245498:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986951.245503:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a669 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.245511:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a669 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.245539:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a45316900) 00010000:00010000:1.0:1788986951.245543:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986951.245548:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a669 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.245555:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a669 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986951.251322:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986951.252232:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971462272 00000100:00100000:2.0:1788986951.252245:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971462272 00000100:00100000:2.0:1788986951.252318:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1221 00000100:00100000:2.0:1788986951.252328:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59789:x1875885971462272:12345-192.168.206.21@tcp:36:touch.60003 00010000:00010000:2.0:1788986951.252401:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986951.252433:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a670 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d174a expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.252454:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9b0a45316f00) 00010000:00010000:2.0:1788986951.252465:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986951.252507:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a67e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.252521:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a67e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.252812:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a67e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986951.253022:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b2e9f1f9 reply state 00000000e054b026 transno 4294967759 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a67e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986951.253033:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986951.253161:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59789:x1875885971462272:12345-192.168.206.21@tcp:36:touch.60003 Request processed in 834us (1851us total) trans 4294967759 rc 0/0 00000100:00100000:2.0:1788986951.253168:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1221 00010000:00010000:2.0:1788986951.255644:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a67e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.255672:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a67e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.255680:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a67e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.255686:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986951.255692:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a67e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.255700:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a67e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.255715:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986951.255719:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986951.255725:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a67e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.255731:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a67e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986951.257177:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986951.257295:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971462400 00000100:00100000:1.0:1788986951.257306:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971462400 00000100:00100000:1.0:1788986951.257370:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1222 00000100:00100000:1.0:1788986951.257382:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59789:x1875885971462400:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:1.0:1788986951.257408:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986951.257436:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a685 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1751 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.257501:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x64:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1751 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.257518:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a685 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x64:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1751 expref: 10 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.257686:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:1.0:1788986951.257700:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788986951.257703:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986951.257762:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59789:x1875885971462400:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 383us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986951.257770:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1222 00000100:00100000:0.0:1788986951.267588:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986951.276705:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971462528 00000100:00100000:2.0:1788986951.276721:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971462528 00000100:00100000:3.0:1788986951.276994:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 670 00000100:00100000:3.0:1788986951.277009:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971462528:12345-192.168.206.21@tcp:2:touch.60003 00000100:00100000:3.0:1788986951.277437:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971462528:12345-192.168.206.21@tcp:2:touch.60003 Request processed in 430us (9917us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788986951.277454:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 670 00000100:00080000:0.0:1788986951.277644:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986951.282676:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986951.282854:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971462784 00000100:00100000:0.0:1788986951.282865:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971462784 00000100:00100000:0.0:1788986951.282921:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:0.0:1788986951.282931:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59789:x1875885971462784:12345-192.168.206.21@tcp:35:touch.60003 00000100:00100000:0.0:1788986951.283759:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59789:x1875885971462784:12345-192.168.206.21@tcp:35:touch.60003 Request processed in 826us (1089us total) trans 4294967760 rc 0/0 00000100:00100000:0.0:1788986951.283769:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 120 00000100:00100000:1.0:1788986951.343080:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986951.344589:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971462912 00000100:00100000:2.0:1788986951.344605:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971462912 00000100:00100000:2.0:1788986951.344682:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1223 00000100:00100000:2.0:1788986951.344693:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59793:x1875885971462912:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:2.0:1788986951.344716:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986951.344736:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a68c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1758 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.344801:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a693 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.344815:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a693 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.344826:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a693 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.344847:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a69a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.344854:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a69a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.344864:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a69a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.344949:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a6a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.344957:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.344964:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788986951.344995:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x64:0x0]: returning size 0 00000004:00200000:2.0:1788986951.344999:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788986951.345016:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345027:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a6a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345034:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a693 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345041:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a693 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345047:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a693 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345053:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986951.345057:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a693 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345065:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a693 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345076:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:2.0:1788986951.345079:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986951.345083:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a693 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345122:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a693 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345135:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a69a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345141:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a69a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345147:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a69a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345152:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986951.345155:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a69a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345160:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a69a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345167:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a45acae00) 00010000:00010000:2.0:1788986951.345169:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986951.345172:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a69a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345182:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a69a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345221:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a68c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1758 expref: 13 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345250:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a6a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1758 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.345257:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:2.0:1788986951.345259:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788986951.345262:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1400, rc 0) 00000100:00100000:2.0:1788986951.345329:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59793:x1875885971462912:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 637us (2255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986951.345336:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1223 00000100:00100000:2.0:1788986951.354047:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986951.354170:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971463040 00000100:00100000:0.0:1788986951.354180:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971463040 00000100:00100000:0.0:1788986951.354262:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 671 00000100:00100000:0.0:1788986951.354273:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971463040:12345-192.168.206.21@tcp:101:rm.60003 00010000:00010000:0.0:1788986951.354295:0:86533:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986951.354319:0:86533:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005b71c7a4/0xc20d828fcf54a6a8 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d175f expref: -99 pid: 86533 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986951.354617:0:86533:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x27:0x0] initial LVB size: 0, mtime: 0x6aa1c646, atime: 0x6aa1c646, ctime: 0x6aa1c646, blocks: 0x1 00010000:00010000:0.0:1788986951.354644:0:86533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=2735s v=(0 0) 00010000:00010000:0.0:1788986951.354649:0:86533:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986951.354725:0:86533:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005b71c7a4/0xc20d828fcf54a6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d175f expref: 7 pid: 86533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986951.354750:0:86533:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005b71c7a4/0xc20d828fcf54a6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d175f expref: 7 pid: 86533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986951.354763:0:86533:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986951.354886:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971463040:12345-192.168.206.21@tcp:101:rm.60003 Request processed in 615us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986951.354893:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 671 00000100:00100000:1.0:1788986951.377301:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986951.377473:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971463296 00000100:00100000:2.0:1788986951.377486:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971463296 00000100:00100000:2.0:1788986951.377557:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1224 00000100:00100000:2.0:1788986951.377568:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59793:x1875885971463296:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:2.0:1788986951.377626:0:5856:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788986951.377671:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1400/0xc20d828fcf54a6a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x64:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1758 expref: 12 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.377698:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a685 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x64:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1751 expref: 11 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.377717:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9b0a45316900) 00010000:00010000:2.0:1788986951.377727:0:5856:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788986951.377750:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a6af lrc: 3/0,1 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.377764:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a6af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.377774:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a6af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.377788:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a6b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.377796:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a6b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.377803:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a6b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.377911:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a6bd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.377919:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a6bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.377927:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a6bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788986951.378531:0:5856:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].39, 64 off10688 00000004:00080000:2.0:1788986951.378542:0:5856:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2735281452348ns, next at 2736281449801ns, rc = 0 00010000:00010000:2.0:1788986951.378602:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a6c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378613:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a6c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378622:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a6c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378631:0:5856:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a6c4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378638:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a6c4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378644:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a6c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378676:0:5856:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788986951.378699:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a6bd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378706:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a6bd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378713:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a6bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378719:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986951.378723:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a6bd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378731:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a6bd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378741:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:2.0:1788986951.378744:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788986951.378748:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a6bd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378754:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0400/0xc20d828fcf54a6bd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x64:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378772:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a6af lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378778:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a6af lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378785:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a6af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378790:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986951.378793:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a6af lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378799:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a6af lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378805:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:2.0:1788986951.378808:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986951.378810:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a6af lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.378816:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0e00/0xc20d828fcf54a6af lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788986951.378828:0:5856:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 0000000004925f48 reply state 00000000b9852c37 transno 4294967761 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a6b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986951.378837:0:5856:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788986951.378922:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59793:x1875885971463296:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 1353us (1631us total) trans 4294967761 rc 0/0 00000100:00100000:2.0:1788986951.378930:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1224 00010000:00010000:3.0:1788986951.379285:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986951.379292:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a6c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.379299:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986951.379303:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a6c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.379310:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a6c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.379319:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x64:0x0].0x0 (ffff9b0a45aca000) 00010000:00010000:3.0:1788986951.379322:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788986951.379326:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a6c4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.379332:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54a6c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x64:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986951.379346:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986951.379348:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986951.379350:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986951.384484:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a6b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.384502:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a6b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.384510:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a6b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.384516:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986951.384530:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a6b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.384538:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a6b6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.384554:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a45acae00) 00010000:00010000:1.0:1788986951.384557:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986951.384562:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a6b6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986951.384568:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54a6b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986951.744481:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986951.800743:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986951.800838:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986951.800875:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986951.800935:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986951.800974:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971463808 00000100:00100000:2.0:1788986951.800985:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971463808 00000100:00100000:2.0:1788986951.801035:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971463680 00000100:00100000:2.0:1788986951.801038:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971463680 00000100:00100000:2.0:1788986951.801077:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1495 00000100:00100000:2.0:1788986951.801110:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971463808:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986951.801198:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971463808:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 101us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986951.801206:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1495 00000100:00100000:2.0:1788986951.801228:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1496 00000100:00100000:2.0:1788986951.801236:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971463680:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986951.801264:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2347:x1875885971463680:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986951.801271:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1496 00000100:00080000:2.0:1788986951.801291:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986951.802782:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971463424 00000100:00100000:3.0:1788986951.802795:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971463424 00000100:00100000:3.0:1788986951.802852:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1484 00000100:00100000:3.0:1788986951.802861:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971463424:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986951.802913:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971463424:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 53us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986951.802920:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1484 00000100:00100000:0.0:1788986951.803995:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971463552 00000100:00100000:0.0:1788986951.804003:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971463552 00000100:00100000:0.0:1788986951.804049:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1959 00000100:00100000:0.0:1788986951.804195:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:2347:x1875885971463552:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986951.804830:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:2347:x1875885971463552:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 769us (4094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986951.804839:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1959 00000001:00080000:3.0:1788986952.226892:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967374 is committed 00000100:00100000:0.0:1788986952.421788:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986952.421862:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971463936 00000100:00100000:1.0:1788986952.421871:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971463936 00000100:00100000:1.0:1788986952.421927:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1225 00000100:00100000:1.0:1788986952.421937:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59808:x1875885971463936:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986952.421957:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986952.421976:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a6cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1766 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.422035:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a6d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.422052:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.422064:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986952.422264:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:1.0:1788986952.422269:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986952.422290:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a6d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.422317:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a6cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1766 expref: 13 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.422338:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a6d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1766 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.422346:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:1.0:1788986952.422349:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986952.422354:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788986952.422413:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59808:x1875885971463936:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 476us (630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986952.422421:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1225 00000100:00100000:2.0:1788986952.426003:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986952.426071:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971464192 00000100:00100000:3.0:1788986952.426080:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971464192 00000100:00100000:3.0:1788986952.426176:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1226 00000100:00100000:3.0:1788986952.426196:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59808:x1875885971464192:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986952.426239:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986952.426261:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030600/0xc20d828fcf54a6d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1766 expref: 12 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986952.426279:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a654 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1743 expref: 11 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986952.426289:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:3.0:1788986952.426299:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986952.426321:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a6d9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986952.426333:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986952.426342:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788986952.517893:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967760 is committed 00000004:00010000:3.0:1788986952.518387:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000fc20c9dc reply state 000000000ab80246 transno 4294967762 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986952.518405:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986952.518427:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000100:00100000:3.0:1788986952.518555:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+12:59808:x1875885971464192:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 92362us (92552us total) trans 4294967762 rc 0/0 00000100:00100000:3.0:1788986952.518563:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1226 00000001:00080000:0.0:1788986952.518689:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967761 is committed 00000004:00080000:0.0:1788986952.518694:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 105 committed 00000001:00080000:0.0:1788986952.518731:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967762 is committed 00010000:00010000:0.0:1788986952.518755:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a6d9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.518764:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a6d9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.518773:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a6d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.518780:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986952.518785:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a6d9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.518794:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a6d9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.518814:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745f00) 00010000:00010000:0.0:1788986952.518818:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788986952.518824:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a6d9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.518830:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3200/0xc20d828fcf54a6d9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986952.521896:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993659264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788986952.521957:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986952.522019:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993659264 00000100:00100000:2.0:1788986952.522027:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993659264 00000100:00100000:2.0:1788986952.522124:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 672 00000100:00100000:2.0:1788986952.522135:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993659264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788986952.522161:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:39 count 1 00010000:00010000:2.0:1788986952.522195:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986952.522215:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b71c7a4/0xc20d828fcf54a6a8 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d175f expref: 5 pid: 86533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986952.522223:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788986952.522227:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986952.522231:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986952.522258:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b71c7a4/0xc20d828fcf54a6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d175f expref: 5 pid: 86533 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986952.522271:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b71c7a4/0xc20d828fcf54a6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d175f expref: 5 pid: 86533 timeout: 2836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986952.522281:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993659392:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986952.522332:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b6d80 going to sleep for 11 seconds 00000100:00080000:3.0:1788986952.522433:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986952.530292:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986952.530329:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971464320 00000100:00100000:2.0:1788986952.530339:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971464320 00010000:00010000:2.0:1788986952.530382:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b71c7a4/0xc20d828fcf54a6a8 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d175f expref: 6 pid: 86533 timeout: 2836 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986952.530409:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6698:1875885993659392:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986952.530425:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 469 00000100:00100000:2.0:1788986952.530436:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2349:x1875885971464320:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788986952.530437:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986952.530451:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986952.530458:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b71c7a4/0xc20d828fcf54a6a8 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d175f expref: 6 pid: 86533 timeout: 2836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986952.530471:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b71c7a4/0xc20d828fcf54a6a8 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d175f expref: 6 pid: 86533 timeout: 2836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986952.530494:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b71c7a4/0xc20d828fcf54a6a8 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d175f expref: 6 pid: 86533 timeout: 2836 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986952.530507:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986952.530511:0:5840:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788986952.530515:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986952.530524:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986952.530553:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788986952.530580:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.530591:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.530602:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.530610:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.530628:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788986952.531317:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993659264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 9181us (9357us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788986952.531328:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 672 00010000:00010000:1.0:1788986952.531361:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788986952.531368:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.531378:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788986952.531383:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.531395:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.531412:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.531420:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000270b3612/0xc20d828fcf54a6e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986952.531440:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986952.531443:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986952.531445:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788986952.531484:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a80d38e00/2, rc 0, transno 4294967375 00000100:00100000:1.0:1788986952.531490:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993659264:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788986952.531744:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971464320:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 1308us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986952.531754:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 469 00000100:00100000:2.0:1788986952.576353:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986952.577307:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971464448 00000100:00100000:0.0:1788986952.577320:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971464448 00000100:00100000:0.0:1788986952.577387:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1227 00000100:00100000:0.0:1788986952.577398:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59812:x1875885971464448:12345-192.168.206.21@tcp:101:touch.60003 00010000:00010000:0.0:1788986952.577420:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986952.577440:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54a6e7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d176d expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577499:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a6ee lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577513:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a6ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577525:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a6ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577540:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a6f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577546:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577553:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577846:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a6fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577855:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a6fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577862:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a6fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986952.577885:0:5855:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:0.0:1788986952.577889:0:5855:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986952.577908:0:5855:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a6fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577924:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a6ee lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577929:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a6ee lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577936:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a6ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577943:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986952.577946:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a6ee lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577953:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a6ee lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577964:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:0.0:1788986952.577967:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986952.577972:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a6ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577978:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a6ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577989:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a6f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.577995:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a6f5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.578000:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.578005:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eee00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986952.578007:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a6f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.578013:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a6f5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.578019:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a4823b200) 00010000:00010000:0.0:1788986952.578022:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986952.578025:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a6f5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.578030:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a6f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.578058:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eec00/0xc20d828fcf54a6e7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d176d expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.578071:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a6fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d176d expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986952.578078:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:0.0:1788986952.578081:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986952.578082:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef000, rc 0) 00000100:00100000:1.0:1788986952.578288:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59812:x1875885971464448:12345-192.168.206.21@tcp:101:touch.60003 Request processed in 889us (1943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986952.578297:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1227 00010000:00010000:2.0:1788986952.768948:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986953.631127:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986953.631173:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971464576 00000100:00100000:1.0:1788986953.631194:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971464576 00000100:00100000:1.0:1788986953.631368:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1228 00000100:00100000:1.0:1788986953.631384:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59826:x1875885971464576:12345-192.168.206.21@tcp:101:chmod.0 00010000:00010000:1.0:1788986953.631403:0:15241:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986953.631423:0:15241:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a703 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1774 expref: -99 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788986953.631492:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788986953.631851:0:15241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a70a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986953.631866:0:15241:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a70a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986953.631878:0:15241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a70a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788986953.631910:0:15241:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:1.0:1788986953.631913:0:15241:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788986953.631932:0:15241:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a70a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15241 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986953.631957:0:15241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a703 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1774 expref: 9 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986953.631975:0:15241:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a70a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1774 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986953.631983:0:15241:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:1.0:1788986953.631986:0:15241:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788986953.631990:0:15241:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030e00, rc 0) 00000100:00100000:1.0:1788986953.632051:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59826:x1875885971464576:12345-192.168.206.21@tcp:101:chmod.0 Request processed in 674us (933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986953.632058:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1228 00000100:00100000:0.0:1788986953.643889:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986953.643959:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971464832 00000100:00100000:3.0:1788986953.643968:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971464832 00000100:00100000:3.0:1788986953.644023:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1229 00000100:00100000:3.0:1788986953.644034:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59826:x1875885971464832:12345-192.168.206.21@tcp:36:chmod.0 00010000:00010000:3.0:1788986953.644080:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788986953.644122:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030e00/0xc20d828fcf54a70a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1774 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986953.644142:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef000/0xc20d828fcf54a6fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d176d expref: 7 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986953.644151:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a4823b900) 00010000:00010000:3.0:1788986953.644162:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986953.644196:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a711 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986953.644209:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986953.644219:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986953.645280:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000006630655c reply state 00000000a2586acf transno 4294967763 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986953.645293:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788986953.645302:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000100:00100000:3.0:1788986953.651394:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59826:x1875885971464832:12345-192.168.206.21@tcp:36:chmod.0 Request processed in 7351us (7500us total) trans 4294967763 rc 0/0 00000100:00100000:3.0:1788986953.651405:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1229 00010000:00010000:2.0:1788986953.657550:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a711 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986953.657566:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a711 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986953.657573:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986953.657580:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2000 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986953.657584:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a711 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986953.657592:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a711 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986953.657607:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745300) 00010000:00010000:2.0:1788986953.657610:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788986953.657614:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a711 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986953.657621:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2000/0xc20d828fcf54a711 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986953.729394:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993659520:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986953.729470:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986953.729520:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993659520 00000100:00100000:3.0:1788986953.729528:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993659520 00000100:00100000:3.0:1788986953.729585:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:3.0:1788986953.729595:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993659520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986953.729628:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986953.729684:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993659520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986953.729691:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1788986953.729795:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993659520:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986953.797442:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986953.837243:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986953.839796:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971464960 00000100:00100000:1.0:1788986953.839813:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971464960 00000100:00100000:1.0:1788986953.839889:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1230 00000100:00100000:1.0:1788986953.839902:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59838:x1875885971464960:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986953.840021:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59838:x1875885971464960:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 123us (2789us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986953.840029:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1230 00000100:00100000:3.0:1788986953.842941:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986953.843023:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971465088 00000100:00100000:0.0:1788986953.843032:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971465088 00000100:00100000:1.0:1788986953.843194:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 673 00000100:00100000:1.0:1788986953.843208:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59838:x1875885971465088:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00080000:3.0:1788986953.843553:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986953.843674:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59838:x1875885971465088:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 468us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986953.843683:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 673 00000100:00100000:3.0:1788986953.850316:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986953.850846:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971465216 00000100:00100000:1.0:1788986953.850856:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971465216 00000100:00100000:1.0:1788986953.850936:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 674 00000100:00080000:3.0:1788986953.851119:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986953.851167:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59838:x1875885971465216:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986953.851618:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941836a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59838:x1875885971465216:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 671us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986953.851627:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 674 00000100:00100000:2.0:1788986953.862958:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986953.863022:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971465344 00000100:00100000:1.0:1788986953.863032:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971465344 00000100:00100000:1.0:1788986953.863118:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1231 00000100:00100000:1.0:1788986953.863129:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59838:x1875885971465344:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:1.0:1788986953.863563:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59838:x1875885971465344:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 434us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986953.863571:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1231 00000100:00100000:3.0:1788986953.870343:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986953.870499:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971465472 00000100:00100000:0.0:1788986953.870510:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971465472 00000100:00100000:0.0:1788986953.870590:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1232 00000100:00100000:0.0:1788986953.870603:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59838:x1875885971465472:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986953.870739:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59838:x1875885971465472:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 138us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986953.870748:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1232 00000100:00100000:3.0:1788986953.873562:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986953.873662:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971465600 00000100:00100000:1.0:1788986953.873676:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971465600 00000100:00100000:1.0:1788986953.873741:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 675 00000100:00100000:1.0:1788986953.873752:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59838:x1875885971465600:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986953.874159:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59838:x1875885971465600:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 406us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986953.874167:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 675 00000100:00100000:2.0:1788986953.877489:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986953.877727:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971465728 00000100:00100000:1.0:1788986953.877738:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971465728 00000100:00100000:1.0:1788986953.877802:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 676 00000100:00100000:1.0:1788986953.877812:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59838:x1875885971465728:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986953.880459:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59838:x1875885971465728:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 2636us (2968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986953.880471:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 676 00000100:00100000:3.0:1788986953.889201:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986953.889277:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971465856 00000100:00100000:0.0:1788986953.889287:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971465856 00000100:00100000:0.0:1788986953.889348:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1233 00000100:00100000:0.0:1788986953.889359:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59838:x1875885971465856:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986953.889810:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59838:x1875885971465856:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 451us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986953.889818:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1233 00000100:00100000:2.0:1788986954.039855:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986954.039949:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971465984 00000100:00100000:0.0:1788986954.039959:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971465984 00000100:00100000:0.0:1788986954.040028:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1234 00000100:00100000:0.0:1788986954.040040:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+7:59842:x1875885971465984:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:0.0:1788986954.040062:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986954.040083:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a718 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d177b expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040185:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a71f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040201:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a71f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040213:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a71f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040228:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a726 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040234:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040241:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040790:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a72d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040802:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040810:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986954.040833:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:0.0:1788986954.040837:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788986954.040855:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a72d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040867:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a71f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040873:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a71f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040880:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a71f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040885:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986954.040889:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a71f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040896:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a71f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040906:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:0.0:1788986954.040909:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986954.040914:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a71f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040920:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ee400/0xc20d828fcf54a71f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040932:0:5856:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a726 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040937:0:5856:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a726 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040948:0:5856:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040953:0:5856:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:0.0:1788986954.040956:0:5856:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a726 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040962:0:5856:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a726 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040968:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a4823b200) 00010000:00010000:0.0:1788986954.040970:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788986954.040973:0:5856:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a726 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.040978:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efc00/0xc20d828fcf54a726 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.041011:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508eee00/0xc20d828fcf54a718 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d177b expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.041025:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a72d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d177b expref: 8 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.041032:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:0.0:1788986954.041034:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788986954.041036:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788986954.041418:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59842:x1875885971465984:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 1377us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986954.041430:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1234 00000100:00100000:2.0:1788986954.063021:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986954.063462:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971466240 00000100:00100000:1.0:1788986954.063473:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971466240 00000100:00100000:1.0:1788986954.063537:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1235 00000100:00100000:1.0:1788986954.063548:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59842:x1875885971466240:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:1.0:1788986954.063573:0:5855:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788986954.063599:0:5855:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a734 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1782 expref: -99 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.063971:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a73b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.063985:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a73b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.063996:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a73b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.064009:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a742 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.064015:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.064022:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788986954.067547:0:5855:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x27:0x0], index 1: 0 00010000:00010000:1.0:1788986954.070293:0:5855:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a749 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.070325:0:5855:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.070339:0:5855:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a749 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.070380:0:5855:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a73b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.070388:0:5855:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a73b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.070395:0:5855:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a73b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.070402:0:5855:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986954.070406:0:5855:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a73b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.070414:0:5855:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a73b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.070425:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:1.0:1788986954.070428:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986954.070434:0:5855:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a73b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.070440:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031c00/0xc20d828fcf54a73b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788986954.070458:0:5855:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000b8b6d57a reply state 000000005f66d18f transno 4294967764 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986954.070468:0:5855:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788986954.070510:0:5855:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030000/0xc20d828fcf54a734 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1782 expref: 11 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.070529:0:5855:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a749 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1782 expref: 10 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.070537:0:5855:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff9b0a45316d00) 00010000:00010000:1.0:1788986954.070539:0:5855:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788986954.070541:0:5855:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030200, rc 0) 00000100:00100000:1.0:1788986954.071922:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+11:59842:x1875885971466240:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 8366us (8899us total) trans 4294967764 rc 0/0 00000100:00100000:1.0:1788986954.071935:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1235 00010000:00010000:1.0:1788986954.084983:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a742 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.085001:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a742 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.085008:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a742 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.085015:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:1.0:1788986954.085019:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a742 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.085027:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a742 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.085047:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a45316e00) 00010000:00010000:1.0:1788986954.085050:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788986954.085054:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a742 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986954.085061:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031600/0xc20d828fcf54a742 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5855 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986954.093874:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986954.094269:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971466368 00000100:00100000:0.0:1788986954.094278:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971466368 00000100:00100000:0.0:1788986954.094334:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 677 00000100:00100000:0.0:1788986954.094345:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:59842:x1875885971466368:12345-192.168.206.21@tcp:101:dd.60003 00010000:00010000:0.0:1788986954.094361:0:6695:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986954.094380:0:6695:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf54a757 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1789 expref: -99 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788986954.094404:0:6695:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788986954.094425:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=2737s v=(0 0) 00010000:00010000:0.0:1788986954.094430:0:6695:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788986954.094440:0:6695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf54a757 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1789 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.094458:0:6695:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf54a757 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1789 expref: 6 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986954.094470:0:6695:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eee00, rc 0) 00000100:00100000:0.0:1788986954.094528:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+6:59842:x1875885971466368:12345-192.168.206.21@tcp:101:dd.60003 Request processed in 185us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986954.094535:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 677 00000100:00100000:2.0:1788986954.125085:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986954.125208:0:6702:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971466496 00000100:00100000:0.0:1788986954.125218:0:6702:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971466496 00002000:00100000:0.0:1788986954.125262:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x27:0x0] (0->1048575) req@ffff9b0a80907100 x1875885971466496/t0(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:120/0 lens 488/0 e 0 to 0 dl 1788986965 ref 1 fl New:/600/ffffffff rc 0/-1 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1788986954.125282:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a80907100 with x1875885971466496 ext(0->1048575) 00002000:00010000:0.0:1788986954.125287:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a80907100 00000100:00100000:0.0:1788986954.125314:0:6702:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 31 00000100:00100000:0.0:1788986954.125322:0:6702:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2347:x1875885971466496:12345-192.168.206.21@tcp:4:dd.60003 00000100:00100000:0.0:1788986954.148442:0:6702:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80907100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2347:x1875885971466496:12345-192.168.206.21@tcp:4:dd.60003 Request processed in 23111us (23356us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788986954.148456:0:6702:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 31 00002000:00100000:0.0:1788986954.148468:0:6702:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x27:0x0] (0->1048575) req@ffff9b0a80907100 x1875885971466496/t4294967374(0) o4->d307e018-a913-49dd-8d34-07b37c8ccf58@192.168.206.21@tcp:120/0 lens 488/448 e 0 to 0 dl 1788986965 ref 1 fl Complete:/600/0 rc 0/0 job:'dd.60003' uid:60003 gid:60003 projid:0 00002000:00100000:0.0:1788986954.148478:0:6702:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9b0a80907100 with x1875885971466496 ext(0->1048575) 00002000:00010000:0.0:1788986954.148485:0:6702:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9b0a80907100 00000100:00100000:2.0:1788986954.157735:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986954.157855:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971466624 00000100:00100000:1.0:1788986954.157864:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971466624 00000100:00100000:1.0:1788986954.157908:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1236 00000100:00100000:1.0:1788986954.157918:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+10:59842:x1875885971466624:12345-192.168.206.21@tcp:44:dd.60003 00000001:00080000:0.0:1788986954.216121:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967764 is committed 00000100:00100000:3.0:1788986954.216341:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59842:x1875885971466624:12345-192.168.206.21@tcp:44:dd.60003 Request processed in 58419us (58609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986954.216353:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1236 00000100:00100000:2.0:1788986954.219900:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986954.219997:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971466752 00000100:00100000:0.0:1788986954.220006:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971466752 00000100:00100000:0.0:1788986954.220402:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 678 00000100:00100000:0.0:1788986954.220415:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2348:x1875885971466752:12345-192.168.206.21@tcp:16:dd.60003 00000001:00080000:2.0:1788986954.287994:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967374 is committed 00000100:00100000:0.0:1788986954.288210:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2348:x1875885971466752:12345-192.168.206.21@tcp:16:dd.60003 Request processed in 67792us (68311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986954.288222:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 678 00000100:00100000:0.0:1788986954.293282:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986954.293364:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971467008 00000100:00100000:1.0:1788986954.293374:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971467008 00000100:00100000:1.0:1788986954.293429:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:1.0:1788986954.293439:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a51a6f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:59842:x1875885971467008:12345-192.168.206.21@tcp:35:dd.60003 00000100:00100000:1.0:1788986954.293956:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a51a6f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:59842:x1875885971467008:12345-192.168.206.21@tcp:35:dd.60003 Request processed in 517us (681us total) trans 4294967765 rc 0/0 00000100:00100000:1.0:1788986954.293965:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 121 00000100:00100000:3.0:1788986954.752345:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993660032:0@lo:400:kworker.0 00000100:00100000:3.0:1788986954.752418:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986954.752475:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986954.752481:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993659904:0@lo:400:kworker.0 00000100:00100000:3.0:1788986954.752503:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986954.752531:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993659904 00000100:00100000:3.0:1788986954.752538:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993659904 00000100:00100000:3.0:1788986954.752586:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1960 00000100:00100000:3.0:1788986954.752594:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993659904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986954.752651:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993659904:12345-0@lo:400:kworker.0 Request processed in 46us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986954.752658:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1960 00000100:00080000:3.0:1788986954.752678:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986954.752706:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993659904:0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.752804:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993659776:0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.752831:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986954.752856:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993660288:0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.752875:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986954.752893:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788986954.752899:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993659648:0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.752926:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986954.752948:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993660160:0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.752970:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986954.752994:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993660032 00000100:00100000:0.0:1788986954.752997:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993660032 00000100:00100000:0.0:1788986954.753030:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993660288 00000100:00100000:0.0:1788986954.753033:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993660288 00000100:00100000:0.0:1788986954.753054:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1497 00000100:00100000:0.0:1788986954.753060:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993660032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.753121:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3319:x1875885993660032:12345-0@lo:400:kworker.0 Request processed in 60us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986954.753127:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1497 00000100:00100000:0.0:1788986954.753141:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:0.0:1788986954.753147:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993660288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.753190:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993660288:12345-0@lo:400:kworker.0 Request processed in 43us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986954.753196:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:0.0:1788986954.753216:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993659648 00000100:00100000:0.0:1788986954.753220:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993659648 00000100:00100000:0.0:1788986954.753240:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1485 00000100:00100000:0.0:1788986954.753246:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993659648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.753273:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993659648:12345-0@lo:400:kworker.0 Request processed in 27us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986954.753282:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1485 00000100:00100000:0.0:1788986954.753308:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993659776 00000100:00100000:0.0:1788986954.753312:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993659776 00000100:00100000:0.0:1788986954.753329:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993660160 00000100:00100000:0.0:1788986954.753332:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993660160 00000100:00100000:0.0:1788986954.753349:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1961 00000100:00100000:0.0:1788986954.753355:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993659776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.753382:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993659776:12345-0@lo:400:kworker.0 Request processed in 28us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986954.753387:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1961 00000100:00100000:0.0:1788986954.753399:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1962 00000100:00100000:0.0:1788986954.753404:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993660160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.753429:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993660160:12345-0@lo:400:kworker.0 Request processed in 25us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986954.753434:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1962 00000100:00100000:0.0:1788986954.753463:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993659648:0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.753471:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993660160:0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.753479:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993659776:0@lo:400:kworker.0 00000100:00100000:0.0:1788986954.753486:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941835880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993660288:0@lo:400:kworker.0 00000100:00080000:3.0:1788986954.753922:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986954.753927:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986954.753929:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986954.753952:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993660032:0@lo:400:kworker.0 00010000:00010000:2.0:1788986954.817052:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986955.264695:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788986955.264716:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993660416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986955.264776:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986955.264979:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993660416 00000100:00100000:3.0:1788986955.264987:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993660416 00000100:00100000:3.0:1788986955.265037:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:3.0:1788986955.265046:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993660416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986955.265068:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788986955.265150:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993660416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986955.265158:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1788986955.265270:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993660416:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1788986955.759449:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967765 is committed 00010000:00010000:3.0:1788986955.840240:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986956.864953:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986956.913982:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986956.914019:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986956.914127:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971467264 00000100:00100000:3.0:1788986956.914137:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971467264 00000100:00100000:3.0:1788986956.914221:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1963 00000100:00100000:3.0:1788986956.914243:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971467264:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986956.914416:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986956.914446:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986956.914543:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:2346:x1875885971467264:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 312us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986956.914550:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1963 00000100:00080000:3.0:1788986956.914573:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986956.931606:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971467136 00000100:00100000:0.0:1788986956.931620:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971467136 00000100:00100000:0.0:1788986956.931673:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1486 00000100:00100000:0.0:1788986956.931682:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971467136:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986956.931753:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971467136:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 71us (17336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986956.931760:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1486 00000100:00100000:1.0:1788986956.932847:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971467520 00000100:00100000:1.0:1788986956.932855:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971467520 00000100:00100000:1.0:1788986956.932911:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971467392 00000100:00100000:1.0:1788986956.932914:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971467392 00000100:00100000:1.0:1788986956.932936:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1499 00000100:00100000:1.0:1788986956.932944:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971467520:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986956.932986:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971467520:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 43us (18967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986956.932992:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1499 00000100:00100000:1.0:1788986956.933005:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1500 00000100:00100000:1.0:1788986956.933010:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971467392:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986956.933029:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971467392:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 20us (18583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986956.933034:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1500 00000100:00080000:3.0:1788986956.933562:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986956.933566:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1788986957.059866:0:101920:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2740962773333ns, next at 2736281449801ns, rc = 0 00000004:00080000:3.0:1788986957.060019:0:101920:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2740962929472ns, next at 2716603799123ns, rc = 0 00000004:00080000:1.0:1788986957.067265:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 107 committed 00000004:00080000:1.0:1788986957.067285:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 106 committed 00000001:00080000:1.0:1788986957.373864:0:6721:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967375 is committed 00010000:00010000:3.0:1788986957.888280:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986958.620977:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986958.621276:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971467648 00000100:00100000:3.0:1788986958.621287:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971467648 00000100:00100000:3.0:1788986958.621354:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1237 00000100:00100000:3.0:1788986958.621368:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:60035:x1875885971467648:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986958.621453:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+8:60035:x1875885971467648:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 90us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986958.621460:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1237 00000100:00080000:3.0:1788986958.621481:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986958.629388:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986958.629464:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971467776 00000100:00100000:3.0:1788986958.629473:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971467776 00000100:00100000:3.0:1788986958.629559:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 679 00000100:00100000:3.0:1788986958.629576:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:60035:x1875885971467776:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:3.0:1788986958.630051:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:60035:x1875885971467776:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 476us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986958.630063:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 679 00000100:00080000:0.0:1788986958.630999:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986958.635742:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986958.635830:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971467904 00000100:00100000:2.0:1788986958.635841:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971467904 00000100:00100000:2.0:1788986958.635919:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 680 00000100:00100000:2.0:1788986958.635931:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:60035:x1875885971467904:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00080000:0.0:1788986958.636729:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986958.636827:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:60035:x1875885971467904:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 897us (1091us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986958.636837:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 680 00000100:00100000:3.0:1788986958.649387:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986958.649511:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971468032 00000100:00100000:2.0:1788986958.649521:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971468032 00000100:00100000:2.0:1788986958.649572:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1238 00000100:00100000:2.0:1788986958.649582:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:60035:x1875885971468032:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986958.649930:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+8:60035:x1875885971468032:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 347us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986958.649938:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1238 00000100:00100000:2.0:1788986958.655606:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986958.655930:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971468160 00000100:00100000:3.0:1788986958.655939:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971468160 00000100:00100000:3.0:1788986958.655990:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1239 00000100:00100000:3.0:1788986958.655998:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:60035:x1875885971468160:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986958.656106:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:60035:x1875885971468160:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 88us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986958.656113:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1239 00000100:00100000:0.0:1788986958.660532:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986958.660635:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971468288 00000100:00100000:2.0:1788986958.660645:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971468288 00000100:00100000:2.0:1788986958.660706:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 681 00000100:00100000:2.0:1788986958.660718:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:60035:x1875885971468288:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986958.661079:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:60035:x1875885971468288:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 361us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986958.661113:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 681 00000100:00100000:0.0:1788986958.664585:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986958.666199:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971468416 00000100:00100000:2.0:1788986958.666212:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971468416 00000100:00100000:2.0:1788986958.666274:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 682 00000100:00100000:2.0:1788986958.666285:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:60035:x1875885971468416:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986958.666631:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+6:60035:x1875885971468416:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 347us (2060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986958.666639:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 682 00000100:00100000:0.0:1788986958.673434:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986958.673764:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971468544 00000100:00100000:3.0:1788986958.673774:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971468544 00000100:00100000:3.0:1788986958.673838:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1240 00000100:00100000:3.0:1788986958.673848:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:60035:x1875885971468544:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:3.0:1788986958.674353:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+8:60035:x1875885971468544:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 506us (925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986958.674362:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1240 00000100:00100000:2.0:1788986958.741143:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986958.741239:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971468800 00000100:00100000:3.0:1788986958.741249:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971468800 00000100:00100000:3.0:1788986958.741297:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1241 00000100:00100000:3.0:1788986958.741307:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:60039:x1875885971468800:12345-192.168.206.21@tcp:36:rm.60003 00010000:00010000:3.0:1788986958.741381:0:5854:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986958.741419:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54a749 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x65:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1782 expref: 8 pid: 5855 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.741442:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff9b0a45316d00) 00010000:00010000:3.0:1788986958.741454:0:5854:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986958.741480:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a75e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.741495:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a75e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.741505:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a75e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.741520:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a765 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.741532:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.741539:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.741877:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a76c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.741887:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a76c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.741895:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a76c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788986958.742733:0:5854:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].39, 64 off10688 00000004:00080000:3.0:1788986958.742744:0:5854:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2742645653895ns, next at 2743645651684ns, rc = 0 00010000:00010000:3.0:1788986958.742843:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a773 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742854:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742863:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a773 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742871:0:5854:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a773 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742877:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a773 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742889:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742906:0:5854:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788986958.742927:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a76c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742933:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a76c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742939:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a76c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742944:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986958.742948:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a76c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742954:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a76c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742964:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:3.0:1788986958.742967:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986958.742972:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a76c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742978:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a76c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x65:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.742995:0:5854:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a75e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.743002:0:5854:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a75e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.743008:0:5854:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a75e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.743013:0:5854:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2200 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986958.743016:0:5854:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a75e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.743023:0:5854:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a75e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.743030:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:3.0:1788986958.743032:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986958.743035:0:5854:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a75e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986958.743041:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a75e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x60:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986958.743049:0:5854:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 00000000958ac5b7 reply state 00000000088fdeed transno 4294967766 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986958.743057:0:5854:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986958.743185:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:60039:x1875885971468800:12345-192.168.206.21@tcp:36:rm.60003 Request processed in 1874us (2092us total) trans 4294967766 rc 0/0 00000100:00100000:3.0:1788986958.743194:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1241 00010000:00010000:2.0:1788986958.743656:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986958.743664:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a773 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986958.743671:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986958.743675:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a773 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986958.743688:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a773 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986958.743699:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x65:0x0].0x0 (ffff9b0a55745e00) 00010000:00010000:2.0:1788986958.743702:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788986958.743706:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a773 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986958.743711:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2e00/0xc20d828fcf54a773 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x65:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986958.743727:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986958.743729:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986958.743731:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986958.750122:0:3304:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a765 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986958.750139:0:3304:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a765 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986958.750155:0:3304:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a765 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986958.750162:0:3304:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2a00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788986958.750166:0:3304:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a765 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986958.750174:0:3304:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a765 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986958.750189:0:3304:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x7c633847 (ffff9b0a55745000) 00010000:00010000:2.0:1788986958.750192:0:3304:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788986958.750197:0:3304:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a765 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986958.750204:0:3304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2a00/0xc20d828fcf54a765 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x60:0x0].0x7c633847 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986958.848464:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986958.850075:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993660544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986958.850231:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986958.851203:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993660544 00000100:00100000:0.0:1788986958.851219:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993660544 00000100:00100000:0.0:1788986958.851340:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:0.0:1788986958.851352:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993660544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986958.851400:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986958.851506:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993660544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986958.851516:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1788986958.851667:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:2.0:1788986958.851673:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a80d38e00, transno 4294967375 00000100:00100000:2.0:1788986958.851697:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993660544:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986958.852126:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986958.912239:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986959.873536:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993660800:0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.873603:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986959.873659:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993661312:0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.873680:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986959.873700:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788986959.873704:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993660672:0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.873726:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986959.873744:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993661184:0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.873760:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986959.873780:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993660928:0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.873807:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986959.873822:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788986959.873827:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993661056:0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.873843:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986959.873869:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993660800 00000100:00100000:0.0:1788986959.873877:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993660800 00000100:00100000:0.0:1788986959.873911:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993661184 00000100:00100000:0.0:1788986959.873913:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993661184 00000100:00100000:0.0:1788986959.873932:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993660928 00000100:00100000:0.0:1788986959.873934:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993660928 00000100:00100000:0.0:1788986959.873948:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1964 00000100:00100000:0.0:1788986959.873955:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993660800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.873997:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993660800:12345-0@lo:400:kworker.0 Request processed in 43us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986959.874003:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1964 00000100:00100000:0.0:1788986959.874016:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1965 00000100:00100000:0.0:1788986959.874021:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993661184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.874040:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993661184:12345-0@lo:400:kworker.0 Request processed in 20us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986959.874045:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1965 00000100:00100000:0.0:1788986959.874054:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1966 00000100:00100000:0.0:1788986959.874059:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993660928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.874078:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993660928:12345-0@lo:400:kworker.0 Request processed in 20us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986959.874083:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1966 00000100:00100000:0.0:1788986959.874120:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993661312 00000100:00100000:0.0:1788986959.874123:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993661312 00000100:00100000:0.0:1788986959.874159:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993661056 00000100:00100000:0.0:1788986959.874161:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993661056 00000100:00100000:0.0:1788986959.874177:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:0.0:1788986959.874182:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993661312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.874207:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993661312:12345-0@lo:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986959.874223:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:0.0:1788986959.874393:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:0.0:1788986959.874400:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993661056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.874425:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993661056:12345-0@lo:400:kworker.0 Request processed in 26us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986959.874430:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:0.0:1788986959.874446:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993660672 00000100:00100000:0.0:1788986959.874448:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993660672 00000100:00100000:0.0:1788986959.874467:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1487 00000100:00100000:0.0:1788986959.874473:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993660672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.874496:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993660672:12345-0@lo:400:kworker.0 Request processed in 24us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986959.874502:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1487 00000100:00080000:0.0:1788986959.874535:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788986959.874541:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986959.874571:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993661056:0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.874580:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993660928:0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.874603:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993660672:0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.874612:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993661184:0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.874621:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe80700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993660800:0@lo:400:kworker.0 00000100:00100000:0.0:1788986959.874628:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993661312:0@lo:400:kworker.0 00010000:00010000:2.0:1788986959.940252:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986960.385555:0:7935:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2744288462704ns, next at 2745288459526ns, rc = 0 00000100:00100000:1.0:1788986960.385682:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993661440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986960.385777:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986960.386017:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993661440 00000100:00100000:3.0:1788986960.386029:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993661440 00000100:00100000:3.0:1788986960.386126:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1788986960.386148:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993661440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986960.386194:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1788986960.386254:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993661440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986960.386262:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:1.0:1788986960.386414:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993661440:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986960.967047:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788986961.099455:0:102067:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 2745002361253ns, next at 2736281449801ns, rc = 0 00000004:00080000:3.0:1788986961.099665:0:102067:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 2745002575342ns, next at 2745288459526ns, rc = 0 00000004:00080000:0.0:1788986961.153235:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 107 committed 00000004:00080000:0.0:1788986961.153264:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 109 committed 00000001:00080000:0.0:1788986961.153288:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967766 is committed 00000004:00080000:0.0:1788986961.153294:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 108 committed 00000100:00100000:2.0:1788986961.153738:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788986961.153769:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993661568:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788986961.153859:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986961.153950:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993661568 00000100:00100000:2.0:1788986961.153958:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993661568 00000100:00100000:2.0:1788986961.154026:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 683 00000100:00100000:2.0:1788986961.154036:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993661568:12345-0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1788986961.154393:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00080000:2.0:1788986961.154430:0:6698:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:39 count 1 00010000:00010000:2.0:1788986961.154465:0:6698:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986961.154492:0:6698:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf54a757 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1789 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986961.154502:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x27:0x0].0x0 since=8s v=(0 0) 00010000:00010000:2.0:1788986961.154508:0:6698:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788986961.154513:0:6698:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986961.154548:0:6698:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf54a757 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000000010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1789 expref: 5 pid: 6695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986961.154569:0:6698:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf54a757 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x70000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1789 expref: 5 pid: 6695 timeout: 2845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986961.154582:0:6698:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993661696:192.168.206.21@tcp:104: 00000100:00100000:2.0:1788986961.154740:0:6698:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5abfeb40 going to sleep for 11 seconds 00000004:00080000:0.0:1788986961.158293:0:5876:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 110 committed 00000100:00100000:0.0:1788986961.159984:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986961.160045:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971468928 00000100:00100000:0.0:1788986961.160057:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971468928 00010000:00010000:0.0:1788986961.160177:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf54a757 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1789 expref: 6 pid: 6695 timeout: 2845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986961.160222:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 470 00000100:00100000:0.0:1788986961.160235:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45612850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971468928:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788986961.160256:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788986961.160264:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf54a757 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x60000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1789 expref: 6 pid: 6695 timeout: 2845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986961.160281:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf54a757 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x50000400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1789 expref: 6 pid: 6695 timeout: 2845 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986961.160321:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986961.160327:0:5841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x27:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788986961.160336:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986961.160348:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986961.160376:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788986961.160439:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45612850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2346:x1875885971468928:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 206us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986961.160448:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 470 00000100:00080000:3.0:1788986961.161052:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788986961.161158:0:6698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003b921907/0xc20d828fcf54a757 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->1048575) gid 0 flags: 0x44801400010020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1789 expref: 5 pid: 6695 timeout: 2845 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986961.161181:0:6698:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6698:1875885993661696:192.168.206.21@tcp:104: 00010000:00010000:3.0:1788986961.161206:0:6698:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986961.161218:0:6698:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986961.161227:0:6698:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986961.161245:0:6698:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986961.161253:0:6698:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986961.161279:0:6698:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788986961.162067:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3318:x1875885993661568:12345-0@lo:6:osp-syn-1-0.0 Request processed in 8030us (8205us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788986961.162077:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 683 00010000:00010000:0.0:1788986961.162397:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788986961.162405:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986961.162415:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788986961.162420:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986961.162431:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986961.162454:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986961.162468:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc85b72/0xc20d828fcf54a77a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6698 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986961.162491:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986961.162493:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986961.162495:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788986961.162664:0:3318:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9b0a797f8380/2, rc 0, transno 4294967375 00000100:00100000:2.0:1788986961.162685:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993661568:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788986961.984592:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986962.032357:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986962.032393:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986962.032418:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986962.032444:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986962.032470:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971469184 00000100:00100000:0.0:1788986962.032478:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971469184 00000100:00100000:0.0:1788986962.032535:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1967 00000100:00100000:0.0:1788986962.032547:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971469184:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986962.032629:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971469184:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 85us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986962.032637:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1967 00000100:00100000:0.0:1788986962.032660:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971469440 00000100:00100000:0.0:1788986962.032663:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971469440 00000100:00100000:0.0:1788986962.032684:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971469312 00000100:00100000:0.0:1788986962.032687:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971469312 00000100:00100000:0.0:1788986962.032832:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1503 00000100:00100000:0.0:1788986962.032840:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971469440:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986962.032869:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971469440:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 30us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986962.032879:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1503 00000100:00100000:0.0:1788986962.032891:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1504 00000100:00100000:0.0:1788986962.032898:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971469312:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986962.032923:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971469312:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986962.032930:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1504 00000100:00100000:0.0:1788986962.032950:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971469056 00000100:00100000:0.0:1788986962.032953:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971469056 00000100:00100000:0.0:1788986962.032977:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1488 00000100:00100000:0.0:1788986962.032982:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971469056:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986962.033006:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971469056:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986962.033013:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1488 00000100:00080000:0.0:1788986962.033043:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788986962.033048:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788986963.009406:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986963.973282:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993661824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986963.973381:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986963.973516:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993661824 00000100:00100000:3.0:1788986963.973527:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993661824 00000100:00100000:3.0:1788986963.974919:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1788986963.974935:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993661824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986963.974982:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986963.975063:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993661824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (1683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986963.975071:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00080000:3.0:1788986963.975129:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986963.975582:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941835c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993661824:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986964.033223:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788986964.043134:0:7656:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967375 is committed 00000100:00100000:3.0:1788986964.992529:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993661952:0@lo:400:kworker.0 00000100:00100000:3.0:1788986964.992639:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986964.992639:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993662080:0@lo:400:kworker.0 00000100:00100000:1.0:1788986964.992680:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986964.992779:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993662336:0@lo:400:kworker.0 00000100:00100000:2.0:1788986964.992817:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986964.993311:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993662464:0@lo:400:kworker.0 00000100:00100000:3.0:1788986964.993348:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986964.993387:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993662208:0@lo:400:kworker.0 00000100:00100000:3.0:1788986964.993411:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986964.993451:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993662336 00000100:00100000:3.0:1788986964.993461:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993662336 00000100:00100000:3.0:1788986964.993519:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1788986964.993529:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993662336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986964.993595:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993662336:12345-0@lo:400:kworker.0 Request processed in 68us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986964.993603:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1788986964.993634:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993662080 00000100:00100000:3.0:1788986964.993638:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993662080 00000100:00100000:3.0:1788986964.993662:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993662464 00000100:00100000:3.0:1788986964.993665:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993662464 00000100:00100000:3.0:1788986964.993692:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993662208 00000100:00100000:3.0:1788986964.993695:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993662208 00000100:00100000:3.0:1788986964.993712:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1968 00000100:00100000:3.0:1788986964.993718:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993662080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986964.993753:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993662080:12345-0@lo:400:kworker.0 Request processed in 35us (1072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986964.993760:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1968 00000100:00100000:3.0:1788986964.993773:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1969 00000100:00100000:3.0:1788986964.993779:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993662464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986964.993829:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993662464:12345-0@lo:400:kworker.0 Request processed in 51us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986964.993836:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1969 00000100:00100000:3.0:1788986964.993848:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1970 00000100:00100000:3.0:1788986964.993868:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993662208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986964.993900:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993662208:12345-0@lo:400:kworker.0 Request processed in 34us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986964.993906:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1970 00000100:00080000:3.0:1788986964.993923:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986964.993963:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993662208:0@lo:400:kworker.0 00000100:00100000:3.0:1788986964.993998:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe83480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993662464:0@lo:400:kworker.0 00000100:00100000:3.0:1788986964.994052:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe80a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993662336:0@lo:400:kworker.0 00000100:00100000:0.0:1788986964.994829:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993661952 00000100:00100000:0.0:1788986964.994839:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993661952 00000100:00100000:0.0:1788986964.995017:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1489 00000100:00100000:0.0:1788986964.995028:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993661952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986964.995141:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993661952:12345-0@lo:400:kworker.0 Request processed in 115us (2502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986964.995147:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1489 00000100:00100000:3.0:1788986964.997165:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993661952:0@lo:400:kworker.0 00000100:00100000:1.0:1788986964.999767:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe80380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993662080:0@lo:400:kworker.0 00000100:00100000:1.0:1788986964.999790:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993662592:0@lo:400:kworker.0 00000100:00100000:1.0:1788986964.999874:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986965.000387:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993662592 00000100:00100000:0.0:1788986965.000398:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993662592 00000100:00100000:0.0:1788986965.000498:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:0.0:1788986965.000511:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993662592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986965.000597:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993662592:12345-0@lo:400:kworker.0 Request processed in 90us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986965.000605:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:2.0:1788986965.000725:0:3318:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967375 gen 2 00000004:00080000:2.0:1788986965.000733:0:3318:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9b0a797f8380, transno 4294967375 00000100:00100000:2.0:1788986965.000753:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993662592:0@lo:400:kworker.0 00000100:00080000:3.0:1788986965.000932:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788986965.059984:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986965.507751:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993662720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986965.507869:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986965.510754:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993662720 00000100:00100000:3.0:1788986965.510939:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993662720 00000100:00100000:3.0:1788986965.511225:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1788986965.511239:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993662720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986965.511299:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986965.511421:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993662720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 185us (3552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986965.511428:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1788986965.511554:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993662720:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986966.080252:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788986967.106911:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986967.153428:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986967.153595:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986967.153644:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986967.153684:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971469952 00000100:00100000:0.0:1788986967.153691:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986967.153700:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971469952 00000100:00100000:1.0:1788986967.153718:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971469568 00000100:00100000:1.0:1788986967.153726:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971469568 00000100:00100000:0.0:1788986967.153748:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971469824 00000100:00100000:0.0:1788986967.153755:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971469824 00000100:00100000:1.0:1788986967.153807:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1490 00000100:00100000:2.0:1788986967.153808:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1507 00000100:00100000:2.0:1788986967.153829:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971469952:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986967.153829:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971469568:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986967.153940:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971469568:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 119us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986967.153948:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1490 00000100:00100000:2.0:1788986967.160163:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971469952:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 6325us (6550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986967.161250:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971469696 00000100:00100000:3.0:1788986967.161691:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971469696 00000100:00100000:3.0:1788986967.161794:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1971 00000100:00100000:3.0:1788986967.161807:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971469696:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986967.161908:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2348:x1875885971469696:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 104us (8493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986967.161917:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1971 00000100:00080000:3.0:1788986967.161956:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986967.161962:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986967.161965:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788986967.162126:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1508 00000100:00100000:0.0:1788986967.162140:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971469824:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986967.162181:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971469824:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 46us (8492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986967.162188:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1508 00000100:00100000:2.0:1788986967.168464:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1507 00010000:00010000:3.0:1788986968.128311:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986969.090426:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788986969.090455:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993662848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986969.090553:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986969.090993:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993662848 00000100:00100000:2.0:1788986969.091005:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993662848 00000100:00100000:2.0:1788986969.091130:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1788986969.091145:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993662848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788986969.091197:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788986969.091283:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993662848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (730us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986969.091290:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00080000:3.0:1788986969.091356:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986969.092315:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993662848:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788986969.152384:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986970.115311:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993663104:0@lo:400:kworker.0 00000100:00100000:1.0:1788986970.115369:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993662976:0@lo:400:kworker.0 00000100:00100000:2.0:1788986970.115462:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993663360:0@lo:400:kworker.0 00000100:00100000:0.0:1788986970.119841:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986970.119939:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993663616:0@lo:400:kworker.0 00000100:00100000:0.0:1788986970.120014:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986970.120028:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993663232:0@lo:400:kworker.0 00000100:00100000:0.0:1788986970.120065:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993663104 00000100:00100000:0.0:1788986970.120075:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993663104 00000100:00100000:3.0:1788986970.120079:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986970.120159:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993663232 00000100:00100000:0.0:1788986970.120162:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993663232 00000100:00100000:3.0:1788986970.120192:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1972 00000100:00100000:0.0:1788986970.120200:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1973 00000100:00100000:3.0:1788986970.120207:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993663104:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986970.120212:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993663232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986970.120277:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993663232:12345-0@lo:400:kworker.0 Request processed in 68us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986970.120285:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993663104:12345-0@lo:400:kworker.0 Request processed in 81us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986970.120289:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1973 00000100:00100000:3.0:1788986970.120298:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1972 00000100:00080000:0.0:1788986970.120327:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986970.120367:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993663232:0@lo:400:kworker.0 00000100:00100000:3.0:1788986970.120404:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993663616 00000100:00100000:3.0:1788986970.120409:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993663616 00000100:00100000:3.0:1788986970.120444:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:3.0:1788986970.120451:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993663616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986970.120483:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993663616:12345-0@lo:400:kworker.0 Request processed in 33us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986970.120489:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:1.0:1788986970.121117:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986970.121283:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993663488:0@lo:400:kworker.0 00000100:00100000:1.0:1788986970.121327:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986970.121374:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993663488 00000100:00100000:1.0:1788986970.121379:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993663488 00000100:00100000:1.0:1788986970.121421:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1974 00000100:00100000:1.0:1788986970.121429:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993663488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986970.121473:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993663488:12345-0@lo:400:kworker.0 Request processed in 45us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986970.121479:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1974 00000100:00100000:1.0:1788986970.121515:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993663488:0@lo:400:kworker.0 00000100:00080000:1.0:1788986970.121548:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788986970.121553:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986970.121632:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986970.121644:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993662976 00000100:00100000:3.0:1788986970.121650:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993662976 00000100:00100000:3.0:1788986970.121682:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1491 00000100:00100000:3.0:1788986970.121689:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993662976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986970.121751:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993663360 00000100:00100000:1.0:1788986970.121756:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993663360 00000100:00100000:1.0:1788986970.121796:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:1.0:1788986970.121804:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993663360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986970.121836:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993663104:0@lo:400:kworker.0 00000100:00100000:0.0:1788986970.121859:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993663616:0@lo:400:kworker.0 00000100:00100000:3.0:1788986970.124843:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993662976:12345-0@lo:400:kworker.0 Request processed in 3142us (3715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986970.124861:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1491 00000100:00100000:0.0:1788986970.125167:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993662976:0@lo:400:kworker.0 00000100:00100000:1.0:1788986970.134187:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993663360:12345-0@lo:400:kworker.0 Request processed in 12367us (12539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986970.134209:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1788986970.134432:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993663360:0@lo:400:kworker.0 00010000:00010000:3.0:1788986970.176622:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986970.625303:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993663744:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788986970.625439:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986970.630193:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993663744 00000100:00100000:1.0:1788986970.630219:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993663744 00000100:00100000:1.0:1788986970.630420:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1788986970.630436:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993663744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788986970.630501:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986970.630759:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993663744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 326us (5318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986970.630768:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:0.0:1788986970.630904:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993663744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986971.201556:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788986972.225428:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986972.274506:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986972.274573:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986972.274833:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971470080 00000100:00100000:3.0:1788986972.274847:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971470080 00000100:00100000:3.0:1788986972.274975:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1492 00000100:00100000:3.0:1788986972.274988:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971470080:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986972.275130:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2349:x1875885971470080:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 143us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986972.275147:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1492 00000100:00100000:0.0:1788986972.279859:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986972.280269:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986972.284285:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971470336 00000100:00100000:1.0:1788986972.284307:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971470336 00000100:00100000:1.0:1788986972.284499:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1511 00000100:00100000:1.0:1788986972.284513:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971470336:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986972.284616:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971470336:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 107us (10042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986972.284624:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1511 00000100:00100000:1.0:1788986972.286329:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971470464 00000100:00100000:1.0:1788986972.286346:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971470464 00000100:00100000:3.0:1788986972.286394:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971470208 00000100:00100000:3.0:1788986972.286399:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971470208 00000100:00080000:2.0:1788986972.287070:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986972.287101:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986972.287104:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986972.288728:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1512 00000100:00100000:1.0:1788986972.288767:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971470464:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986972.288895:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2349:x1875885971470464:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 151us (8625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986972.288918:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1512 00000100:00100000:3.0:1788986972.288935:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1975 00000100:00100000:3.0:1788986972.288948:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971470208:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986972.288989:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:2349:x1875885971470208:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (9145us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986972.288995:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1975 00010000:00010000:0.0:1788986973.248769:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986974.210842:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993663872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986974.210954:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986974.211076:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993663872 00000100:00100000:0.0:1788986974.211087:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993663872 00000100:00100000:0.0:1788986974.211199:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00080000:1.0:1788986974.211834:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986974.213976:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993663872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986974.214039:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986974.214180:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe55f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993663872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 235us (3226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986974.214190:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:0.0:1788986974.220890:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993663872:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986974.272982:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986975.233320:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993664128:0@lo:400:kworker.0 00000100:00100000:3.0:1788986975.233430:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986975.233532:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993664640:0@lo:400:kworker.0 00000100:00100000:3.0:1788986975.233564:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986975.233594:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986975.233600:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993664256:0@lo:400:kworker.0 00000100:00100000:3.0:1788986975.233624:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986975.233940:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993664000:0@lo:400:kworker.0 00000100:00100000:0.0:1788986975.233987:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986975.234032:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993664512:0@lo:400:kworker.0 00000100:00100000:0.0:1788986975.234068:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986975.234127:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986975.234134:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993664384:0@lo:400:kworker.0 00000100:00100000:0.0:1788986975.234172:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986975.234383:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993664640 00000100:00100000:1.0:1788986975.234392:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993664640 00000100:00100000:1.0:1788986975.234474:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993664384 00000100:00100000:1.0:1788986975.234478:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993664384 00000100:00100000:1.0:1788986975.234507:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:1.0:1788986975.234529:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993664640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986975.234595:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993664640:12345-0@lo:400:kworker.0 Request processed in 69us (1030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986975.234604:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:1.0:1788986975.234624:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:1.0:1788986975.234630:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993664384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986975.234666:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993664384:12345-0@lo:400:kworker.0 Request processed in 37us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986975.234673:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:1.0:1788986975.234695:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993664128 00000100:00100000:1.0:1788986975.234699:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993664128 00000100:00100000:1.0:1788986975.234722:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993664256 00000100:00100000:1.0:1788986975.234725:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993664256 00000100:00100000:1.0:1788986975.234743:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993664512 00000100:00100000:1.0:1788986975.234745:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993664512 00000100:00100000:1.0:1788986975.234763:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1976 00000100:00100000:1.0:1788986975.234769:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993664128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986975.234803:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993664128:12345-0@lo:400:kworker.0 Request processed in 35us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986975.234810:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1976 00000100:00100000:1.0:1788986975.234822:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1977 00000100:00100000:1.0:1788986975.234828:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993664256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986975.234860:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993664256:12345-0@lo:400:kworker.0 Request processed in 32us (1235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986975.234866:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1977 00000100:00100000:1.0:1788986975.234877:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1978 00000100:00100000:1.0:1788986975.234883:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993664512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986975.234911:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993664512:12345-0@lo:400:kworker.0 Request processed in 28us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986975.234917:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1978 00000100:00100000:1.0:1788986975.234985:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993664384:0@lo:400:kworker.0 00000100:00100000:1.0:1788986975.234997:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993664512:0@lo:400:kworker.0 00000100:00080000:0.0:1788986975.235412:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788986975.235419:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986975.236505:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993664000 00000100:00100000:3.0:1788986975.236527:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993664000 00000100:00100000:3.0:1788986975.236614:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:3.0:1788986975.236627:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993664000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986975.236735:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993664000:12345-0@lo:400:kworker.0 Request processed in 111us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986975.236742:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:3.0:1788986975.236815:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993664256:0@lo:400:kworker.0 00000100:00100000:3.0:1788986975.236831:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993664128:0@lo:400:kworker.0 00000100:00100000:3.0:1788986975.236843:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993664640:0@lo:400:kworker.0 00000100:00100000:1.0:1788986975.237315:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993664000:0@lo:400:kworker.0 00010000:00010000:0.0:1788986975.298798:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986975.746537:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986975.746567:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993664768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986975.746657:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986975.747139:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993664768 00000100:00100000:3.0:1788986975.747150:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993664768 00000100:00100000:3.0:1788986975.747228:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1788986975.747238:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993664768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986975.747283:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986975.747351:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993664768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986975.747359:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:1.0:1788986975.747720:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993664768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788986976.323371:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986976.612895:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986976.613459:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971470592 00000100:00100000:2.0:1788986976.614963:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971470592 00000100:00100000:2.0:1788986976.615127:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1242 00000100:00100000:2.0:1788986976.615140:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:60257:x1875885971470592:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986976.615277:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:60257:x1875885971470592:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 141us (2403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986976.615285:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1242 00000100:00080000:0.0:1788986976.615439:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986976.622036:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986976.622156:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971470720 00000100:00100000:1.0:1788986976.622169:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971470720 00000100:00100000:1.0:1788986976.622267:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 684 00000100:00100000:1.0:1788986976.622278:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:60257:x1875885971470720:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:1.0:1788986976.622765:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:60257:x1875885971470720:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 487us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986976.622774:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 684 00000100:00080000:0.0:1788986976.623066:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986976.627594:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986976.627830:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971470848 00000100:00100000:2.0:1788986976.627845:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971470848 00000100:00100000:2.0:1788986976.627942:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 685 00000100:00100000:2.0:1788986976.627955:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:60257:x1875885971470848:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00080000:0.0:1788986976.628138:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788986976.628495:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:60257:x1875885971470848:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 539us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986976.628509:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 685 00000100:00100000:3.0:1788986976.631267:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986976.631379:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971470976 00000100:00100000:2.0:1788986976.631391:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971470976 00000100:00100000:2.0:1788986976.631472:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1243 00000100:00100000:2.0:1788986976.631486:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:60257:x1875885971470976:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986976.633785:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:60257:x1875885971470976:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 2279us (2508us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986976.633805:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1243 00000100:00100000:3.0:1788986976.649397:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986976.649566:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971471104 00000100:00100000:0.0:1788986976.649577:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971471104 00000100:00100000:0.0:1788986976.649654:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1244 00000100:00100000:0.0:1788986976.649666:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:60257:x1875885971471104:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:0.0:1788986976.649806:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+7:60257:x1875885971471104:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 141us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986976.649815:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1244 00000100:00100000:1.0:1788986976.652845:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986976.653143:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971471232 00000100:00100000:0.0:1788986976.653156:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971471232 00000100:00100000:0.0:1788986976.653228:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 686 00000100:00100000:0.0:1788986976.653240:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:60257:x1875885971471232:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:0.0:1788986976.657919:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:60257:x1875885971471232:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 4663us (5070us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986976.657938:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 686 00000100:00100000:3.0:1788986976.660486:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986976.660546:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971471360 00000100:00100000:2.0:1788986976.660559:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971471360 00000100:00100000:2.0:1788986976.660638:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 687 00000100:00100000:2.0:1788986976.660648:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:60257:x1875885971471360:12345-192.168.206.21@tcp:19:lfs.60003 00000100:00100000:2.0:1788986976.661379:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:60257:x1875885971471360:12345-192.168.206.21@tcp:19:lfs.60003 Request processed in 726us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986976.661390:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 687 00000100:00100000:3.0:1788986976.676190:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986976.676452:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971471488 00000100:00100000:2.0:1788986976.676466:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971471488 00000100:00100000:2.0:1788986976.676595:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1245 00000100:00100000:2.0:1788986976.676613:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:60257:x1875885971471488:12345-192.168.206.21@tcp:48:lfs.60003 00000100:00100000:2.0:1788986976.677544:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+7:60257:x1875885971471488:12345-192.168.206.21@tcp:48:lfs.60003 Request processed in 931us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986976.677554:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1245 00000100:00100000:0.0:1788986976.758143:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986976.758929:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971471616 00000100:00100000:3.0:1788986976.758946:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971471616 00000100:00100000:3.0:1788986976.759036:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1246 00000100:00100000:3.0:1788986976.759060:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+7:60258:x1875885971471616:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:3.0:1788986976.759116:0:5854:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986976.759144:0:5854:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a781 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1790 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.759230:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a788 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.759248:0:5854:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.759272:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986976.759318:0:5854:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00000004:00200000:3.0:1788986976.759322:0:5854:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788986976.759346:0:5854:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a788 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5854 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.759376:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a781 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1790 expref: 9 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.759398:0:5854:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a788 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1790 expref: 8 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.759407:0:5854:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:3.0:1788986976.759410:0:5854:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788986976.759416:0:5854:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788986976.759947:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+8:60258:x1875885971471616:12345-192.168.206.21@tcp:101:rm.0 Request processed in 897us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986976.759956:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1246 00000100:00100000:3.0:1788986976.762827:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986976.762908:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971471872 00000100:00100000:0.0:1788986976.762921:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971471872 00000100:00100000:0.0:1788986976.762997:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1247 00000100:00100000:0.0:1788986976.763009:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+8:60258:x1875885971471872:12345-192.168.206.21@tcp:101:rm.0 00010000:00010000:0.0:1788986976.763034:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986976.763073:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a78f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1797 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788986976.763205:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00010000:00010000:0.0:1788986976.763530:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a78f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1797 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986976.763548:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:0.0:1788986976.763552:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788986976.763559:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508ef400/0xc20d828fcf54a78f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1797 expref: 10 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986976.763581:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788986976.763668:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+9:60258:x1875885971471872:12345-192.168.206.21@tcp:101:rm.0 Request processed in 660us (852us total) trans 4294967767 rc 301/301 00000100:00100000:0.0:1788986976.763678:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1247 00000100:00100000:0.0:1788986976.774932:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986976.774981:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971472000 00000100:00100000:0.0:1788986976.775185:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971472000 00000100:00100000:0.0:1788986976.775258:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 122 00000100:00100000:0.0:1788986976.775271:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:60258:x1875885971472000:12345-192.168.206.21@tcp:37:rm.0 00000100:00100000:1.0:1788986976.809411:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+9:60258:x1875885971472000:12345-192.168.206.21@tcp:37:rm.0 Request processed in 34126us (34480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986976.809428:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 122 00000100:00100000:0.0:1788986976.817129:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986976.817176:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971472256 00000100:00100000:0.0:1788986976.817189:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971472256 00000100:00100000:0.0:1788986976.817252:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 123 00000100:00100000:0.0:1788986976.817263:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+9:60258:x1875885971472256:12345-192.168.206.21@tcp:35:rm.0 00000100:00100000:0.0:1788986976.819598:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+10:60258:x1875885971472256:12345-192.168.206.21@tcp:35:rm.0 Request processed in 2316us (2462us total) trans 4294967768 rc 0/0 00000100:00100000:0.0:1788986976.819615:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 123 00000100:00100000:1.0:1788986976.835559:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986976.835718:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971472512 00000100:00100000:3.0:1788986976.835730:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971472512 00000100:00100000:3.0:1788986976.835853:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1248 00000100:00100000:3.0:1788986976.835866:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+10:60258:x1875885971472512:12345-192.168.206.21@tcp:36:rm.0 00010000:00010000:3.0:1788986976.836005:0:7899:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788986976.836040:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54a788 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1790 expref: 10 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.836074:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a508efa00/0xc20d828fcf54a72d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x60:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d177b expref: 9 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.836109:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a4823ba00) 00010000:00010000:3.0:1788986976.836130:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54a447 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d16c5 expref: 8 pid: 15241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.836143:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745a00) 00010000:00010000:3.0:1788986976.836150:0:7899:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788986976.836179:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a79d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.836193:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a79d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.836203:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a79d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.836216:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a7a4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.836223:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.836229:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.838895:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a7ab lrc: 3/0,1 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.839063:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a7ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.839079:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a7ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788986976.841650:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000401:0x60:0x0]: returning size 16384 00010000:00010000:3.0:1788986976.841681:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a7ab lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841691:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a7ab lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841699:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a7ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841705:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986976.841710:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a7ab lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841724:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a7ab lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841742:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x60:0x0].0x0 (ffff9b0a55745700) 00010000:00010000:3.0:1788986976.841745:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788986976.841751:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a7ab lrc: 2/0,0 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841758:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2800/0xc20d828fcf54a7ab lrc: 0/0,0 mode: --/EX res: [0x200000401:0x60:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841789:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a79d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841858:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a79d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841864:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a79d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841868:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986976.841872:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a79d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841878:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a79d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841886:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745b00) 00010000:00010000:3.0:1788986976.841888:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986976.841891:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a79d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.841901:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3c00/0xc20d828fcf54a79d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788986976.842143:0:7899:0:(mdt_handler.c:4490:mdt_save_lock()) ### save lock request 000000007de93dea reply state 00000000f6e13057 transno 4294967769 ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986976.842155:0:7899:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788986976.842267:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+9:60258:x1875885971472512:12345-192.168.206.21@tcp:36:rm.0 Request processed in 6397us (6715us total) trans 4294967769 rc 0/0 00000100:00100000:3.0:1788986976.842277:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1248 00010000:00010000:3.0:1788986976.854754:0:3305:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a7a4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.854783:0:3305:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a7a4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.854859:0:3305:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a7a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.854868:0:3305:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:3.0:1788986976.854873:0:3305:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a7a4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.854882:0:3305:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a7a4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.854905:0:3305:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xc313f4c7 (ffff9b0a55745400) 00010000:00010000:3.0:1788986976.854908:0:3305:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788986976.854914:0:3305:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a7a4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986976.855065:0:3305:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2600/0xc20d828fcf54a7a4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xc313f4c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788986976.870972:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967767 is committed 00010000:00010000:2.0:1788986977.344407:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986977.392694:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986977.393497:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971472640 00000100:00100000:2.0:1788986977.393522:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971472640 00000100:00100000:2.0:1788986977.393595:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1494 00000100:00100000:2.0:1788986977.393608:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971472640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986977.393696:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971472640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 91us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986977.393705:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1494 00010000:00010000:1.0:1788986978.375734:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986978.791292:0:102287:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffef3a0a210 20000000:00000080:2.0:1788986978.791316:0:102287:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0941da9800 uarg=0000000000000000 00010000:00010000:2.0:1788986978.796345:0:102287:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986978.796448:0:102287:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986978.796522:0:102287:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986978.796715:0:102287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.796738:0:102287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a439 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a432 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.796747:0:102287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.796930:0:102287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a439 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a432 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.796954:0:102287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a439 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a432 expref: 18 pid: 5849 timeout: 2862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986978.796972:0:102287:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102287:1875885993664896:0@lo:104: 00000100:00100000:2.0:1788986978.797072:0:102287:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986978.797259:0:102287:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a46ee8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788986978.797428:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993664896 00000100:00100000:1.0:1788986978.797439:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993664896 00000100:00100000:1.0:1788986978.797750:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 395 00000100:00100000:1.0:1788986978.797763:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:102287:x1875885993664896:12345-0@lo:104: 00010000:00010000:1.0:1788986978.797783:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986978.797885:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986978.797893:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:102287:x1875885993664896:12345-0@lo:104: Request processed in 133us (821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986978.797901:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 395 00000100:00100000:2.0:1788986978.797995:0:102287:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102287:1875885993664896:0@lo:104: 00010000:00010000:2.0:1788986978.798021:0:102287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986978.798122:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986978.798130:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986978.798138:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986978.798143:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986978.798152:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986978.798159:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986978.798166:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986978.798211:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986978.798219:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986978.798246:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986978.798253:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a432 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a439 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986978.798273:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986978.798276:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986978.798277:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986978.798701:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993665024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788986978.798757:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986978.798869:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993665024 00000100:00100000:2.0:1788986978.798876:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993665024 00010000:00010000:2.0:1788986978.798909:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a439 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a432 expref: 19 pid: 5849 timeout: 2862 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986978.798943:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 471 00000100:00100000:2.0:1788986978.798952:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993665024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986978.798966:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986978.798972:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a439 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a432 expref: 19 pid: 5849 timeout: 2862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.798984:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a439 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a432 expref: 19 pid: 5849 timeout: 2862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.799000:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a439 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a432 expref: 19 pid: 5849 timeout: 2862 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.799019:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.799028:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.799056:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.799064:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.799076:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.799084:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.799250:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986978.799255:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.799264:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986978.799715:0:102287:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986978.799726:0:102287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.804835:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.804864:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7b2 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986978.804899:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986978.805052:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993665024:12345-0@lo:103:ldlm_bl.0 Request processed in 6085us (6278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986978.805063:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 471 00000100:00100000:3.0:1788986978.805268:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993665024:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986979.335169:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993665152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986979.337802:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986979.338263:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993665152 00000100:00100000:3.0:1788986979.338299:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993665152 00000100:00100000:3.0:1788986979.338950:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1788986979.338964:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993665152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986979.339012:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986979.339128:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993665152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986979.339135:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00080000:3.0:1788986979.339159:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788986979.339547:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993665152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788986979.397889:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788986979.780020:0:102336:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd2343ab40 20000000:00000080:2.0:1788986979.780055:0:102336:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094197ec00 uarg=0000000000000000 00010000:00010000:2.0:1788986979.780337:0:102336:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788986979.780354:0:102336:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788986979.780377:0:102336:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788986979.780401:0:102336:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7b9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986979.780420:0:102336:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7b9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986979.780434:0:102336:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7b9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986979.780451:0:102336:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7b9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986979.780458:0:102336:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7b9 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986979.780467:0:102336:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7b9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986979.780474:0:102336:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986979.780479:0:102336:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7b9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986979.780488:0:102336:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7b9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986979.780502:0:102336:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7b9 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986979.780511:0:102336:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7b9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986979.780520:0:102336:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7b9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102336 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986979.904633:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986979.904645:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986979.904652:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986979.904713:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986979.904727:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986979.904740:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986979.904771:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993665280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986979.904860:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986979.904918:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a59f526c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788986979.905632:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993665280 00000100:00100000:0.0:1788986979.905644:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993665280 00000100:00100000:0.0:1788986979.905719:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1495 00000100:00100000:0.0:1788986979.905731:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993665280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986979.905754:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788986979.905773:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf54a7c7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a7c0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986979.905803:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf54a7c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a7c0 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986979.905817:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf54a7c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a7c0 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986979.905828:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eec00, rc 0) 00000100:00100000:0.0:1788986979.905907:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993665280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986979.905915:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1495 00000100:00100000:1.0:1788986979.906388:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993665280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788986979.906408:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a7c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986979.906419:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a7c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788986979.906443:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788986979.906448:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a7c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986979.906458:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a7c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986980.360046:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993665536:0@lo:400:kworker.0 00000100:00100000:0.0:1788986980.360161:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986980.360227:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993666048:0@lo:400:kworker.0 00000100:00100000:0.0:1788986980.360257:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986980.360285:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788986980.360291:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993665408:0@lo:400:kworker.0 00000100:00100000:0.0:1788986980.360323:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986980.360348:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993665920:0@lo:400:kworker.0 00000100:00100000:0.0:1788986980.360371:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986980.360405:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993665536 00000100:00100000:0.0:1788986980.360414:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993665536 00000100:00100000:1.0:1788986980.360465:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993665664:0@lo:400:kworker.0 00000100:00100000:0.0:1788986980.360467:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993665920 00000100:00100000:0.0:1788986980.360470:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993665920 00000100:00100000:1.0:1788986980.360507:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986980.360518:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993665664 00000100:00100000:0.0:1788986980.360521:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993665664 00000100:00100000:1.0:1788986980.360534:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986980.360539:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993665792:0@lo:400:kworker.0 00000100:00100000:1.0:1788986980.360563:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986980.360595:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993666048 00000100:00100000:1.0:1788986980.360599:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993666048 00000100:00100000:1.0:1788986980.360741:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993665792 00000100:00100000:1.0:1788986980.360745:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993665792 00000100:00100000:1.0:1788986980.360770:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:1.0:1788986980.360781:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993666048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986980.360852:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993666048:12345-0@lo:400:kworker.0 Request processed in 72us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986980.360860:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:1.0:1788986980.360881:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:1.0:1788986980.360888:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993665792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986980.361273:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1979 00000100:00100000:3.0:1788986980.361286:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993665536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986980.361325:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993665536:12345-0@lo:400:kworker.0 Request processed in 43us (1165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986980.361331:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1979 00000100:00100000:3.0:1788986980.361349:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1980 00000100:00100000:3.0:1788986980.361354:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993665920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986980.361383:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993665920:12345-0@lo:400:kworker.0 Request processed in 28us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986980.361392:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1980 00000100:00100000:1.0:1788986980.361395:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993665792:12345-0@lo:400:kworker.0 Request processed in 509us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986980.361402:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:3.0:1788986980.361411:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993665408 00000100:00100000:3.0:1788986980.361415:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993665408 00000100:00100000:3.0:1788986980.361446:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1496 00000100:00100000:3.0:1788986980.361452:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993665408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986980.361482:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993665408:12345-0@lo:400:kworker.0 Request processed in 31us (1158us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986980.361488:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1496 00000100:00080000:3.0:1788986980.361520:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986980.361525:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986980.363956:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1981 00000100:00100000:0.0:1788986980.363976:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993665664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986980.364102:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993665664:12345-0@lo:400:kworker.0 Request processed in 121us (3580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986980.364109:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1981 00000100:00100000:1.0:1788986980.364179:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993665792:0@lo:400:kworker.0 00000100:00100000:1.0:1788986980.364197:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993665664:0@lo:400:kworker.0 00000100:00100000:1.0:1788986980.364249:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993665408:0@lo:400:kworker.0 00000100:00100000:1.0:1788986980.364265:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993665920:0@lo:400:kworker.0 00000100:00100000:1.0:1788986980.364279:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993665536:0@lo:400:kworker.0 00000100:00100000:1.0:1788986980.364311:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993666048:0@lo:400:kworker.0 00010000:00010000:3.0:1788986980.417212:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788986980.786771:0:102384:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc825d5390 20000000:00000080:1.0:1788986980.786795:0:102384:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a760d7c00 uarg=0000000000000000 00010000:00010000:1.0:1788986980.788797:0:102384:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788986980.788820:0:102384:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788986980.788843:0:102384:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788986980.788866:0:102384:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986980.788887:0:102384:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf54a7c7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a7c0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986980.789005:0:102384:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986980.789065:0:102384:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf54a7c7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a7c0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986980.789083:0:102384:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf54a7c7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a7c0 expref: 18 pid: 5848 timeout: 2864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986980.789154:0:102384:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102384:1875885993666176:0@lo:104: 00000100:00100000:1.0:1788986980.789286:0:102384:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986980.789412:0:102384:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788986980.789621:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993666176 00000100:00100000:3.0:1788986980.789631:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993666176 00000100:00100000:3.0:1788986980.789731:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:3.0:1788986980.789742:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:102384:x1875885993666176:12345-0@lo:104: 00010000:00010000:3.0:1788986980.789757:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a7c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986980.789826:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788986980.789832:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:102384:x1875885993666176:12345-0@lo:104: Request processed in 92us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986980.789838:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00010000:00010000:2.0:1788986980.789886:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788986980.789894:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a7c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.789918:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788986980.789923:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a7c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.789933:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a7c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788986980.789945:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a7c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788986980.789951:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788986980.789990:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a7c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.789997:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788986980.790022:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a7c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790041:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0c00/0xc20d828fcf54a7c0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a7c7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790061:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986980.790062:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788986980.790064:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986980.790086:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993666304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788986980.790156:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986980.790207:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993666304 00000100:00100000:2.0:1788986980.790211:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993666304 00010000:00010000:2.0:1788986980.790246:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf54a7c7 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a7c0 expref: 19 pid: 5848 timeout: 2864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986980.790270:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1788986980.790277:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993666304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986980.790288:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788986980.790293:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf54a7c7 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a7c0 expref: 19 pid: 5848 timeout: 2864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790305:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf54a7c7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a7c0 expref: 19 pid: 5848 timeout: 2864 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790323:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790332:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790350:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790357:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790365:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790371:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790377:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788986980.790381:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790389:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790398:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986980.790412:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788986980.790444:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993666304:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986980.790451:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 472 00000100:00100000:2.0:1788986980.790511:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993666304:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788986980.790615:0:102384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eec00/0xc20d828fcf54a7c7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a7c0 expref: 18 pid: 5848 timeout: 2864 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986980.790631:0:102384:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102384:1875885993666176:0@lo:104: 00010000:00010000:1.0:1788986980.790645:0:102384:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986980.790654:0:102384:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986980.790661:0:102384:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986980.790668:0:102384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a7ce lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102384 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986980.865520:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788986980.865555:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993666432:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986980.865648:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986980.865724:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993666432 00000100:00100000:3.0:1788986980.865734:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993666432 00000100:00100000:3.0:1788986980.865799:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1788986980.865809:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993666432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986980.865856:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986980.865912:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993666432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986980.865919:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1788986980.865976:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993666432:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986981.441358:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788986981.937391:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967768 is committed 00000001:00080000:0.0:1788986981.937424:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967769 is committed 00010000:00010000:2.0:1788986982.465039:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986982.512895:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986982.512956:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986982.512987:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971472768 00000100:00100000:3.0:1788986982.513001:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788986982.513014:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971472768 00000100:00100000:1.0:1788986982.513054:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971473024 00000100:00100000:3.0:1788986982.513057:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986982.513065:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971473024 00000100:00100000:3.0:1788986982.513127:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971472896 00000100:00100000:3.0:1788986982.513131:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971472896 00000100:00100000:0.0:1788986982.513153:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1497 00000100:00100000:1.0:1788986982.513165:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971473152 00000100:00100000:1.0:1788986982.513170:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971473152 00000100:00100000:3.0:1788986982.513174:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1982 00000100:00100000:0.0:1788986982.513175:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971472768:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986982.513186:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971472896:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986982.513196:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1517 00000100:00100000:1.0:1788986982.513205:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971473024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986982.513282:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971472896:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 91us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986982.513282:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971472768:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 110us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986982.513304:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1982 00000100:00100000:0.0:1788986982.513320:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1497 00000100:00100000:3.0:1788986982.513347:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1518 00000100:00100000:3.0:1788986982.513357:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971473152:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986982.519453:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971473024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 6235us (6482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986982.519468:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1517 00000100:00080000:2.0:1788986982.520279:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788986982.520290:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788986982.520294:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788986982.521408:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971473152:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 8026us (8324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986982.521427:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1518 10000000:01000000:3.0:1788986982.596309:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788986982.596320:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788986982.596326:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788986982.596386:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986982.596400:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986982.596414:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986982.596446:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993666560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788986982.596561:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986982.596633:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76628d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788986982.596745:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993666560 00000100:00100000:2.0:1788986982.596757:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993666560 00000100:00100000:2.0:1788986982.596832:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1498 00000100:00100000:2.0:1788986982.596843:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993666560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788986982.596864:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788986982.596882:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7dc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a7d5 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986982.596918:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a7d5 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986982.596931:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a7d5 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986982.596943:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1c00, rc 0) 00000100:00100000:2.0:1788986982.597013:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993666560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986982.597030:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1498 00000100:00100000:3.0:1788986982.597433:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993666560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986982.597454:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a7dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986982.597465:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a7dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986982.597502:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788986982.597509:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a7dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986982.597518:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a7dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986983.493787:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986984.460353:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993666688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788986984.460462:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986984.460574:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993666688 00000100:00100000:3.0:1788986984.460584:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993666688 00000100:00100000:3.0:1788986984.460658:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1788986984.460668:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993666688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986984.460711:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986984.462508:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993666688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1829us (2034us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986984.462525:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00080000:3.0:1788986984.462569:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788986984.462686:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993666688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788986984.513266:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788986985.339801:0:102580:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff44cb2c50 20000000:00000080:0.0:1788986985.339823:0:102580:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a794af800 uarg=0000000000000000 00010000:00010000:0.0:1788986985.340704:0:102580:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788986985.340724:0:102580:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788986985.340747:0:102580:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788986985.340769:0:102580:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986985.340790:0:102580:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7dc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a7d5 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986985.340800:0:102580:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986985.340847:0:102580:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a7d5 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986985.340866:0:102580:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7dc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a7d5 expref: 18 pid: 5848 timeout: 2869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788986985.340959:0:102580:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102580:1875885993666816:0@lo:104: 00000100:00100000:0.0:1788986985.341324:0:102580:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986985.341447:0:102580:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a4577a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788986985.341592:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993666816 00000100:00100000:1.0:1788986985.341602:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993666816 00000100:00100000:1.0:1788986985.341695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 397 00000100:00100000:1.0:1788986985.341707:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:102580:x1875885993666816:12345-0@lo:104: 00010000:00010000:1.0:1788986985.341724:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a7dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788986985.341808:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788986985.341816:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:102580:x1875885993666816:12345-0@lo:104: Request processed in 112us (494us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986985.341825:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 397 00000100:00100000:2.0:1788986985.341915:0:102580:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:102580:1875885993666816:0@lo:104: 00010000:00010000:2.0:1788986985.341939:0:102580:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342020:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788986985.342029:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a7dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342038:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788986985.342042:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a7dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342052:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a7dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788986985.342061:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a7dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788986985.342068:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788986985.342126:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a7dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342134:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788986985.342160:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a7dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342169:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a7d5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a7dc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342190:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986985.342192:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986985.342194:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986985.342202:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986985.342215:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993666944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788986985.342252:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986985.342286:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993666944 00000100:00100000:3.0:1788986985.342290:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993666944 00010000:00010000:3.0:1788986985.342313:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7dc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a7d5 expref: 19 pid: 5848 timeout: 2869 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788986985.342338:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1788986985.342346:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993666944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788986985.342358:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788986985.342363:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7dc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a7d5 expref: 19 pid: 5848 timeout: 2869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342375:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7dc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a7d5 expref: 19 pid: 5848 timeout: 2869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342388:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1c00/0xc20d828fcf54a7dc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a7d5 expref: 19 pid: 5848 timeout: 2869 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342416:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342426:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342448:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342457:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342465:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342472:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342478:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788986985.342483:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342491:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342503:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986985.342512:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788986985.342541:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993666944:12345-0@lo:103:ldlm_bl.0 Request processed in 196us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986985.342548:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00000100:00100000:3.0:1788986985.342581:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993666944:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788986985.342661:0:102580:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986985.342670:0:102580:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986985.342677:0:102580:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54a7e3 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 102580 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788986985.474579:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993667328:0@lo:400:kworker.0 00000100:00100000:1.0:1788986985.474672:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986985.474743:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788986985.474751:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993667456:0@lo:400:kworker.0 00000100:00100000:1.0:1788986985.474780:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986985.474819:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993667328 00000100:00100000:1.0:1788986985.474828:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993667328 00000100:00100000:1.0:1788986985.474886:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519 00000100:00100000:1.0:1788986985.474896:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993667328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986985.475062:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993667072:0@lo:400:kworker.0 00000100:00100000:0.0:1788986985.475156:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993667200:0@lo:400:kworker.0 00000100:00100000:2.0:1788986985.476936:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993667456 00000100:00100000:2.0:1788986985.476962:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993667456 00000100:00100000:2.0:1788986985.477064:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1983 00000100:00100000:2.0:1788986985.477080:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993667456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986985.477415:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986985.477475:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993667584:0@lo:400:kworker.0 00000100:00100000:3.0:1788986985.477510:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788986985.477564:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788986985.477578:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993667072 00000100:00100000:3.0:1788986985.477583:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993667072 00000100:00100000:3.0:1788986985.477615:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1788986985.477623:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993667072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986985.477665:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993667072:12345-0@lo:400:kworker.0 Request processed in 43us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986985.477673:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1984 00000100:00100000:3.0:1788986985.477701:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993667584 00000100:00100000:3.0:1788986985.477705:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993667584 00000100:00100000:3.0:1788986985.477740:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:3.0:1788986985.477747:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993667584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986985.477779:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993667584:12345-0@lo:400:kworker.0 Request processed in 33us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986985.477785:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00080000:3.0:1788986985.477803:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788986985.477836:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993667072:0@lo:400:kworker.0 00000100:00100000:3.0:1788986985.477847:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993667584:0@lo:400:kworker.0 00000100:00100000:0.0:1788986985.482144:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986985.482258:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993667200 00000100:00100000:0.0:1788986985.482269:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993667200 00000100:00100000:0.0:1788986985.482330:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1985 00000100:00100000:0.0:1788986985.482340:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993667200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986985.482402:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993667200:12345-0@lo:400:kworker.0 Request processed in 64us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986985.482409:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1985 00000100:00100000:0.0:1788986985.482877:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993667200:0@lo:400:kworker.0 00000100:00080000:3.0:1788986985.483758:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986985.486119:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993667328:12345-0@lo:400:kworker.0 Request processed in 11192us (11415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986985.486136:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519 00000100:00100000:3.0:1788986985.487213:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993667328:0@lo:400:kworker.0 00000100:00100000:2.0:1788986985.496313:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993667456:12345-0@lo:400:kworker.0 Request processed in 19223us (21516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986985.496333:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1983 00000100:00100000:1.0:1788986985.496498:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993667456:0@lo:400:kworker.0 00010000:00010000:3.0:1788986985.537228:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986985.986745:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993667712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788986985.986846:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986985.993353:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993667712 00000100:00100000:0.0:1788986985.993371:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993667712 00000100:00100000:0.0:1788986985.993454:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1788986985.993477:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993667712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986985.993530:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986985.993750:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941836680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993667712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 286us (6902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986985.993757:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1788986985.994045:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993667712:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986986.561179:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788986986.817168:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788986986.817176:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788986986.817182:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788986986.817223:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986986.817236:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788986986.817248:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788986986.817272:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993667840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788986986.817331:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788986986.817395:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09428c49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788986986.817652:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993667840 00000100:00100000:3.0:1788986986.817660:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993667840 00000100:00100000:3.0:1788986986.817716:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1499 00000100:00100000:3.0:1788986986.817725:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993667840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788986986.817737:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788986986.817750:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a7f1 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a7ea expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986986.817773:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a7f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a7ea expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986986.817783:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a7f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a7ea expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788986986.817791:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3c00, rc 0) 00000100:00100000:3.0:1788986986.817839:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993667840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986986.817846:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1499 00000100:00100000:0.0:1788986986.817903:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993667840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788986986.817922:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a7f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986986.817933:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a7f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788986986.817952:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788986986.817957:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a7f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986986.817965:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a7f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788986987.585466:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986987.633194:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986987.633231:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986987.633263:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986987.633296:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986987.633325:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971473408 00000100:00100000:3.0:1788986987.633333:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971473408 00000100:00100000:3.0:1788986987.633392:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1986 00000100:00100000:3.0:1788986987.633402:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971473408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986987.633492:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971473408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 91us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986987.633499:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1986 00000100:00100000:3.0:1788986987.633528:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971473536 00000100:00100000:3.0:1788986987.633532:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971473536 00000100:00100000:3.0:1788986987.633558:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971473664 00000100:00100000:3.0:1788986987.633561:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971473664 00000100:00100000:3.0:1788986987.633580:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1521 00000100:00100000:3.0:1788986987.633587:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971473536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986987.633613:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971473536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986987.633619:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1521 00000100:00100000:3.0:1788986987.633631:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1522 00000100:00100000:3.0:1788986987.633637:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971473664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986987.633675:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971473664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986987.633681:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1522 00000100:00080000:3.0:1788986987.633696:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986987.633699:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986987.633701:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986987.634304:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971473280 00000100:00100000:0.0:1788986987.634309:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971473280 00000100:00100000:0.0:1788986987.634349:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1500 00000100:00100000:0.0:1788986987.634358:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971473280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986987.634399:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971473280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 43us (1214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986987.634406:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1500 00010000:00010000:3.0:1788986988.608210:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986989.568750:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788986989.568777:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993667968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788986989.568853:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986989.569006:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993667968 00000100:00100000:0.0:1788986989.569014:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993667968 00000100:00100000:0.0:1788986989.569082:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1788986989.569112:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993667968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788986989.569147:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986989.569195:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993667968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986989.569202:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1788986989.569257:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993667968:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788986989.569410:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788986989.636206:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986990.593271:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993668352:0@lo:400:kworker.0 00000100:00100000:3.0:1788986990.593313:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993668224:0@lo:400:kworker.0 00000100:00100000:3.0:1788986990.593361:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986990.593392:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993668480:0@lo:400:kworker.0 00000100:00100000:3.0:1788986990.593411:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993668736:0@lo:400:kworker.0 00000100:00100000:1.0:1788986990.593423:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986990.593439:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993668224 00000100:00100000:3.0:1788986990.593447:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993668224 00000100:00100000:1.0:1788986990.593451:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788986990.593456:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993668096:0@lo:400:kworker.0 00000100:00100000:1.0:1788986990.593487:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986990.593504:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1987 00000100:00100000:1.0:1788986990.593507:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993668608:0@lo:400:kworker.0 00000100:00100000:3.0:1788986990.593513:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993668224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986990.593525:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986990.593550:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993668480 00000100:00100000:3.0:1788986990.593553:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993668224:12345-0@lo:400:kworker.0 Request processed in 41us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986990.593554:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993668480 00000100:00100000:3.0:1788986990.593560:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1987 00000100:00100000:3.0:1788986990.593574:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993668608 00000100:00100000:3.0:1788986990.593576:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993668608 00000100:00100000:1.0:1788986990.593580:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:1.0:1788986990.593585:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993668480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986990.593602:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1988 00000100:00100000:3.0:1788986990.593607:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993668608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986990.593617:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993668480:12345-0@lo:400:kworker.0 Request processed in 33us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986990.593623:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:3.0:1788986990.593630:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993668608:12345-0@lo:400:kworker.0 Request processed in 23us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986990.593635:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1988 00000100:00100000:1.0:1788986990.593642:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986990.593669:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993668096 00000100:00100000:3.0:1788986990.593672:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993668096 00000100:00100000:1.0:1788986990.593676:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993668224:0@lo:400:kworker.0 00000100:00100000:3.0:1788986990.593691:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:3.0:1788986990.593698:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993668096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986990.593698:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993668736 00000100:00100000:1.0:1788986990.593701:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993668736 00000100:00100000:1.0:1788986990.593724:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:3.0:1788986990.593725:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993668096:12345-0@lo:400:kworker.0 Request processed in 29us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986990.593730:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993668736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986990.593731:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00080000:3.0:1788986990.593758:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788986990.593760:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993668736:12345-0@lo:400:kworker.0 Request processed in 30us (116us total) trans 0 rc 0/0 00000100:00080000:3.0:1788986990.593762:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986990.593765:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:1.0:1788986990.593786:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993668096:0@lo:400:kworker.0 00000100:00100000:1.0:1788986990.593795:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993668608:0@lo:400:kworker.0 00000100:00100000:1.0:1788986990.593803:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993668480:0@lo:400:kworker.0 00000100:00100000:1.0:1788986990.593826:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993668736:0@lo:400:kworker.0 00000100:00100000:2.0:1788986990.593879:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986990.594259:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993668352 00000100:00100000:1.0:1788986990.594264:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993668352 00000100:00100000:1.0:1788986990.594358:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1989 00000100:00100000:1.0:1788986990.594366:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993668352:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788986990.594371:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986990.594411:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993668352:12345-0@lo:400:kworker.0 Request processed in 46us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986990.594417:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1989 00000100:00100000:3.0:1788986990.594566:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993668352:0@lo:400:kworker.0 00010000:00010000:3.0:1788986990.656648:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986991.105416:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788986991.107140:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993668864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788986991.107212:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986991.107728:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993668864 00000100:00100000:0.0:1788986991.107737:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993668864 00000100:00100000:0.0:1788986991.107789:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:0.0:1788986991.107799:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993668864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788986991.107832:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788986991.107877:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993668864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986991.107883:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1788986991.109106:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993668864:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788986991.681556:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788986992.704475:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986992.752174:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986992.752339:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986992.752375:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986992.752405:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788986992.752443:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971473920 00000100:00100000:3.0:1788986992.752451:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971473920 00000100:00100000:3.0:1788986992.752506:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1990 00000100:00100000:3.0:1788986992.752516:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971473920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986992.752521:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971474048 00000100:00100000:1.0:1788986992.752526:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971474048 00000100:00100000:1.0:1788986992.752552:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971474176 00000100:00100000:1.0:1788986992.752555:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971474176 00000100:00100000:1.0:1788986992.752573:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1525 00000100:00100000:1.0:1788986992.752580:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971474048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788986992.752581:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971473920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 67us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986992.752588:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1990 00000100:00080000:3.0:1788986992.752607:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788986992.752611:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788986992.752613:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986992.752619:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971474048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 39us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986992.752624:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1525 00000100:00100000:1.0:1788986992.752636:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1526 00000100:00100000:1.0:1788986992.752642:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971474176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986992.752667:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971474176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986992.752672:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1526 00000100:00100000:0.0:1788986992.752852:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971473792 00000100:00100000:0.0:1788986992.752856:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971473792 00000100:00100000:0.0:1788986992.752893:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1502 00000100:00100000:0.0:1788986992.752909:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971473792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788986992.753062:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971473792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 161us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986992.753070:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1502 00010000:00010000:0.0:1788986993.729498:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986994.691424:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993668992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788986994.691521:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986994.691627:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993668992 00000100:00100000:1.0:1788986994.691638:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993668992 00000100:00080000:3.0:1788986994.691703:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788986994.691715:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:1.0:1788986994.691727:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993668992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788986994.691770:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788986994.691832:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993668992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986994.691841:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:3.0:1788986994.691977:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993668992:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788986994.753205:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788986995.130972:0:102925:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 23a: test mapped regular ACLs ========= 16:49:53 (1788986993) 00000100:00100000:1.0:1788986995.714660:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993669120:0@lo:400:kworker.0 00000100:00100000:1.0:1788986995.714776:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986995.714961:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993669120 00000100:00100000:0.0:1788986995.715178:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993669120 00000100:00100000:0.0:1788986995.715336:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:0.0:1788986995.715349:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993669120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788986995.719671:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993669504:0@lo:400:kworker.0 00000100:00100000:3.0:1788986995.719755:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788986995.720823:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993669120:0@lo:400:kworker.0 00000100:00100000:1.0:1788986995.721033:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993669504 00000100:00100000:1.0:1788986995.721041:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993669504 00000100:00100000:0.0:1788986995.721572:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993669120:12345-0@lo:400:kworker.0 Request processed in 6219us (6788us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986995.721586:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:0.0:1788986995.721666:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993669376:0@lo:400:kworker.0 00000100:00100000:0.0:1788986995.721715:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986995.721752:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788986995.721759:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993669248:0@lo:400:kworker.0 00000100:00100000:0.0:1788986995.721780:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986995.721813:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993669376 00000100:00100000:0.0:1788986995.721820:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993669376 00000100:00100000:0.0:1788986995.721869:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993669248 00000100:00100000:0.0:1788986995.721873:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993669248 00000100:00100000:0.0:1788986995.721896:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1991 00000100:00100000:0.0:1788986995.721904:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993669376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986995.721972:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993669376:12345-0@lo:400:kworker.0 Request processed in 60us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986995.721979:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1991 00000100:00100000:0.0:1788986995.721993:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1992 00000100:00100000:0.0:1788986995.721999:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993669248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986995.722025:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993669248:12345-0@lo:400:kworker.0 Request processed in 27us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986995.722042:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1992 00000100:00100000:0.0:1788986995.722076:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993669248:0@lo:400:kworker.0 00000100:00100000:0.0:1788986995.722086:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993669376:0@lo:400:kworker.0 00000100:00080000:0.0:1788986995.722148:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788986995.723528:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:1.0:1788986995.723550:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993669504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788986995.723654:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993669504:12345-0@lo:400:kworker.0 Request processed in 112us (3899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986995.723661:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:3.0:1788986995.725769:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993669504:0@lo:400:kworker.0 00000100:00100000:2.0:1788986995.727335:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788986995.727364:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993669760:0@lo:400:kworker.0 00000100:00100000:2.0:1788986995.727471:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986995.727524:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788986995.727557:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993669632:0@lo:400:kworker.0 00000100:00100000:3.0:1788986995.727629:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788986995.727743:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993669760 00000100:00100000:0.0:1788986995.727754:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993669760 00000100:00100000:0.0:1788986995.727824:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:0.0:1788986995.727834:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993669760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788986995.727887:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993669760:12345-0@lo:400:kworker.0 Request processed in 55us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986995.727893:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:2.0:1788986995.727994:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993669632 00000100:00100000:2.0:1788986995.728001:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993669632 00000100:00100000:2.0:1788986995.728058:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1993 00000100:00100000:2.0:1788986995.728066:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993669632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788986995.728157:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993669632:12345-0@lo:400:kworker.0 Request processed in 91us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986995.728165:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1993 00000100:00100000:2.0:1788986995.728224:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993669760:0@lo:400:kworker.0 00000100:00100000:1.0:1788986995.728237:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993669632:0@lo:400:kworker.0 00000100:00080000:3.0:1788986995.728604:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788986995.728610:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788986995.776405:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788986996.225677:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788986996.225708:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993669888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788986996.225801:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986996.226024:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993669888 00000100:00100000:3.0:1788986996.226034:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993669888 00000100:00100000:3.0:1788986996.226128:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:3.0:1788986996.226140:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993669888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788986996.226184:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47513600 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986996.226244:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993669888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986996.226251:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:0.0:1788986996.226646:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993669888:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788986996.800211:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788986996.860026:0:102973:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_23a Need 2 clients at least 00010000:00010000:0.0:1788986997.828116:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788986997.877611:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986997.877931:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986997.878193:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971474432 00000100:00100000:2.0:1788986997.878206:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971474432 00000100:00100000:2.0:1788986997.878290:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1994 00000100:00100000:2.0:1788986997.878303:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971474432:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788986997.878628:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971474432:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 327us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788986997.878637:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1994 00000100:00080000:2.0:1788986997.878664:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788986997.880031:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971474304 00000100:00100000:0.0:1788986997.880045:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971474304 00000100:00100000:1.0:1788986997.880165:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1504 00000100:00100000:1.0:1788986997.880180:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971474304:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788986997.880256:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971474304:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 79us (2659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788986997.880264:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1504 00000100:00100000:2.0:1788986997.897541:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788986997.897727:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788986997.903059:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971474560 00000100:00100000:1.0:1788986997.903077:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971474560 00000100:00100000:0.0:1788986997.903158:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971474688 00000100:00100000:0.0:1788986997.903164:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971474688 00000100:00100000:0.0:1788986997.903252:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 688 00000100:00100000:0.0:1788986997.903266:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971474688:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:0.0:1788986997.903307:0:6698:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54a153 00000100:00080000:0.0:1788986997.903329:0:6698:0:(import.c:65:import_set_state_nolock()) ffff9b0a76747000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788986997.903385:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:0.0:1788986997.903851:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971474688:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 587us (6122us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986997.903860:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 688 00010000:00010000:0.0:1788986997.903890:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788986997.903931:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 689 00000100:00100000:0.0:1788986997.903949:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971474560:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:0.0:1788986997.903967:0:6697:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54a0a4 00000100:00080000:0.0:1788986997.903973:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b0942ce1800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788986997.903997:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:0.0:1788986997.904196:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+2:2345:x1875885971474560:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 247us (6670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788986997.904204:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 689 00010000:00010000:0.0:1788986997.904224:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788986997.904602:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788986997.904608:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:1.0:1788986998.710862:0:103021:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 23b: test mapped default ACLs ========= 16:49:56 (1788986996) 00010000:00010000:1.0:1788986998.848947:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788986999.808514:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788986999.808545:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993670016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788986999.808641:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788986999.808723:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993670016 00000100:00100000:3.0:1788986999.808732:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993670016 00000100:00100000:3.0:1788986999.808810:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1788986999.808822:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993670016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788986999.808870:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788986999.808933:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993670016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788986999.808941:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:3.0:1788986999.809002:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993670016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788986999.812796:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788986999.872203:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788986999.904672:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788986999.904684:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b0a76743800/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788986999.904722:0:100526:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a76743800/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0001 00000020:00000080:1.0:1788986999.904779:0:100526:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a76747000 for lustre-OST0001 00000001:00100000:1.0:1788986999.911535:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788986999.911548:0:6721:0:(genops.c:885:class_export_put()) final put ffff9b0942ce6000/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:0.0:1788986999.917233:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0942ce6000/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-OST0000 00000020:00000080:0.0:1788986999.917332:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0942ce1800 for lustre-OST0000 00000001:02000400:0.0:1788987000.206963:0:103070:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: SKIP: sanity-sec test_23b Need 2 clients at least 00000100:00100000:2.0:1788987000.832775:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993670272:0@lo:400:kworker.0 00000100:00100000:2.0:1788987000.832848:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987000.832955:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788987000.832971:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993670144:0@lo:400:kworker.0 00000100:00100000:1.0:1788987000.833004:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987000.833054:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993670144 00000100:00100000:1.0:1788987000.833061:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993670144 00000100:00100000:1.0:1788987000.833135:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:1.0:1788987000.833144:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993670144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987000.833192:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993670144:12345-0@lo:400:kworker.0 Request processed in 49us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987000.833199:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:1.0:1788987000.833248:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993670144:0@lo:400:kworker.0 00000100:00100000:1.0:1788987000.835976:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993670400:0@lo:400:kworker.0 00000100:00100000:1.0:1788987000.836043:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987000.836507:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993670272 00000100:00100000:3.0:1788987000.836517:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993670272 00000100:00100000:3.0:1788987000.836577:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993670400 00000100:00100000:3.0:1788987000.836580:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993670400 00000100:00100000:3.0:1788987000.836610:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1995 00000100:00100000:3.0:1788987000.836619:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993670272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987000.836702:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1996 00000100:00100000:1.0:1788987000.836711:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993670400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987000.836747:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993670400:12345-0@lo:400:kworker.0 Request processed in 38us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987000.836754:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1996 00000100:00100000:1.0:1788987000.836794:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993670400:0@lo:400:kworker.0 00000100:00080000:0.0:1788987000.841559:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987000.841581:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993670656:0@lo:400:kworker.0 00000100:00100000:0.0:1788987000.841649:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987000.841697:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788987000.841703:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993670528:0@lo:400:kworker.0 00000100:00100000:0.0:1788987000.841728:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987000.841764:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993670656 00000100:00100000:0.0:1788987000.841771:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993670656 00000100:00100000:0.0:1788987000.841821:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1997 00000100:00100000:0.0:1788987000.841829:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993670656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987000.841882:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993670656:12345-0@lo:400:kworker.0 Request processed in 54us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987000.841889:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1997 00000100:00080000:0.0:1788987000.841909:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987000.842249:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993670528 00000100:00100000:1.0:1788987000.842254:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993670528 00000100:00100000:1.0:1788987000.842285:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:1.0:1788987000.842291:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993670528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987000.842341:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993670528:12345-0@lo:400:kworker.0 Request processed in 50us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987000.842347:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00100000:1.0:1788987000.842374:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788987000.842383:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993670784:0@lo:400:kworker.0 00000100:00100000:1.0:1788987000.842526:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987000.842552:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993670784 00000100:00100000:1.0:1788987000.842556:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993670784 00000100:00100000:1.0:1788987000.842583:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:1.0:1788987000.842589:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993670784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987000.842622:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993670784:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987000.842628:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00080000:1.0:1788987000.842642:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788987000.842668:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993670784:0@lo:400:kworker.0 00000100:00100000:3.0:1788987000.842763:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993670272:12345-0@lo:400:kworker.0 Request processed in 6144us (9914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987000.842771:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1995 00000100:00100000:2.0:1788987000.843114:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993670272:0@lo:400:kworker.0 00000100:00100000:0.0:1788987000.843545:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993670656:0@lo:400:kworker.0 00000100:00100000:0.0:1788987000.843568:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993670528:0@lo:400:kworker.0 00010000:00010000:1.0:1788987000.896298:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987001.344315:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993670912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788987001.344443:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987001.344664:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993670912 00000100:00100000:3.0:1788987001.344677:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993670912 00000100:00100000:3.0:1788987001.344750:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:3.0:1788987001.344762:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993670912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788987001.344822:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987001.352765:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993670912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788987001.353351:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993670912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8587us (8910us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987001.353367:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000001:02000400:0.0:1788987001.886312:0:103119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 24: check nodemap proc files for LBUGs and Oopses ========================================================== 16:50:00 (1788987000) 00010000:00010000:0.0:1788987001.924218:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987002.949475:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:1.0:1788987002.962159:0:103167:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:1.0:1788987002.974885:0:103167:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000100:00100000:3.0:1788987002.993286:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987002.994936:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987002.994970:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971474816 00000100:00100000:0.0:1788987002.994978:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971474816 00000100:00100000:0.0:1788987002.995020:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1506 00000100:00100000:0.0:1788987002.995029:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971474816:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987002.995102:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971474816:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 60us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987002.995110:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1506 00000100:00100000:1.0:1788987002.995303:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971474944 00000100:00100000:1.0:1788987002.995308:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971474944 00000100:00100000:1.0:1788987002.995357:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1998 00000100:00100000:1.0:1788987002.995366:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971474944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788987002.995401:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971474944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (2124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987002.995408:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1998 00000100:00080000:0.0:1788987002.995469:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:2.0:1788987003.783575:0:103215:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcc3742560 20000000:00000080:2.0:1788987003.783594:0:103215:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094197e800 uarg=0000000000000000 10000000:01000000:2.0:1788987003.784300:0:103215:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987003.784322:0:103215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.784343:0:103215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a7f1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a7ea expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.784353:0:103215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.784616:0:103215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a7f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a7ea expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.784632:0:103215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a7f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a7ea expref: 18 pid: 5849 timeout: 2887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987003.784646:0:103215:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103215:1875885993671040:0@lo:104: 00000100:00100000:2.0:1788987003.784708:0:103215:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987003.784763:0:103215:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7feff240 going to sleep for 11 seconds 00000100:00100000:0.0:1788987003.785084:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788987003.785281:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993671040 00000100:00100000:2.0:1788987003.785289:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993671040 00000100:00100000:2.0:1788987003.785341:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:2.0:1788987003.785349:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80857450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:103215:x1875885993671040:12345-0@lo:104: 00010000:00010000:2.0:1788987003.785362:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a7f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.785500:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788987003.785507:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80857450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:103215:x1875885993671040:12345-0@lo:104: Request processed in 159us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987003.785517:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00000100:00100000:0.0:1788987003.785679:0:103215:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103215:1875885993671040:0@lo:104: 00010000:00010000:0.0:1788987003.785696:0:103215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987003.785741:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987003.785748:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a7f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987003.785756:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987003.785760:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a7f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987003.785768:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a7f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987003.785786:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a7f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987003.785792:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788987003.785825:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a7f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987003.785832:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987003.786283:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a7f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987003.786293:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1000/0xc20d828fcf54a7ea lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a7f1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987003.786310:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987003.786313:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987003.786315:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987003.786349:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788987003.786365:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993671168:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788987003.786504:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987003.786663:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993671168 00000100:00100000:2.0:1788987003.786669:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993671168 00010000:00010000:2.0:1788987003.786694:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a7f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a7ea expref: 19 pid: 5849 timeout: 2887 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987003.786726:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:2.0:1788987003.786734:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993671168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987003.786746:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987003.786750:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a7f1 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a7ea expref: 19 pid: 5849 timeout: 2887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.786760:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a7f1 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a7ea expref: 19 pid: 5849 timeout: 2887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.786784:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a7f1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a7ea expref: 19 pid: 5849 timeout: 2887 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.786799:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.786807:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.786820:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.786827:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.786839:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.786856:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.786862:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987003.786866:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.786872:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987003.787567:0:103215:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987003.787643:0:103215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 5/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.789180:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.789199:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a7f8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987003.789216:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987003.789295:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993671168:12345-0@lo:103:ldlm_bl.0 Request processed in 2559us (2788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987003.789305:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00000100:00100000:0.0:1788987003.789480:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993671168:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987003.973076:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788987004.546036:0:103263:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffddfc0c320 20000000:00000080:3.0:1788987004.546051:0:103263:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a796fe000 uarg=0000000000000000 10000000:01000000:3.0:1788987004.546318:0:103263:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788987004.546335:0:103263:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a7ff lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987004.546350:0:103263:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a7ff lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987004.546361:0:103263:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a7ff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987004.546376:0:103263:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a7ff lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987004.546382:0:103263:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a7ff lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987004.546389:0:103263:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a7ff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987004.546395:0:103263:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987004.546399:0:103263:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a7ff lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987004.546407:0:103263:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a7ff lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987004.546419:0:103263:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a7ff lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987004.546427:0:103263:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a7ff lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987004.546434:0:103263:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a7ff lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103263 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987004.928226:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788987004.928247:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993671296:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987004.928508:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987004.930061:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993671296 00000100:00100000:2.0:1788987004.930073:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993671296 00000100:00100000:2.0:1788987004.930151:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:2.0:1788987004.930161:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993671296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788987004.930192:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987004.930267:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993671296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (1759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987004.930275:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1788987004.935145:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993671296:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788987004.940375:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788987004.996341:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788987005.556920:0:103312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc5ab30e0 20000000:00000080:3.0:1788987005.556939:0:103312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a796fd400 uarg=0000000000000000 10000000:01000000:3.0:1788987005.557499:0:103312:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788987005.557522:0:103312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a806 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987005.557539:0:103312:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a806 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987005.557550:0:103312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a806 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987005.557556:0:103312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a806 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987005.557567:0:103312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a806 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987005.557575:0:103312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a806 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987005.557582:0:103312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987005.557586:0:103312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a806 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987005.557594:0:103312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a806 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987005.557609:0:103312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a806 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987005.557618:0:103312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a806 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987005.557624:0:103312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a806 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987005.701799:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788987005.701805:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788987005.701809:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788987005.701849:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987005.701860:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987005.701874:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987005.701907:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993671424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788987005.701964:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987005.702013:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51df26c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788987005.702397:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993671424 00000100:00100000:0.0:1788987005.702405:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993671424 00000100:00100000:0.0:1788987005.702450:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:0.0:1788987005.702459:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993671424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987005.702470:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788987005.702483:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a814 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a80d expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987005.702505:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a814 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a80d expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987005.702514:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a814 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a80d expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987005.702522:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788987005.702566:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993671424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987005.702572:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:0.0:1788987005.702614:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993671424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987005.702627:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a814 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987005.702635:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a814 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987005.702652:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788987005.702657:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a814 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987005.702664:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a814 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987005.953209:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993671680:0@lo:400:kworker.0 00000100:00100000:1.0:1788987005.953209:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993671936:0@lo:400:kworker.0 00000100:00100000:3.0:1788987005.953233:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993671808:0@lo:400:kworker.0 00000100:00100000:0.0:1788987005.953280:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993671552:0@lo:400:kworker.0 00000100:00100000:1.0:1788987005.953951:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987005.955618:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993671936 00000100:00100000:1.0:1788987005.955632:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993671936 00000100:00100000:1.0:1788987005.955704:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1999 00000100:00100000:1.0:1788987005.955716:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993671936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987005.955807:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993671936:12345-0@lo:400:kworker.0 Request processed in 95us (1857us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987005.955813:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1999 00000100:00080000:1.0:1788987005.955835:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987005.956720:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993671936:0@lo:400:kworker.0 00000100:00100000:2.0:1788987005.958678:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987005.961649:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987005.961778:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993671680 00000100:00100000:3.0:1788987005.961791:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993671680 00000100:00100000:3.0:1788987005.961876:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2000 00000100:00100000:3.0:1788987005.961888:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993671680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987005.961993:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993671680:12345-0@lo:400:kworker.0 Request processed in 108us (3321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987005.962001:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2000 00000100:00080000:3.0:1788987005.962027:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987005.962820:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993671808 00000100:00100000:2.0:1788987005.962834:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993671808 00000100:00100000:2.0:1788987005.962904:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1788987005.962914:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993671808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987005.963005:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993671808:12345-0@lo:400:kworker.0 Request processed in 92us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987005.963012:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1788987005.963066:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993671680:0@lo:400:kworker.0 00000100:00100000:3.0:1788987005.963236:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993671808:0@lo:400:kworker.0 00000100:00100000:0.0:1788987005.964328:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987005.964390:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993671552 00000100:00100000:2.0:1788987005.964397:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993671552 00000100:00100000:0.0:1788987005.964417:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993672064:0@lo:400:kworker.0 00000100:00100000:2.0:1788987005.964437:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2001 00000100:00100000:2.0:1788987005.964445:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993671552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987005.964467:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987005.964489:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993671552:12345-0@lo:400:kworker.0 Request processed in 45us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987005.964495:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2001 00000100:00100000:0.0:1788987005.964531:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993671552:0@lo:400:kworker.0 00000100:00100000:1.0:1788987005.964625:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993672064 00000100:00100000:1.0:1788987005.964635:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993672064 00000100:00100000:1.0:1788987005.964998:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:1.0:1788987005.965005:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993672064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987005.965615:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993672064:0@lo:400:kworker.0 00000100:00100000:1.0:1788987005.965681:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993672064:12345-0@lo:400:kworker.0 Request processed in 43us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987005.965691:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00080000:2.0:1788987005.969585:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788987006.016345:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987006.464929:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993672192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788987006.465001:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987006.465878:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993672192 00000100:00100000:0.0:1788987006.465898:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993672192 00000100:00100000:0.0:1788987006.465951:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:0.0:1788987006.465959:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993672192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987006.465992:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987006.466126:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993672192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 167us (1124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987006.466133:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1788987006.476952:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993672192:0@lo:13:osp-pre-1-0.0 00000020:00000080:3.0:1788987006.697945:0:103360:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffecc066440 20000000:00000080:3.0:1788987006.697964:0:103360:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511e3400 uarg=0000000000000000 10000000:01000000:3.0:1788987006.698350:0:103360:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788987006.698370:0:103360:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987006.698388:0:103360:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a814 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a80d expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987006.698395:0:103360:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987006.698433:0:103360:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a814 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a80d expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987006.698448:0:103360:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a814 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a80d expref: 18 pid: 5848 timeout: 2890 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987006.698462:0:103360:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103360:1875885993672320:0@lo:104: 00000100:00100000:3.0:1788987006.698520:0:103360:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987006.698607:0:103360:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094390b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788987006.698648:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993672320 00000100:00100000:0.0:1788987006.698655:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993672320 00000100:00100000:0.0:1788987006.698725:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:0.0:1788987006.698734:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:103360:x1875885993672320:12345-0@lo:104: 00010000:00010000:0.0:1788987006.698746:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a814 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987006.698806:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987006.698812:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:103360:x1875885993672320:12345-0@lo:104: Request processed in 80us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987006.698818:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00010000:00010000:2.0:1788987006.698859:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788987006.698866:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a814 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.698873:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788987006.698877:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a814 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.698895:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a814 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788987006.698902:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a814 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987006.698908:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788987006.698938:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a814 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.698945:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788987006.698965:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a814 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.698972:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2800/0xc20d828fcf54a80d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a814 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.698989:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987006.698991:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987006.698993:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987006.699012:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993672448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788987006.699043:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987006.699080:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993672448 00000100:00100000:2.0:1788987006.699085:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993672448 00010000:00010000:2.0:1788987006.699133:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a814 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a80d expref: 19 pid: 5848 timeout: 2890 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987006.699157:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1788987006.699164:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993672448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987006.699175:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987006.699180:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a814 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a80d expref: 19 pid: 5848 timeout: 2890 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.699190:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a814 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a80d expref: 19 pid: 5848 timeout: 2890 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.699205:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.699214:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.699228:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.699235:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.699242:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.699249:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.699255:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987006.699259:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.699267:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.699276:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987006.699287:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987006.699319:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993672448:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987006.699325:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1788987006.699367:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993672448:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987006.699448:0:103360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a814 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a80d expref: 18 pid: 5848 timeout: 2890 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987006.699458:0:103360:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103360:1875885993672320:0@lo:104: 00010000:00010000:3.0:1788987006.699470:0:103360:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987006.699477:0:103360:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987006.699483:0:103360:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987006.699488:0:103360:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a81b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103360 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987007.040332:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788987007.638536:0:103411:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff23f0f910 20000000:00000080:1.0:1788987007.638553:0:103411:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f3e6c00 uarg=0000000000000000 10000000:01000000:1.0:1788987007.638942:0:103411:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788987007.638961:0:103411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a822 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987007.638976:0:103411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a822 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987007.638991:0:103411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a822 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987007.638997:0:103411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a822 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987007.639003:0:103411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a822 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987007.639010:0:103411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a822 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987007.639017:0:103411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788987007.639021:0:103411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a822 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987007.639028:0:103411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a822 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987007.639039:0:103411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a822 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987007.639046:0:103411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a822 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987007.639052:0:103411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a822 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987008.064540:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987008.112586:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987008.112631:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987008.113003:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971475200 00000100:00100000:2.0:1788987008.113013:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971475200 00000100:00100000:2.0:1788987008.113115:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2002 00000100:00100000:2.0:1788987008.113127:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971475200:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987008.113197:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971475200:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 73us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987008.113204:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2002 00000100:00080000:0.0:1788987008.116117:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987008.116517:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971475072 00000100:00100000:3.0:1788987008.116528:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971475072 00000100:00100000:0.0:1788987008.116717:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1508 00000100:00100000:0.0:1788987008.116729:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971475072:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987008.116794:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971475072:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (4162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987008.116801:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1508 10000000:01000000:2.0:1788987008.384192:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788987008.384200:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788987008.384204:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788987008.384263:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987008.384274:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987008.384286:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987008.384309:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993672576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788987008.384379:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987008.384445:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f3c13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788987008.384541:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993672576 00000100:00100000:3.0:1788987008.384548:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993672576 00000100:00100000:3.0:1788987008.384603:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:3.0:1788987008.384612:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993672576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987008.384624:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788987008.384636:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a830 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a829 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.384658:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a829 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.384669:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a829 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.384678:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3800, rc 0) 00000100:00100000:3.0:1788987008.384726:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993672576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987008.384732:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:2.0:1788987008.384852:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993672576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987008.384865:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a830 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987008.384875:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a830 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987008.384913:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788987008.384918:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a830 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987008.384927:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a830 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788987008.571007:0:103459:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff463b78e0 20000000:00000080:3.0:1788987008.571021:0:103459:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511e2000 uarg=0000000000000000 10000000:01000000:3.0:1788987008.571288:0:103459:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788987008.571305:0:103459:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.571320:0:103459:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a830 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a829 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.571327:0:103459:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.571431:0:103459:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a829 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.571450:0:103459:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a830 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a829 expref: 18 pid: 5849 timeout: 2892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987008.571465:0:103459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103459:1875885993672704:0@lo:104: 00000100:00100000:3.0:1788987008.571527:0:103459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987008.571638:0:103459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b69c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788987008.571714:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993672704 00000100:00100000:2.0:1788987008.571721:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993672704 00000100:00100000:2.0:1788987008.571885:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 400 00000100:00100000:2.0:1788987008.571895:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:103459:x1875885993672704:12345-0@lo:104: 00010000:00010000:2.0:1788987008.571908:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a830 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987008.571985:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788987008.571992:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:103459:x1875885993672704:12345-0@lo:104: Request processed in 99us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987008.571999:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 400 00010000:00010000:0.0:1788987008.572050:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788987008.572057:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a830 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987008.572066:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788987008.572070:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a830 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987008.572079:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a830 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788987008.572112:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a830 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987008.572119:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788987008.572148:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a830 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987008.572155:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788987008.572186:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a830 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987008.572194:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1800/0xc20d828fcf54a829 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a830 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987008.572210:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987008.572212:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987008.572214:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987008.572343:0:103459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103459:1875885993672704:0@lo:104: 00010000:00010000:3.0:1788987008.572372:0:103459:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987008.572484:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993672832:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788987008.572517:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987008.572666:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993672832 00000100:00100000:3.0:1788987008.572671:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993672832 00010000:00010000:3.0:1788987008.572692:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a830 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a829 expref: 19 pid: 5849 timeout: 2892 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987008.572763:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1788987008.572771:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993672832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987008.572782:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788987008.572787:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a830 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a829 expref: 19 pid: 5849 timeout: 2892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.572797:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a830 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a829 expref: 19 pid: 5849 timeout: 2892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.572810:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a830 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a829 expref: 19 pid: 5849 timeout: 2892 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.572824:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.572833:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.572846:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.572854:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.572861:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.572868:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.572874:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987008.572890:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.572898:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.572918:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987008.572928:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788987008.572963:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993672832:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987008.572970:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00010000:00010000:0.0:1788987008.573015:0:103459:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987008.573023:0:103459:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987008.573030:0:103459:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54a837 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987008.575561:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993672832:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987009.089254:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987010.048603:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993672960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788987010.048669:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987010.050160:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993672960 00000100:00100000:3.0:1788987010.050171:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993672960 00000100:00100000:3.0:1788987010.050225:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:3.0:1788987010.050234:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993672960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987010.050265:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788987010.050533:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788987010.050921:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993672960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 686us (2250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987010.050931:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:2.0:1788987010.050954:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993672960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788987010.116377:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788987010.305157:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788987010.305165:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788987010.305169:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788987010.305218:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987010.305231:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987010.305242:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987010.305272:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993673088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788987010.305354:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987010.305406:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788987010.305475:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993673088 00000100:00100000:1.0:1788987010.305483:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993673088 00000100:00100000:1.0:1788987010.305530:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:1.0:1788987010.305539:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993673088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987010.305554:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987010.305567:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a845 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a83e expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987010.305590:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a845 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a83e expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987010.305600:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a845 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a83e expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987010.305608:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788987010.305653:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993673088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987010.305660:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000100:00100000:2.0:1788987010.305749:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993673088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987010.305773:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a845 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987010.305784:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a845 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987010.305805:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788987010.305810:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a845 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987010.305818:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a845 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987011.074180:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993673600:0@lo:400:kworker.0 00000100:00100000:3.0:1788987011.074340:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987011.074366:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993673216:0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.074399:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987011.074421:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993673728:0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.074450:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987011.074492:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993673472:0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.074521:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987011.074546:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987011.074554:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993673344:0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.074580:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987011.074619:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993673600 00000100:00100000:1.0:1788987011.074629:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993673600 00000100:00100000:1.0:1788987011.074706:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993673216 00000100:00100000:1.0:1788987011.074710:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993673216 00000100:00100000:1.0:1788987011.074732:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2003 00000100:00100000:1.0:1788987011.074742:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993673600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.074803:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993673600:12345-0@lo:400:kworker.0 Request processed in 62us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987011.074811:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2003 00000100:00100000:1.0:1788987011.074829:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993673344 00000100:00100000:1.0:1788987011.074832:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993673344 00000100:00100000:1.0:1788987011.074848:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2004 00000100:00100000:1.0:1788987011.074853:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993673216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.074901:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993673216:12345-0@lo:400:kworker.0 Request processed in 47us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987011.074908:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2004 00000100:00100000:1.0:1788987011.074920:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2005 00000100:00100000:1.0:1788987011.074926:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993673344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.074957:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993673344:12345-0@lo:400:kworker.0 Request processed in 31us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987011.074963:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2005 00000100:00100000:1.0:1788987011.074984:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993673728 00000100:00100000:1.0:1788987011.074987:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993673728 00000100:00100000:1.0:1788987011.075012:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993673472 00000100:00100000:1.0:1788987011.075015:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993673472 00000100:00100000:1.0:1788987011.075035:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:1.0:1788987011.075041:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993673728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.075073:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993673728:12345-0@lo:400:kworker.0 Request processed in 33us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987011.075080:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00100000:1.0:1788987011.075132:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:1.0:1788987011.075139:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993673472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.075168:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993673472:12345-0@lo:400:kworker.0 Request processed in 30us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987011.075173:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00080000:1.0:1788987011.075195:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788987011.075200:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987011.075266:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993673344:0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.075278:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993673472:0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.075310:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993673216:0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.075320:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993673728:0@lo:400:kworker.0 00000100:00100000:1.0:1788987011.076140:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993673600:0@lo:400:kworker.0 00010000:00010000:3.0:1788987011.137419:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788987011.294256:0:103607:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe23ea62f0 20000000:00000080:0.0:1788987011.294278:0:103607:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0941f06c00 uarg=0000000000000000 10000000:01000000:0.0:1788987011.294535:0:103607:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788987011.294553:0:103607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987011.294570:0:103607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a845 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a83e expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987011.294579:0:103607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987011.294619:0:103607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a845 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a83e expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987011.294636:0:103607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a845 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a83e expref: 18 pid: 5848 timeout: 2895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987011.294652:0:103607:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103607:1875885993673856:0@lo:104: 00000100:00100000:0.0:1788987011.294726:0:103607:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987011.294928:0:103607:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a765823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788987011.295286:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993673856 00000100:00100000:3.0:1788987011.295294:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993673856 00000100:00100000:3.0:1788987011.295430:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 401 00000100:00100000:3.0:1788987011.295441:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:103607:x1875885993673856:12345-0@lo:104: 00010000:00010000:3.0:1788987011.295454:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a845 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987011.295522:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788987011.295528:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:103607:x1875885993673856:12345-0@lo:104: Request processed in 90us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987011.295536:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 401 00010000:00010000:2.0:1788987011.295579:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788987011.295586:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a845 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.295593:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788987011.295597:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a845 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.295605:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a845 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788987011.295611:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a845 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987011.295617:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788987011.295652:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a845 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.295658:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788987011.295679:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a845 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.295690:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54a83e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a845 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.295710:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987011.295711:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987011.295713:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987011.295742:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788987011.295754:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993673984:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788987011.295800:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987011.295843:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993673984 00000100:00100000:2.0:1788987011.295847:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993673984 00010000:00010000:2.0:1788987011.295891:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a845 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a83e expref: 19 pid: 5848 timeout: 2895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987011.295914:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1788987011.295921:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45612450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993673984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987011.295931:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987011.295937:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a845 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a83e expref: 19 pid: 5848 timeout: 2895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.295946:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a845 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a83e expref: 19 pid: 5848 timeout: 2895 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.295962:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.295971:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.295991:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.295998:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.296005:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.296011:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.296016:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987011.296020:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.296028:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.296037:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987011.296047:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987011.296072:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45612450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993673984:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987011.296078:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 00000100:00100000:2.0:1788987011.296268:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993673984:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987011.296615:0:103607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a845 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a83e expref: 18 pid: 5848 timeout: 2895 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987011.296626:0:103607:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103607:1875885993673856:0@lo:104: 00010000:00010000:0.0:1788987011.296642:0:103607:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987011.296651:0:103607:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987011.296657:0:103607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987011.296668:0:103607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a84c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987011.586029:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788987011.586051:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993674112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788987011.586147:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987011.586313:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993674112 00000100:00100000:0.0:1788987011.586321:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993674112 00000100:00100000:0.0:1788987011.586371:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:0.0:1788987011.586379:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993674112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987011.586417:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987011.586463:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993674112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987011.586470:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1788987011.586549:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993674112:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788987012.004770:0:103655:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffee456a5f0 20000000:00000080:1.0:1788987012.004785:0:103655:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a42c4bc00 uarg=0000000000000000 10000000:01000000:1.0:1788987012.004981:0:103655:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788987012.004999:0:103655:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a853 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987012.005016:0:103655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a853 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987012.005026:0:103655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a853 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987012.005032:0:103655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a853 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987012.005039:0:103655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a853 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987012.005046:0:103655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a853 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987012.005052:0:103655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788987012.005056:0:103655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a853 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987012.005063:0:103655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a853 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987012.005074:0:103655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a853 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987012.005081:0:103655:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a853 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987012.005215:0:103655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a853 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103655 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987012.167621:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788987012.480380:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788987012.480390:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788987012.480396:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788987012.480441:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987012.480453:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987012.480464:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987012.480492:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993674240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788987012.480569:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987012.480645:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094395fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788987012.480838:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993674240 00000100:00100000:3.0:1788987012.480850:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993674240 00000100:00100000:3.0:1788987012.480918:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:3.0:1788987012.480929:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993674240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987012.480943:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788987012.480955:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a861 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a85a expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987012.480977:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a861 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a85a expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987012.480988:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a861 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a85a expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987012.480996:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788987012.481958:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993674240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1026us (1385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987012.481968:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:2.0:1788987012.482268:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993674240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987012.482293:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a861 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987012.482305:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a861 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987012.482327:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788987012.482333:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a861 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987012.482340:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a861 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987013.184422:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987013.236967:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987013.237023:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987013.237033:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971475456 00000100:00100000:1.0:1788987013.237046:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971475456 00000100:00080000:3.0:1788987013.237108:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987013.237114:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971475328 00000100:00100000:2.0:1788987013.237121:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971475328 00000100:00100000:1.0:1788987013.237138:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2006 00000100:00100000:1.0:1788987013.237152:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971475456:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987013.237165:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1512 00000100:00100000:2.0:1788987013.237176:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971475328:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987013.237240:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2347:x1875885971475328:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 65us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987013.237241:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2347:x1875885971475456:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 92us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987013.237253:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1512 00000100:00100000:1.0:1788987013.237256:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2006 00010000:00010000:2.0:1788987014.208478:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987015.170938:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993674368:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788987015.171007:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987015.171070:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993674368 00000100:00100000:0.0:1788987015.171077:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993674368 00000100:00080000:2.0:1788987015.171150:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788987015.171154:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1788987015.171163:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993674368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788987015.171191:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987015.171243:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993674368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987015.171249:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1788987015.171336:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993674368:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788987015.232480:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788987015.422233:0:103853:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd24bfabb0 20000000:00000080:3.0:1788987015.422251:0:103853:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511e1800 uarg=0000000000000000 00010000:00010000:3.0:1788987015.423013:0:103853:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788987015.423028:0:103853:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788987015.423042:0:103853:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788987015.423064:0:103853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987015.423085:0:103853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a861 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a85a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987015.423120:0:103853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987015.423162:0:103853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a861 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a85a expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987015.423178:0:103853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a861 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a85a expref: 18 pid: 5846 timeout: 2899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987015.423194:0:103853:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103853:1875885993674496:0@lo:104: 00000100:00100000:3.0:1788987015.423260:0:103853:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987015.423396:0:103853:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a59f5c780 going to sleep for 11 seconds 00000100:00100000:0.0:1788987015.423738:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993674496 00000100:00100000:0.0:1788987015.423747:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993674496 00000100:00100000:0.0:1788987015.423834:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 402 00000100:00100000:0.0:1788987015.423854:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:103853:x1875885993674496:12345-0@lo:104: 00010000:00010000:0.0:1788987015.423867:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a861 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987015.423967:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987015.423982:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:103853:x1875885993674496:12345-0@lo:104: Request processed in 133us (714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987015.423990:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 402 00010000:00010000:2.0:1788987015.424029:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788987015.424036:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a861 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424044:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788987015.424048:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a861 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424057:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a861 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788987015.424065:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a861 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987015.424071:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788987015.424121:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a861 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424129:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788987015.424150:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a861 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424158:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0a00/0xc20d828fcf54a85a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a861 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424173:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987015.424174:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987015.424176:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987015.424191:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788987015.424201:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993674624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788987015.424233:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987015.424272:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993674624 00000100:00100000:2.0:1788987015.424276:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993674624 00010000:00010000:2.0:1788987015.424293:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a861 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a85a expref: 19 pid: 5846 timeout: 2899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987015.424327:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1788987015.424334:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993674624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987015.424344:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987015.424349:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a861 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a85a expref: 19 pid: 5846 timeout: 2899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424358:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a861 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a85a expref: 19 pid: 5846 timeout: 2899 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424373:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424381:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424395:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424401:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424407:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424413:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424418:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987015.424422:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424430:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424439:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987015.424449:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987015.424476:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993674624:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987015.424495:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00000100:00100000:2.0:1788987015.424536:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993674624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987015.425372:0:103853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a861 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a85a expref: 18 pid: 5846 timeout: 2899 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987015.425388:0:103853:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:103853:1875885993674496:0@lo:104: 00010000:00010000:3.0:1788987015.425408:0:103853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987015.425416:0:103853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987015.425422:0:103853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987015.425427:0:103853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a868 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 103853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987016.192307:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993675136:0@lo:400:kworker.0 00000100:00100000:2.0:1788987016.192885:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993674752:0@lo:400:kworker.0 00000100:00100000:2.0:1788987016.192953:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987016.193027:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993675264:0@lo:400:kworker.0 00000100:00100000:2.0:1788987016.193055:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987016.193137:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987016.193171:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788987016.193173:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993674752 00000100:00100000:1.0:1788987016.193179:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993675008:0@lo:400:kworker.0 00000100:00100000:0.0:1788987016.193184:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993674752 00000100:00100000:1.0:1788987016.193219:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993675136 00000100:00100000:1.0:1788987016.193225:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993675136 00000100:00100000:0.0:1788987016.193248:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:0.0:1788987016.193261:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993674752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987016.193267:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00100000:1.0:1788987016.193277:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993675136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987016.193330:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993675136:12345-0@lo:400:kworker.0 Request processed in 54us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987016.193341:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00100000:0.0:1788987016.193341:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993674752:12345-0@lo:400:kworker.0 Request processed in 81us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987016.193360:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:2.0:1788987016.193543:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993674752:0@lo:400:kworker.0 00000100:00100000:2.0:1788987016.193572:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788987016.193580:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993674880:0@lo:400:kworker.0 00000100:00100000:2.0:1788987016.193606:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987016.194152:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993675392:0@lo:400:kworker.0 00000100:00100000:2.0:1788987016.194185:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987016.194230:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993675392 00000100:00100000:2.0:1788987016.194235:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993675392 00000100:00100000:2.0:1788987016.194282:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:2.0:1788987016.194300:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993675392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987016.194509:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993675392:12345-0@lo:400:kworker.0 Request processed in 65us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987016.194517:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00080000:2.0:1788987016.194542:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788987016.194765:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987016.194828:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993675264 00000100:00100000:3.0:1788987016.194844:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993675264 00000100:00100000:0.0:1788987016.194953:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993674880 00000100:00100000:0.0:1788987016.194958:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993674880 00000100:00100000:0.0:1788987016.194990:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2007 00000100:00100000:0.0:1788987016.194999:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993675264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987016.195044:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993675264:12345-0@lo:400:kworker.0 Request processed in 47us (1988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987016.195051:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2007 00000100:00100000:0.0:1788987016.195065:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2008 00000100:00100000:0.0:1788987016.195071:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993674880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987016.195115:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993674880:12345-0@lo:400:kworker.0 Request processed in 45us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987016.195122:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2008 00000100:00100000:2.0:1788987016.195236:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993675136:0@lo:400:kworker.0 00000100:00100000:2.0:1788987016.195267:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993675008 00000100:00100000:2.0:1788987016.195270:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993675008 00000100:00100000:2.0:1788987016.195514:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2009 00000100:00100000:2.0:1788987016.195524:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993675008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987016.195579:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993675008:12345-0@lo:400:kworker.0 Request processed in 57us (1018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987016.195590:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2009 00000100:00080000:2.0:1788987016.195923:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987016.195955:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993675008:0@lo:400:kworker.0 00000100:00100000:2.0:1788987016.195997:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993674880:0@lo:400:kworker.0 00000100:00100000:2.0:1788987016.196011:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993675392:0@lo:400:kworker.0 00000100:00100000:2.0:1788987016.196024:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993675264:0@lo:400:kworker.0 00010000:00010000:2.0:1788987016.258198:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987016.704573:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993675520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788987016.704694:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987016.705202:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993675520 00000100:00100000:1.0:1788987016.705215:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993675520 00000100:00100000:1.0:1788987016.705298:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:1.0:1788987016.705554:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993675520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788987016.705609:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987016.705895:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993675520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 345us (1200us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987016.705904:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1788987016.706003:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993675520:0@lo:13:osp-pre-1-0.0 10000000:01000000:2.0:1788987016.768188:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788987016.768199:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788987016.768205:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788987016.768262:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987016.768274:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987016.768287:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987016.768318:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993675648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788987016.768421:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987016.768502:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80e92b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788987016.768932:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993675648 00000100:00100000:0.0:1788987016.768941:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993675648 00000100:00100000:0.0:1788987016.769005:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:0.0:1788987016.769016:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993675648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987016.769034:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788987016.769052:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54a876 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a86f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987016.769080:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54a876 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a86f expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987016.769119:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54a876 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a86f expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987016.769130:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eee00, rc 0) 00000100:00100000:0.0:1788987016.769175:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993675648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987016.769182:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:2.0:1788987016.769613:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993675648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987016.769699:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a876 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987016.769772:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a876 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987016.769796:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788987016.769802:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a876 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987016.769810:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a876 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987017.281431:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987018.304692:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987018.366172:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987018.366299:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971475584 00000100:00100000:0.0:1788987018.366309:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971475584 00000100:00100000:0.0:1788987018.366383:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1515 00000100:00100000:0.0:1788987018.366394:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971475584:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987018.371741:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971475584:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5334us (5562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987018.371759:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1515 00000100:00100000:3.0:1788987018.372691:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987018.374979:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971475712 00000100:00100000:2.0:1788987018.375055:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971475712 00000100:00100000:2.0:1788987018.375157:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2010 00000100:00100000:2.0:1788987018.375167:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971475712:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987018.375269:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971475712:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 104us (2580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987018.375277:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2010 00000100:00080000:0.0:1788987018.375406:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788987019.328320:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987020.289340:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788987020.289362:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993675776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788987020.289432:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987020.289526:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993675776 00000100:00100000:0.0:1788987020.289534:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993675776 00000100:00100000:0.0:1788987020.289595:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1788987020.289604:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993675776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788987020.289639:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987020.289684:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993675776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987020.289690:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1788987020.289736:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993675776:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788987020.289779:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1788987020.341487:0:104097:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9d46d7b0 20000000:00000080:2.0:1788987020.341506:0:104097:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a76638800 uarg=0000000000000000 00010000:00010000:2.0:1788987020.344067:0:104097:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788987020.344085:0:104097:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788987020.344230:0:104097:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987020.344249:0:104097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987020.344267:0:104097:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54a876 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a86f expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987020.344275:0:104097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987020.344376:0:104097:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54a876 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a86f expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987020.344391:0:104097:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54a876 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a86f expref: 18 pid: 5849 timeout: 2904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987020.344403:0:104097:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104097:1875885993675904:0@lo:104: 00000100:00100000:2.0:1788987020.344460:0:104097:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987020.344520:0:104097:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f550300 going to sleep for 11 seconds 00000100:00100000:3.0:1788987020.344596:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993675904 00000100:00100000:3.0:1788987020.344603:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993675904 00000100:00100000:3.0:1788987020.344688:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 403 00000100:00100000:3.0:1788987020.344699:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:104097:x1875885993675904:12345-0@lo:104: 00010000:00010000:3.0:1788987020.344711:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a876 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987020.344774:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788987020.344781:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:104097:x1875885993675904:12345-0@lo:104: Request processed in 84us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987020.344787:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 403 00010000:00010000:0.0:1788987020.344841:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788987020.344848:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a876 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.344855:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1a00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788987020.344858:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a876 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.344867:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a876 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788987020.344874:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a876 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987020.344880:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:0.0:1788987020.344909:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a876 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.344915:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788987020.344934:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a876 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.344945:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1a00/0xc20d828fcf54a86f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a876 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.344958:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987020.344960:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987020.344961:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987020.344978:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993676032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788987020.345007:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987020.345044:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993676032 00000100:00100000:0.0:1788987020.345048:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993676032 00010000:00010000:0.0:1788987020.345067:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54a876 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a86f expref: 19 pid: 5849 timeout: 2904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987020.345109:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1788987020.345117:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993676032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987020.345127:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987020.345132:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54a876 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a86f expref: 19 pid: 5849 timeout: 2904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.345141:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54a876 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a86f expref: 19 pid: 5849 timeout: 2904 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.345155:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.345163:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.345180:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.345187:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.345194:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.345200:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.345205:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788987020.345209:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.345216:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.345224:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.345232:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788987020.345259:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993676032:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987020.345266:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1788987020.345313:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993676032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987020.345393:0:104097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eee00/0xc20d828fcf54a876 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a86f expref: 18 pid: 5849 timeout: 2904 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987020.345403:0:104097:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104097:1875885993675904:0@lo:104: 00010000:00010000:2.0:1788987020.345414:0:104097:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987020.345422:0:104097:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987020.345428:0:104097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987020.345434:0:104097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a87d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987020.358339:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788987021.236865:0:104145:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd43b4bc20 20000000:00000080:2.0:1788987021.236882:0:104145:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7601bc00 uarg=0000000000000000 00010000:00010000:2.0:1788987021.237108:0:104145:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788987021.237125:0:104145:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788987021.237145:0:104145:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987021.237166:0:104145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a884 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987021.237183:0:104145:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a884 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987021.237194:0:104145:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a884 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987021.237201:0:104145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a884 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987021.237208:0:104145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a884 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987021.237215:0:104145:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a884 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987021.237221:0:104145:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987021.237225:0:104145:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a884 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987021.237233:0:104145:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a884 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987021.237249:0:104145:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a884 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987021.237256:0:104145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a884 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987021.237262:0:104145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54a884 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987021.315412:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993676416:0@lo:400:kworker.0 00000100:00100000:3.0:1788987021.315490:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987021.315561:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788987021.315568:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993676288:0@lo:400:kworker.0 00000100:00100000:3.0:1788987021.315591:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987021.315608:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993676800:0@lo:400:kworker.0 00000100:00100000:3.0:1788987021.315629:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987021.315657:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993676416 00000100:00100000:3.0:1788987021.315665:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993676416 00000100:00100000:3.0:1788987021.315720:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993676288 00000100:00100000:3.0:1788987021.315724:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993676288 00000100:00100000:3.0:1788987021.315746:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2011 00000100:00100000:3.0:1788987021.315754:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993676416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987021.315803:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993676416:12345-0@lo:400:kworker.0 Request processed in 49us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987021.315822:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2011 00000100:00100000:2.0:1788987021.315838:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2012 00000100:00100000:2.0:1788987021.315846:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993676288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987021.315889:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993676288:12345-0@lo:400:kworker.0 Request processed in 45us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987021.315933:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993676544:0@lo:400:kworker.0 00000100:00100000:0.0:1788987021.315944:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993676160:0@lo:400:kworker.0 00000100:00100000:1.0:1788987021.315962:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987021.315974:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987021.315994:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993676800 00000100:00100000:0.0:1788987021.315996:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993676672:0@lo:400:kworker.0 00000100:00100000:1.0:1788987021.315997:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993676800 00000100:00100000:0.0:1788987021.316017:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987021.316022:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993676544 00000100:00100000:1.0:1788987021.316025:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993676544 00000100:00100000:1.0:1788987021.316043:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:0.0:1788987021.316045:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993676672 00000100:00100000:1.0:1788987021.316049:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993676800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987021.316049:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993676672 00000100:00100000:1.0:1788987021.316078:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993676800:12345-0@lo:400:kworker.0 Request processed in 30us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987021.316084:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00100000:3.0:1788987021.316114:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:3.0:1788987021.316121:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993676544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987021.316158:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993676544:12345-0@lo:400:kworker.0 Request processed in 38us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987021.316164:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00080000:3.0:1788987021.316179:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788987021.316179:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993676544:0@lo:400:kworker.0 00000100:00080000:3.0:1788987021.316183:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987021.316198:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993676288:0@lo:400:kworker.0 00000100:00100000:3.0:1788987021.316206:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993676800:0@lo:400:kworker.0 00000100:00100000:3.0:1788987021.316215:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993676416:0@lo:400:kworker.0 00000100:00100000:2.0:1788987021.325327:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2012 00000100:00100000:0.0:1788987021.332460:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2013 00000100:00100000:0.0:1788987021.332498:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993676672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987021.332638:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993676672:12345-0@lo:400:kworker.0 Request processed in 161us (16620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987021.332646:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2013 00000100:00100000:2.0:1788987021.332731:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993676672:0@lo:400:kworker.0 00000100:00100000:0.0:1788987021.341074:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993676160 00000100:00100000:0.0:1788987021.341205:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993676160 00000100:00100000:0.0:1788987021.341304:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1788987021.341315:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993676160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987021.341402:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993676160:12345-0@lo:400:kworker.0 Request processed in 89us (25426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987021.341409:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1788987021.343082:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993676160:0@lo:400:kworker.0 00010000:00010000:2.0:1788987021.376301:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788987021.766979:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788987021.766987:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788987021.766991:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788987021.767031:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987021.767043:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987021.767054:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987021.767078:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993676928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788987021.767158:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987021.767209:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a45b97840 going to sleep for 11 seconds 00000100:00100000:3.0:1788987021.767365:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993676928 00000100:00100000:3.0:1788987021.767374:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993676928 00000100:00100000:3.0:1788987021.767422:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:3.0:1788987021.767431:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993676928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987021.767443:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788987021.767455:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a892 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a88b expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987021.767475:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a892 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a88b expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987021.767486:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a892 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a88b expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987021.767495:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788987021.767532:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993676928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987021.767538:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:3.0:1788987021.767584:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993676928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987021.767598:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a892 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987021.767607:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a892 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987021.767624:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788987021.767628:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a892 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987021.767636:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a892 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987021.828067:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788987021.828103:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993677056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788987021.828167:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987021.828211:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993677056 00000100:00100000:0.0:1788987021.828219:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993677056 00000100:00100000:0.0:1788987021.828281:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1788987021.828291:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993677056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987021.828326:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987021.828376:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993677056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987021.828383:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:0.0:1788987021.828429:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993677056:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1788987022.141713:0:104194:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd72730840 20000000:00000080:2.0:1788987022.141732:0:104194:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0942783400 uarg=0000000000000000 00010000:00010000:2.0:1788987022.142421:0:104194:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788987022.142439:0:104194:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788987022.142457:0:104194:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987022.142476:0:104194:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987022.142563:0:104194:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a892 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a88b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987022.142578:0:104194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987022.142617:0:104194:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a892 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a88b expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987022.142630:0:104194:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a892 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a88b expref: 18 pid: 5846 timeout: 2906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987022.142644:0:104194:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104194:1875885993677184:0@lo:104: 00000100:00100000:2.0:1788987022.142705:0:104194:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987022.142800:0:104194:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a6b2f9180 going to sleep for 11 seconds 00000100:00100000:0.0:1788987022.142859:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993677184 00000100:00100000:0.0:1788987022.142867:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993677184 00000100:00100000:0.0:1788987022.142952:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 404 00000100:00100000:0.0:1788987022.142961:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:104194:x1875885993677184:12345-0@lo:104: 00010000:00010000:0.0:1788987022.142975:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a892 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987022.143051:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987022.143058:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:104194:x1875885993677184:12345-0@lo:104: Request processed in 99us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987022.143064:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 404 00010000:00010000:3.0:1788987022.143121:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987022.143128:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a892 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.143135:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987022.143138:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a892 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.143147:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a892 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987022.143153:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a892 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987022.143159:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788987022.143189:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a892 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.143195:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987022.143218:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a892 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.143225:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030c00/0xc20d828fcf54a88b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a892 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.143244:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987022.143246:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987022.143247:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987022.143356:0:104194:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80ca1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104194:1875885993677184:0@lo:104: 00010000:00010000:2.0:1788987022.143374:0:104194:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987022.144641:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788987022.144668:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993677312:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788987022.144742:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987022.144850:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993677312 00000100:00100000:3.0:1788987022.144859:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993677312 00010000:00010000:3.0:1788987022.144892:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a892 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a88b expref: 19 pid: 5846 timeout: 2906 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987022.144926:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1788987022.144935:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993677312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987022.144949:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788987022.144955:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a892 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a88b expref: 19 pid: 5846 timeout: 2906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.144966:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a892 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a88b expref: 19 pid: 5846 timeout: 2906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.144982:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a892 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a88b expref: 19 pid: 5846 timeout: 2906 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.145008:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.145017:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.145031:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.145038:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.145045:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.145051:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.145057:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987022.145061:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.145069:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.145083:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987022.145115:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788987022.145156:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993677312:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987022.145164:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00000100:00100000:3.0:1788987022.145207:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993677312:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987022.146434:0:104194:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987022.146451:0:104194:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987022.146458:0:104194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a899 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987022.401789:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788987023.235813:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788987023.235822:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788987023.235828:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788987023.235879:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987023.235890:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987023.235902:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987023.235929:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993677440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788987023.235995:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987023.236058:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094395fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788987023.236343:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993677440 00000100:00100000:1.0:1788987023.236351:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993677440 00000100:00100000:1.0:1788987023.236391:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:1.0:1788987023.236399:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993677440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987023.236413:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987023.236426:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a8a7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a8a0 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987023.236449:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a8a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a8a0 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987023.236461:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a8a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a8a0 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987023.236470:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030000, rc 0) 00000100:00100000:1.0:1788987023.236600:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993677440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987023.236607:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:2.0:1788987023.236680:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993677440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987023.236697:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a8a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987023.236707:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a8a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987023.236726:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788987023.236731:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a8a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987023.236739:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a8a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987023.427117:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987023.475165:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987023.475204:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987023.475282:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971475840 00000100:00100000:1.0:1788987023.475291:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971475840 00000100:00100000:1.0:1788987023.475344:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1519 00000100:00100000:1.0:1788987023.475355:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971475840:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788987023.475418:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971475840:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 64us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987023.475425:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1519 00000100:00100000:2.0:1788987023.475603:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971475968 00000100:00100000:2.0:1788987023.475608:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971475968 00000100:00100000:2.0:1788987023.475659:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2014 00000100:00100000:2.0:1788987023.475670:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971475968:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987023.475709:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971475968:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 43us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987023.475716:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2014 00000100:00080000:1.0:1788987023.475779:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788987024.448370:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987025.411383:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788987025.411409:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993677568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788987025.411470:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987025.412292:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993677568 00000100:00100000:0.0:1788987025.412303:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993677568 00000100:00100000:0.0:1788987025.412375:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:0.0:1788987025.412386:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993677568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788987025.412424:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987025.412482:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993677568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987025.412489:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00080000:0.0:1788987025.412509:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788987025.414330:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993677568:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788987025.472438:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788987025.854867:0:104391:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffc56390e0 20000000:00000080:2.0:1788987025.855214:0:104391:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0942781400 uarg=0000000000000000 00010000:00010000:2.0:1788987025.857624:0:104391:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 00010000:00010000:2.0:1788987025.857642:0:104391:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 0. 10000000:01000000:2.0:1788987025.857661:0:104391:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987025.857679:0:104391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987025.857698:0:104391:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a8a7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a8a0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987025.857707:0:104391:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987025.857749:0:104391:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a8a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a8a0 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987025.857764:0:104391:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a8a7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a8a0 expref: 18 pid: 5848 timeout: 2909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987025.857779:0:104391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104391:1875885993677696:0@lo:104: 00000100:00100000:2.0:1788987025.858447:0:104391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987025.858540:0:104391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a50309d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788987025.863002:0:7642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788987025.863032:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993677696 00000100:00100000:3.0:1788987025.863043:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993677696 00000100:00100000:3.0:1788987025.863139:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 405 00000100:00100000:3.0:1788987025.863151:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941f04050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:104391:x1875885993677696:12345-0@lo:104: 00010000:00010000:3.0:1788987025.863181:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a8a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987025.863298:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788987025.863304:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941f04050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:104391:x1875885993677696:12345-0@lo:104: Request processed in 157us (4859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987025.863313:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 405 00010000:00010000:3.0:1788987025.863368:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788987025.863375:0:104391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104391:1875885993677696:0@lo:104: 00010000:00010000:3.0:1788987025.863376:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a8a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987025.863389:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efe00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987025.863395:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a8a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863406:0:104391:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987025.863410:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a8a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987025.863424:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a8a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987025.863431:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788987025.863478:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a8a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987025.863486:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987025.863507:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a8a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987025.863515:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a8a0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a8a7 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987025.863535:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987025.863538:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987025.863540:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987025.863555:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993677824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788987025.863587:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987025.863687:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993677824 00000100:00100000:0.0:1788987025.863692:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993677824 00010000:00010000:0.0:1788987025.863718:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a8a7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a8a0 expref: 19 pid: 5848 timeout: 2909 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987025.863749:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00000100:00100000:0.0:1788987025.863756:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993677824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987025.863768:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987025.863774:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a8a7 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a8a0 expref: 19 pid: 5848 timeout: 2909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863796:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a8a7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a8a0 expref: 19 pid: 5848 timeout: 2909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863811:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030000/0xc20d828fcf54a8a7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a8a0 expref: 19 pid: 5848 timeout: 2909 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863826:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863835:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863849:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863858:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863866:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863873:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863879:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788987025.863884:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863891:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863910:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863919:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788987025.863950:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993677824:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987025.863958:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00010000:00010000:0.0:1788987025.863991:0:104391:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.863999:0:104391:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987025.864006:0:104391:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0200/0xc20d828fcf54a8ae lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987025.865734:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993677824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788987026.432618:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993678080:0@lo:400:kworker.0 00000100:00100000:0.0:1788987026.432635:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993678208:0@lo:400:kworker.0 00000100:00100000:2.0:1788987026.432705:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987026.432767:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993677952:0@lo:400:kworker.0 00000100:00100000:2.0:1788987026.432796:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993678592:0@lo:400:kworker.0 00000100:00100000:1.0:1788987026.432827:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993678336:0@lo:400:kworker.0 00000100:00100000:0.0:1788987026.436657:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987026.436738:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993678080 00000100:00100000:0.0:1788987026.436747:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993678080 00000100:00100000:0.0:1788987026.436798:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993678208 00000100:00100000:0.0:1788987026.436801:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993678208 00000100:00100000:1.0:1788987026.437510:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987026.437681:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2015 00000100:00100000:0.0:1788987026.437691:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993678080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987026.437746:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993678080:12345-0@lo:400:kworker.0 Request processed in 57us (5041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987026.437753:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2015 00000100:00100000:0.0:1788987026.437769:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2016 00000100:00100000:0.0:1788987026.437775:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993678208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987026.437869:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993678208:0@lo:400:kworker.0 00000100:00100000:3.0:1788987026.437947:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987026.437985:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993678464:0@lo:400:kworker.0 00000100:00100000:3.0:1788987026.438013:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987026.438127:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993677952 00000100:00100000:1.0:1788987026.438133:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993677952 00000100:00100000:1.0:1788987026.438163:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:1.0:1788987026.438240:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993677952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987026.438280:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993677952:12345-0@lo:400:kworker.0 Request processed in 43us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987026.438287:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:3.0:1788987026.438415:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993677952:0@lo:400:kworker.0 00000100:00100000:2.0:1788987026.438773:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987026.438826:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993678336 00000100:00100000:2.0:1788987026.438829:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993678080:0@lo:400:kworker.0 00000100:00100000:1.0:1788987026.438833:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993678336 00000100:00100000:2.0:1788987026.438863:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993678464 00000100:00100000:2.0:1788987026.438868:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993678464 00000100:00100000:1.0:1788987026.438869:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993678592 00000100:00100000:1.0:1788987026.438874:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993678592 00000100:00100000:2.0:1788987026.438898:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2017 00000100:00100000:2.0:1788987026.438907:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993678464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987026.438909:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:1.0:1788987026.438923:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993678336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987026.438957:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993678464:12345-0@lo:400:kworker.0 Request processed in 51us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987026.438967:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2017 00000100:00100000:1.0:1788987026.438983:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993678336:12345-0@lo:400:kworker.0 Request processed in 62us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987026.438992:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:0.0:1788987026.438994:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993678208:12345-0@lo:400:kworker.0 Request processed in 52us (1177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987026.438999:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:0.0:1788987026.439011:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2016 00000100:00100000:2.0:1788987026.439015:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993678592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987026.439039:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993678336:0@lo:400:kworker.0 00000100:00080000:0.0:1788987026.439045:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788987026.439052:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987026.439059:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993678592:12345-0@lo:400:kworker.0 Request processed in 49us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987026.439066:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:2.0:1788987026.439159:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993678464:0@lo:400:kworker.0 00000100:00100000:2.0:1788987026.439181:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993678592:0@lo:400:kworker.0 00010000:00010000:0.0:1788987026.496758:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987026.944440:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987026.944464:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993678720:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788987026.944532:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987026.944749:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993678720 00000100:00100000:0.0:1788987026.944758:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993678720 00000100:00100000:0.0:1788987026.944820:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:0.0:1788987026.944830:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993678720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987026.944861:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987026.944913:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993678720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987026.944920:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1788987026.945057:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993678720:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788987027.528336:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788987027.649357:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788987027.649365:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788987027.649370:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788987027.649411:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987027.649423:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987027.649436:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987027.649464:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993678848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788987027.649540:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987027.649598:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76628d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788987027.649901:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993678848 00000100:00100000:3.0:1788987027.649909:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993678848 00000100:00100000:3.0:1788987027.649977:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:3.0:1788987027.649987:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993678848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987027.650000:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788987027.650015:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a8bc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a8b5 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987027.650039:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a8bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a8b5 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987027.650049:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a8bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a8b5 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987027.650058:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788987027.650131:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993678848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987027.650138:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:3.0:1788987027.650189:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993678848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987027.650205:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a8bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987027.650214:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a8bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987027.650233:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788987027.650239:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a8bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987027.650451:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a8bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987028.544359:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987028.592586:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987028.592633:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987028.592831:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971476224 00000100:00100000:2.0:1788987028.592842:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971476224 00000100:00100000:2.0:1788987028.592914:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2018 00000100:00100000:2.0:1788987028.592924:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971476224:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:3.0:1788987028.592964:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987028.593011:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2348:x1875885971476224:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 88us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987028.593018:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2018 00000100:00100000:1.0:1788987028.593477:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971476096 00000100:00100000:1.0:1788987028.593483:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971476096 00000100:00100000:1.0:1788987028.593600:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1522 00000100:00100000:1.0:1788987028.593608:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971476096:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788987028.593647:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2348:x1875885971476096:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987028.593659:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1522 00010000:00010000:1.0:1788987029.572567:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987030.532235:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993678976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788987030.532329:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987030.532857:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993678976 00000100:00100000:0.0:1788987030.532865:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993678976 00000100:00100000:0.0:1788987030.532930:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1788987030.532938:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993678976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788987030.532969:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987030.533022:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993678976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987030.533029:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00080000:1.0:1788987030.534131:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788987030.534180:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993678976:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788987030.592381:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987031.554265:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788987031.554286:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993679104:0@lo:400:kworker.0 00000100:00100000:1.0:1788987031.554317:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993679360:0@lo:400:kworker.0 00000100:00100000:3.0:1788987031.554415:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993679616:0@lo:400:kworker.0 00000100:00100000:1.0:1788987031.555531:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987031.555602:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788987031.555612:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993679232:0@lo:400:kworker.0 00000100:00100000:1.0:1788987031.555647:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987031.555673:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993679744:0@lo:400:kworker.0 00000100:00100000:1.0:1788987031.555704:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987031.555759:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993679360 00000100:00100000:1.0:1788987031.555767:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993679360 00000100:00100000:1.0:1788987031.555824:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993679232 00000100:00100000:1.0:1788987031.555828:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993679232 00000100:00100000:1.0:1788987031.555856:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2019 00000100:00100000:1.0:1788987031.555867:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993679360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987031.555926:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993679360:12345-0@lo:400:kworker.0 Request processed in 62us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987031.555934:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2019 00000100:00100000:1.0:1788987031.555955:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2020 00000100:00100000:1.0:1788987031.555963:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993679232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987031.555992:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993679232:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987031.555999:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2020 00000100:00080000:1.0:1788987031.556017:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987031.556052:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993679232:0@lo:400:kworker.0 00000100:00100000:1.0:1788987031.556063:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993679360:0@lo:400:kworker.0 00000100:00100000:2.0:1788987031.556456:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987031.556498:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993679104 00000100:00100000:1.0:1788987031.556503:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993679104 00000100:00100000:2.0:1788987031.556513:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993679488:0@lo:400:kworker.0 00000100:00100000:1.0:1788987031.556533:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:1.0:1788987031.556542:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993679104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987031.556549:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987031.556593:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993679744 00000100:00100000:2.0:1788987031.556598:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993679744 00000100:00100000:1.0:1788987031.556600:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993679104:12345-0@lo:400:kworker.0 Request processed in 59us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987031.556607:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:2.0:1788987031.556637:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993679488 00000100:00100000:2.0:1788987031.556641:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993679488 00000100:00100000:2.0:1788987031.556670:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:2.0:1788987031.556676:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993679744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987031.556717:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993679744:12345-0@lo:400:kworker.0 Request processed in 41us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987031.556723:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:1.0:1788987031.556873:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:1.0:1788987031.556884:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993679488:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788987031.556900:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788987031.556924:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993679744:0@lo:400:kworker.0 00000100:00100000:1.0:1788987031.556930:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993679488:12345-0@lo:400:kworker.0 Request processed in 49us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987031.556938:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:2.0:1788987031.556955:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993679488:0@lo:400:kworker.0 00000100:00100000:2.0:1788987031.556964:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993679104:0@lo:400:kworker.0 00000100:00100000:3.0:1788987031.556997:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987031.557825:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993679616 00000100:00100000:2.0:1788987031.557832:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993679616 00000100:00100000:2.0:1788987031.557897:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2021 00000100:00100000:2.0:1788987031.557905:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993679616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987031.557962:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993679616:12345-0@lo:400:kworker.0 Request processed in 58us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987031.557969:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2021 00000100:00100000:2.0:1788987031.558001:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993679616:0@lo:400:kworker.0 00000100:00080000:1.0:1788987031.558072:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788987031.621351:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987032.064675:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993679872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788987032.064742:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987032.064917:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993679872 00000100:00100000:0.0:1788987032.064925:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993679872 00000100:00100000:0.0:1788987032.064982:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1788987032.064991:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993679872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987032.065026:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987032.065110:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993679872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987032.065117:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:2.0:1788987032.065483:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993679872:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788987032.640367:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987033.665174:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987033.713035:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987033.713085:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987033.713217:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971476480 00000100:00100000:2.0:1788987033.713229:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971476480 00000100:00100000:2.0:1788987033.713308:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2022 00000100:00100000:2.0:1788987033.713319:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971476480:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987033.713405:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2346:x1875885971476480:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 88us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987033.713412:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2022 00000100:00100000:1.0:1788987033.713606:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971476352 00000100:00100000:1.0:1788987033.713611:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971476352 00000100:00100000:1.0:1788987033.713650:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1524 00000100:00100000:1.0:1788987033.713658:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971476352:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788987033.713693:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971476352:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 37us (671us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987033.713699:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1524 00000100:00080000:0.0:1788987033.713811:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788987034.691830:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788987034.932031:0:104735:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 25a: test save and reload nodemap config ========================================================== 16:50:33 (1788987033) 00000100:00100000:1.0:1788987035.652545:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788987035.652577:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993680000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788987035.652663:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987035.652791:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993680000 00000100:00100000:3.0:1788987035.652801:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993680000 00000100:00100000:3.0:1788987035.652875:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1788987035.652885:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993680000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987035.652922:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987035.652968:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993680000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987035.652976:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00080000:1.0:1788987035.653499:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788987035.653549:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993680000:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788987035.712542:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987036.223440:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987036.223566:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971476608 00000100:00100000:1.0:1788987036.223578:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971476608 00000100:00100000:1.0:1788987036.223675:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1249 00000100:00100000:1.0:1788987036.223685:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+5:62782:x1875885971476608:12345-192.168.206.21@tcp:101:lsof.0 00010000:00010000:1.0:1788987036.223707:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987036.223746:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a8c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d179e expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987036.223825:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a8ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987036.223840:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a8ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987036.223863:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a8ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788987036.223911:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788987036.223915:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788987036.223960:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a8ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987036.223983:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40031a00/0xc20d828fcf54a8c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d179e expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987036.224008:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a8ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d179e expref: 6 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987036.224016:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:1.0:1788987036.224019:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788987036.224023:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00100000:1.0:1788987036.224150:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d307e018-a913-49dd-8d34-07b37c8ccf58+6:62782:x1875885971476608:12345-192.168.206.21@tcp:101:lsof.0 Request processed in 467us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987036.224158:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1249 00000100:00080000:0.0:1788987036.224368:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987036.672486:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993680512:0@lo:400:kworker.0 00000100:00100000:3.0:1788987036.672504:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993680384:0@lo:400:kworker.0 00000100:00100000:1.0:1788987036.672570:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993680128:0@lo:400:kworker.0 00000100:00100000:2.0:1788987036.672595:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993680256:0@lo:400:kworker.0 00000100:00100000:3.0:1788987036.675584:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987036.675683:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993680384 00000100:00100000:3.0:1788987036.675692:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993680384 00000100:00100000:3.0:1788987036.675763:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2023 00000100:00100000:3.0:1788987036.675775:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993680384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987036.675998:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993680384:12345-0@lo:400:kworker.0 Request processed in 226us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987036.676006:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2023 00000100:00080000:3.0:1788987036.676029:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987036.676058:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993680384:0@lo:400:kworker.0 00000100:00100000:0.0:1788987036.679304:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987036.682797:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993680512 00000100:00100000:3.0:1788987036.682811:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993680512 00000100:00100000:3.0:1788987036.682869:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:3.0:1788987036.682879:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993680512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987036.682974:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993680512:12345-0@lo:400:kworker.0 Request processed in 97us (3678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987036.682981:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:0.0:1788987036.683132:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993680512:0@lo:400:kworker.0 00000100:00100000:2.0:1788987036.689712:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987036.689713:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987036.689936:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993680768:0@lo:400:kworker.0 00000100:00100000:2.0:1788987036.689978:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987036.690046:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993680128 00000100:00100000:2.0:1788987036.690054:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993680128 00000100:00100000:2.0:1788987036.690111:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:2.0:1788987036.690120:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993680128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987036.690167:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993680128:12345-0@lo:400:kworker.0 Request processed in 48us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987036.690174:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:0.0:1788987036.690597:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993680768 00000100:00100000:0.0:1788987036.690603:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993680768 00000100:00080000:2.0:1788987036.690682:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788987036.697804:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993680256 00000100:00100000:3.0:1788987036.697820:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993680256 00000100:00100000:3.0:1788987036.697873:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2024 00000100:00100000:3.0:1788987036.697957:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993680256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987036.698045:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993680256:12345-0@lo:400:kworker.0 Request processed in 164us (8337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987036.698052:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2024 00000100:00100000:2.0:1788987036.698188:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993680256:0@lo:400:kworker.0 00000100:00100000:0.0:1788987036.703213:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:0.0:1788987036.703237:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993680768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987036.703335:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993680768:12345-0@lo:400:kworker.0 Request processed in 111us (13356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987036.703342:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:0.0:1788987036.703402:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993680768:0@lo:400:kworker.0 00000100:00100000:1.0:1788987036.703574:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993680128:0@lo:400:kworker.0 00000100:00100000:1.0:1788987036.703592:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993680640:0@lo:400:kworker.0 00000100:00100000:1.0:1788987036.703627:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987036.703771:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993680640 00000100:00100000:0.0:1788987036.703778:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993680640 00000100:00100000:0.0:1788987036.703830:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2025 00000100:00100000:0.0:1788987036.703836:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993680640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987036.703872:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993680640:12345-0@lo:400:kworker.0 Request processed in 36us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987036.703878:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2025 00000100:00100000:1.0:1788987036.703949:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993680640:0@lo:400:kworker.0 00000100:00080000:2.0:1788987036.704006:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788987036.742911:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987037.184444:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987037.184470:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993680896:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788987037.184533:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987037.185813:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993680896 00000100:00100000:0.0:1788987037.185823:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993680896 00000100:00100000:0.0:1788987037.185884:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1788987037.185894:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993680896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987037.185941:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987037.186014:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993680896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (1480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987037.186021:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1788987037.186959:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993680896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788987037.247558:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987037.247603:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987037.247646:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987037.247751:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971476736 00000100:00100000:0.0:1788987037.247760:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971476736 00000100:00100000:0.0:1788987037.247824:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971476992 00000100:00100000:0.0:1788987037.247828:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971476992 00000100:00100000:0.0:1788987037.247843:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971476864 00000100:00100000:0.0:1788987037.247845:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971476864 00000100:00100000:0.0:1788987037.247861:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:0.0:1788987037.247870:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b81667b-b41b-46dd-83fd-792e204ed8a3+12:2346:x1875885971476736:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788987037.247884:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987037.247901:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a6b031600/0xc20d828fcf5442f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d0728 expref: 12 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987037.247937:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788987037.247985:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b81667b-b41b-46dd-83fd-792e204ed8a3+11:2346:x1875885971476736:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 116us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987037.247996:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 19 00000100:00100000:0.0:1788987037.248016:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:0.0:1788987037.248023:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b81667b-b41b-46dd-83fd-792e204ed8a3+10:2346:x1875885971476992:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788987037.248031:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987037.248040:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf544343 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d073d expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987037.248050:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788987037.248067:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b81667b-b41b-46dd-83fd-792e204ed8a3+9:2346:x1875885971476992:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 44us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987037.248073:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 20 00000100:00100000:0.0:1788987037.248085:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:0.0:1788987037.248130:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45612050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b81667b-b41b-46dd-83fd-792e204ed8a3+8:2346:x1875885971476864:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788987037.248140:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987037.248148:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d48000/0xc20d828fcf54425c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d06f0 expref: 8 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987037.248157:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788987037.248175:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45612050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b81667b-b41b-46dd-83fd-792e204ed8a3+7:2346:x1875885971476864:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 48us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987037.248181:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 21 00000100:00100000:3.0:1788987037.265483:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987037.265591:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971477248 00000100:00100000:2.0:1788987037.265600:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971477248 00000100:00100000:2.0:1788987037.265658:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1250 00000100:00100000:2.0:1788987037.265668:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+6:2345:x1875885971477248:12345-192.168.206.21@tcp:39:umount.0 00000020:00000080:2.0:1788987037.265705:0:5856:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54426a 00000020:00010000:2.0:1788987037.265714:0:5856:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b0a795be800: total 0 00000100:00080000:2.0:1788987037.265719:0:5856:0:(import.c:65:import_set_state_nolock()) ffff9b0a795bd800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788987037.265755:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967769 00000100:00100000:2.0:1788987037.266134:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d307e018-a913-49dd-8d34-07b37c8ccf58+5:2345:x1875885971477248:12345-192.168.206.21@tcp:39:umount.0 Request processed in 467us (659us total) trans 4294967770 rc 0/0 00000100:00100000:2.0:1788987037.266142:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1250 00000020:00010000:1.0:1788987037.266370:0:5843:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b0a795be800: total 0 00010000:00010000:1.0:1788987037.266409:0:5843:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a795be800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788987037.266441:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316e00) 00010000:00010000:1.0:1788987037.266445:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788987037.266453:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54a8ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d179e expref: 4 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987037.266479:0:5843:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a795be800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788987037.266490:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987037.266492:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987037.266493:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987037.282951:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987037.283139:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971477504 00000100:00100000:2.0:1788987037.283150:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971477504 00000100:00100000:2.0:1788987037.283213:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1526 00000100:00100000:2.0:1788987037.283222:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+7:2345:x1875885971477504:12345-192.168.206.21@tcp:251:umount.0 00000020:00000080:2.0:1788987037.283267:0:5846:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf544247 00000020:00010000:2.0:1788987037.283275:0:5846:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b0a76054000: total 0 00000100:00080000:2.0:1788987037.283279:0:5846:0:(import.c:65:import_set_state_nolock()) ffff9b0a76052000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788987037.283344:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b81667b-b41b-46dd-83fd-792e204ed8a3+3:2345:x1875885971477504:12345-192.168.206.21@tcp:251:umount.0 Request processed in 122us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987037.283352:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1526 00000020:00010000:3.0:1788987037.284235:0:5842:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b0a76054000: total 0 00010000:00010000:3.0:1788987037.284241:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987037.284282:0:5842:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a76054000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788987037.284315:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a6b030400/0xc20d828fcf5442fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d072f expref: 2 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987037.284330:0:5842:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a76054000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788987037.284342:0:5842:0:(genops.c:885:class_export_put()) final put ffff9b0a76054000/2b81667b-b41b-46dd-83fd-792e204ed8a3 00010000:00010000:3.0:1788987037.284355:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987037.284358:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987037.284359:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788987037.284475:0:100526:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a76054000/2b81667b-b41b-46dd-83fd-792e204ed8a3 for MGS 00000020:00000080:2.0:1788987037.284519:0:100526:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a76052000 for MGS 00010000:00010000:1.0:1788987037.761372:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788987038.260063:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d307e018-a913-49dd-8d34-07b37c8ccf58 00000001:00080000:3.0:1788987038.260081:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967770 is committed 00000020:00000080:3.0:1788987038.260086:0:5876:0:(genops.c:885:class_export_put()) final put ffff9b0a795be800/d307e018-a913-49dd-8d34-07b37c8ccf58 00000020:00000080:1.0:1788987038.260173:0:100526:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a795be800/d307e018-a913-49dd-8d34-07b37c8ccf58 for lustre-MDT0000 00000020:00000080:1.0:1788987038.260244:0:100526:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a795bd800 for lustre-MDT0000 00000004:00000400:2.0:1788987038.637181:0:104785:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:2.0:1788987038.637188:0:104785:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00010000:00010000:3.0:1788987038.787420:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788987039.581700:0:104833:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc9e60e650 20000000:00000080:0.0:1788987039.581729:0:104833:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80857400 uarg=0000000000000000 10000000:01000000:0.0:1788987039.582289:0:104833:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788987039.582308:0:104833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987039.582327:0:104833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a8bc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a8b5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987039.582335:0:104833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987039.582371:0:104833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a8bc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a8b5 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987039.582385:0:104833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a8bc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a8b5 expref: 18 pid: 5846 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987039.582398:0:104833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104833:1875885993681024:0@lo:104: 00000100:00100000:0.0:1788987039.582456:0:104833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987039.582504:0:104833:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788987039.582637:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993681024 00000100:00100000:3.0:1788987039.582645:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993681024 00000100:00100000:3.0:1788987039.582698:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 406 00000100:00100000:3.0:1788987039.582718:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:104833:x1875885993681024:12345-0@lo:104: 00010000:00010000:3.0:1788987039.582732:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a8bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987039.582793:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788987039.582798:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:104833:x1875885993681024:12345-0@lo:104: Request processed in 93us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987039.582805:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 406 00010000:00010000:1.0:1788987039.582854:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788987039.582861:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a8bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987039.582870:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788987039.582874:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a8bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987039.582882:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a8bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788987039.582888:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a8bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987039.582894:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788987039.582928:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a8bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987039.582935:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788987039.582966:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a8bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987039.582979:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508eea00/0xc20d828fcf54a8b5 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a8bc expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987039.582995:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987039.582996:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987039.582998:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987039.583004:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788987039.583015:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993681152:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788987039.583044:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987039.583109:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993681152 00000100:00100000:2.0:1788987039.583114:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993681152 00010000:00010000:2.0:1788987039.583137:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a8bc lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a8b5 expref: 19 pid: 5846 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987039.583170:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1788987039.583177:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993681152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987039.583187:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987039.583192:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a8bc lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a8b5 expref: 19 pid: 5846 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987039.583201:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a8bc lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a8b5 expref: 19 pid: 5846 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987039.583215:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987039.583222:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987039.583235:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987039.583242:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987039.583248:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987039.583259:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987039.583264:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987039.583268:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987039.583275:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987039.583283:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987039.583291:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987039.583342:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993681152:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987039.583350:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:1.0:1788987039.583431:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993681152:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987039.583771:0:104833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2200/0xc20d828fcf54a8bc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a8b5 expref: 18 pid: 5846 timeout: 2923 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987039.583784:0:104833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104833:1875885993681024:0@lo:104: 00010000:00010000:0.0:1788987039.583798:0:104833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987039.583807:0:104833:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987039.583813:0:104833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987039.583819:0:104833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a8d1 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987039.808518:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788987040.520717:0:104881:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc7d516860 20000000:00000080:3.0:1788987040.520736:0:104881:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a511e1400 uarg=0000000000000000 10000000:01000000:3.0:1788987040.520963:0:104881:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788987040.520983:0:104881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a8d8 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987040.521003:0:104881:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a8d8 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987040.521013:0:104881:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a8d8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987040.521019:0:104881:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a8d8 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987040.521026:0:104881:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a8d8 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987040.521033:0:104881:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a8d8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987040.521038:0:104881:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987040.521042:0:104881:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a8d8 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987040.521049:0:104881:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a8d8 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987040.521062:0:104881:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a8d8 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987040.521068:0:104881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a8d8 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987040.521074:0:104881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3800/0xc20d828fcf54a8d8 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987040.771783:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993681280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987040.771847:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987040.771929:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993681280 00000100:00100000:3.0:1788987040.771938:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993681280 00000100:00100000:3.0:1788987040.772244:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:3.0:1788987040.772255:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993681280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987040.772288:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987040.772333:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993681280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987040.772339:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:3.0:1788987040.772388:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993681280:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788987040.772427:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788987040.832510:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788987041.218531:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788987041.218540:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788987041.218546:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788987041.218608:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.218623:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.218636:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987041.218666:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993681408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788987041.218751:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987041.218821:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a432fc840 going to sleep for 11 seconds 00000100:00100000:1.0:1788987041.219501:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993681408 00000100:00100000:1.0:1788987041.219510:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993681408 00000100:00100000:1.0:1788987041.219572:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:1.0:1788987041.219582:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993681408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987041.219594:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987041.219609:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a8e6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a8df expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987041.219635:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a8e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a8df expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987041.219647:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a8e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a8df expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987041.219655:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788987041.219727:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993681408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987041.219735:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:2.0:1788987041.219761:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993681408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987041.219778:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a8e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.219789:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a8e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987041.219816:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788987041.219822:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a8e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.219831:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a8e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788987041.626808:0:104929:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffdb5358440 20000000:00000080:2.0:1788987041.626822:0:104929:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a5abf0000 uarg=0000000000000000 10000000:01000000:2.0:1788987041.626990:0:104929:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987041.627010:0:104929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.627026:0:104929:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a8e6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a8df expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.627035:0:104929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.627069:0:104929:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a8e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a8df expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.627084:0:104929:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a8e6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a8df expref: 18 pid: 5849 timeout: 2925 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987041.627120:0:104929:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104929:1875885993681536:0@lo:104: 00000100:00100000:2.0:1788987041.627650:0:104929:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987041.627727:0:104929:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a49893240 going to sleep for 11 seconds 00000100:00100000:0.0:1788987041.627819:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993681536 00000100:00100000:0.0:1788987041.627828:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993681536 00000100:00100000:0.0:1788987041.627883:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 407 00000100:00100000:0.0:1788987041.627892:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:104929:x1875885993681536:12345-0@lo:104: 00010000:00010000:0.0:1788987041.627906:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a8e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987041.627979:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987041.627985:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:104929:x1875885993681536:12345-0@lo:104: Request processed in 95us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987041.627991:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 407 00010000:00010000:3.0:1788987041.628060:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987041.628067:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a8e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987041.628074:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987041.628078:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a8e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987041.628081:0:104929:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:104929:1875885993681536:0@lo:104: 00010000:00010000:3.0:1788987041.628087:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a8e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987041.628121:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a8e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987041.628126:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788987041.628133:0:104929:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987041.628160:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a8e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987041.628166:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987041.628201:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a8e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987041.628208:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54a8df lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a8e6 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987041.628224:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987041.628225:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987041.628227:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987041.628241:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788987041.628251:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993681664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788987041.628284:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987041.628333:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993681664 00000100:00100000:2.0:1788987041.628338:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993681664 00010000:00010000:2.0:1788987041.628362:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a8e6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a8df expref: 19 pid: 5849 timeout: 2925 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987041.628389:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1788987041.628396:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993681664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987041.628405:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987041.628409:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a8e6 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a8df expref: 19 pid: 5849 timeout: 2925 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.628419:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a8e6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a8df expref: 19 pid: 5849 timeout: 2925 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.628432:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54a8e6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a8df expref: 19 pid: 5849 timeout: 2925 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.628446:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.628454:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.628472:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.628479:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.628486:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.628492:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.628498:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987041.628501:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.628510:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.628530:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987041.628539:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987041.628579:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993681664:12345-0@lo:103:ldlm_bl.0 Request processed in 184us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987041.628585:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:0.0:1788987041.628648:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993681664:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788987041.628964:0:104929:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987041.628973:0:104929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987041.628979:0:104929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a8ed lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987041.802585:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993681792:0@lo:400:kworker.0 00000100:00100000:2.0:1788987041.802609:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993682176:0@lo:400:kworker.0 00000100:00100000:2.0:1788987041.814798:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987041.814917:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987041.814930:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993682304:0@lo:400:kworker.0 00000100:00100000:2.0:1788987041.814973:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987041.815008:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993681920:0@lo:400:kworker.0 00000100:00100000:2.0:1788987041.815034:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987041.821323:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993682304 00000100:00100000:3.0:1788987041.821473:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993682304 00000100:00100000:3.0:1788987041.821649:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:3.0:1788987041.821658:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993682304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987041.821761:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993682304:12345-0@lo:400:kworker.0 Request processed in 104us (6787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987041.821767:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:3.0:1788987041.821797:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993682048:0@lo:400:kworker.0 00000100:00100000:3.0:1788987041.821830:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788987041.821880:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788987041.821889:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993682048 00000100:00100000:3.0:1788987041.821892:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993682048 00000100:00100000:3.0:1788987041.821912:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546 00000100:00100000:3.0:1788987041.821916:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993682048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987041.821945:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993682048:12345-0@lo:400:kworker.0 Request processed in 28us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987041.821950:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546 00000100:00100000:3.0:1788987041.821980:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993682048:0@lo:400:kworker.0 00000100:00100000:2.0:1788987041.823547:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993682304:0@lo:400:kworker.0 00000100:00100000:0.0:1788987041.829545:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993682176 00000100:00100000:0.0:1788987041.829561:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993682176 00000100:00100000:0.0:1788987041.829658:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993681920 00000100:00100000:0.0:1788987041.829662:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993681920 00000100:00100000:0.0:1788987041.829707:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2026 00000100:00100000:0.0:1788987041.829716:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993682176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987041.829801:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993682176:12345-0@lo:400:kworker.0 Request processed in 87us (15009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987041.829807:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2026 00000100:00100000:0.0:1788987041.829824:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2027 00000100:00100000:0.0:1788987041.829831:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993681920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987041.829863:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993681920:12345-0@lo:400:kworker.0 Request processed in 34us (14829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987041.829869:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2027 00000100:00100000:0.0:1788987041.829932:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993682176:0@lo:400:kworker.0 00000100:00100000:0.0:1788987041.829969:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993681920:0@lo:400:kworker.0 00000100:00100000:0.0:1788987041.830191:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788987041.830765:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987041.830781:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993681792 00000100:00100000:3.0:1788987041.830786:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993681792 00000100:00100000:3.0:1788987041.830826:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1788987041.830834:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993681792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987041.830882:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993681792:12345-0@lo:400:kworker.0 Request processed in 49us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987041.830888:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2028 00000100:00100000:3.0:1788987041.830920:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993681792:0@lo:400:kworker.0 00010000:00010000:1.0:1788987041.856944:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987042.304442:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993682432:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788987042.304516:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987042.304623:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993682432 00000100:00100000:0.0:1788987042.304631:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993682432 00000100:00100000:0.0:1788987042.304682:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1788987042.304691:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993682432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987042.304736:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987042.304779:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993682432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987042.304785:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1788987042.304910:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993682432:0@lo:13:osp-pre-1-0.0 00000020:00000080:2.0:1788987042.627028:0:104977:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcfefce290 20000000:00000080:2.0:1788987042.627044:0:104977:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0942783000 uarg=0000000000000000 10000000:01000000:2.0:1788987042.627261:0:104977:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987042.627284:0:104977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a8f4 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 104977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.627301:0:104977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a8f4 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 104977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.627313:0:104977:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a8f4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 104977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.627321:0:104977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a8f4 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.627328:0:104977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a8f4 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 104977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.627335:0:104977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a8f4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.627342:0:104977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987042.627346:0:104977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a8f4 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 104977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.627357:0:104977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a8f4 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 104977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.627369:0:104977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a8f4 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.627376:0:104977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a8f4 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.627382:0:104977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a8f4 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 104977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987042.880715:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788987042.945142:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788987042.945148:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788987042.945152:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788987042.945204:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987042.945216:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987042.945228:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987042.945254:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993682560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788987042.945317:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987042.945474:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51a11240 going to sleep for 11 seconds 00000100:00100000:2.0:1788987042.945543:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993682560 00000100:00100000:2.0:1788987042.945550:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993682560 00000100:00100000:2.0:1788987042.945603:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:2.0:1788987042.945612:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993682560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987042.945624:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788987042.945637:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a902 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a8fb expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.945659:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a902 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a8fb expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.945669:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a902 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a8fb expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987042.945677:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1200, rc 0) 00000100:00100000:2.0:1788987042.945734:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993682560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987042.945745:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:0.0:1788987042.946136:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993682560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987042.946152:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a902 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987042.946174:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a902 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987042.946193:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788987042.946198:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a902 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987042.946205:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a902 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788987043.565564:0:105029:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd85b567a0 20000000:00000080:0.0:1788987043.565582:0:105029:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80854800 uarg=0000000000000000 10000000:01000000:0.0:1788987043.567362:0:105029:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788987043.567387:0:105029:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987043.567404:0:105029:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a902 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a8fb expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987043.567412:0:105029:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987043.567456:0:105029:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a902 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a8fb expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987043.567472:0:105029:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a902 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a8fb expref: 18 pid: 5848 timeout: 2927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987043.567488:0:105029:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105029:1875885993682688:0@lo:104: 00000100:00100000:0.0:1788987043.567554:0:105029:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987043.569248:0:105029:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a59f529c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788987043.569834:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993682688 00000100:00100000:3.0:1788987043.569846:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993682688 00000100:00100000:3.0:1788987043.569944:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 408 00000100:00100000:3.0:1788987043.569955:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105029:x1875885993682688:12345-0@lo:104: 00010000:00010000:3.0:1788987043.569971:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a902 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987043.570059:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788987043.570065:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105029:x1875885993682688:12345-0@lo:104: Request processed in 113us (2511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987043.570072:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 408 00010000:00010000:1.0:1788987043.570130:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788987043.570137:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a902 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570145:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788987043.570149:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a902 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570163:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a902 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788987043.570169:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a902 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987043.570174:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788987043.570208:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a902 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570215:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788987043.570237:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a902 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570244:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3800/0xc20d828fcf54a8fb lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a902 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570264:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987043.570266:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987043.570268:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987043.570282:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993682816:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788987043.570323:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987043.570370:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993682816 00000100:00100000:1.0:1788987043.570374:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993682816 00010000:00010000:1.0:1788987043.570393:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a902 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a8fb expref: 19 pid: 5848 timeout: 2927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987043.570415:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1788987043.570421:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993682816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788987043.570432:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788987043.570437:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a902 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a8fb expref: 19 pid: 5848 timeout: 2927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570447:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a902 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a8fb expref: 19 pid: 5848 timeout: 2927 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570463:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570471:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570488:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570495:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570501:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570508:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570513:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788987043.570517:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570524:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570537:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570546:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788987043.570576:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993682816:12345-0@lo:103:ldlm_bl.0 Request processed in 155us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987043.570583:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 00000100:00100000:1.0:1788987043.570616:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993682816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788987043.570650:0:105029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a902 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a8fb expref: 18 pid: 5848 timeout: 2927 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987043.570661:0:105029:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105029:1875885993682688:0@lo:104: 00010000:00010000:1.0:1788987043.570673:0:105029:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570696:0:105029:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570703:0:105029:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987043.570709:0:105029:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54a909 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105029 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987043.906618:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788987044.762873:0:105077:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff5930d280 20000000:00000080:1.0:1788987044.762891:0:105077:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b094197e000 uarg=0000000000000000 10000000:01000000:1.0:1788987044.763888:0:105077:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788987044.764801:0:105077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a910 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.764822:0:105077:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a910 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.764833:0:105077:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a910 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.764840:0:105077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a910 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.764848:0:105077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a910 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.764855:0:105077:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a910 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.764862:0:105077:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788987044.764866:0:105077:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a910 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.764874:0:105077:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a910 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.764886:0:105077:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a910 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.764893:0:105077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a910 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.764900:0:105077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54a910 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987044.804344:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788987044.804353:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788987044.804359:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788987044.804407:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.804419:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.804430:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987044.804453:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993682944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788987044.804510:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987044.804563:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788987044.804716:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993682944 00000100:00100000:2.0:1788987044.804723:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993682944 00000100:00100000:2.0:1788987044.804762:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1529 00000100:00100000:2.0:1788987044.804770:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993682944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987044.804783:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788987044.804794:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a91e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a917 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987044.804816:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a91e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a917 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987044.804827:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a91e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a917 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987044.804837:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0e00, rc 0) 00000100:00100000:2.0:1788987044.804881:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993682944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987044.804888:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1529 00000100:00100000:1.0:1788987044.805015:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993682944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987044.805028:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a91e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.805047:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a91e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987044.805065:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788987044.805070:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a91e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.805078:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a91e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987044.932782:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987045.888238:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788987045.888259:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993683072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987045.888321:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987045.888388:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993683072 00000100:00100000:3.0:1788987045.888396:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993683072 00000100:00100000:3.0:1788987045.888447:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1788987045.888456:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993683072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987045.888488:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987045.888530:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993683072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987045.888536:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00080000:3.0:1788987045.888556:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788987045.888590:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993683072:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788987045.952194:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987046.914158:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993683328:0@lo:400:kworker.0 00000100:00100000:1.0:1788987046.914271:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987046.914321:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993683840:0@lo:400:kworker.0 00000100:00100000:1.0:1788987046.914347:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987046.914371:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788987046.914378:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993683456:0@lo:400:kworker.0 00000100:00100000:1.0:1788987046.914399:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987046.914435:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993683328 00000100:00100000:1.0:1788987046.914442:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993683328 00000100:00100000:1.0:1788987046.914482:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993683456 00000100:00100000:1.0:1788987046.914485:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993683456 00000100:00100000:1.0:1788987046.914518:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1788987046.914526:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993683328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987046.914574:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993683328:12345-0@lo:400:kworker.0 Request processed in 49us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987046.914581:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2029 00000100:00100000:1.0:1788987046.914597:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2030 00000100:00100000:1.0:1788987046.914605:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993683456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987046.914629:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993683456:12345-0@lo:400:kworker.0 Request processed in 26us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987046.914635:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2030 00000100:00100000:1.0:1788987046.914652:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993683840 00000100:00100000:1.0:1788987046.914655:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993683840 00000100:00100000:1.0:1788987046.914695:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:1.0:1788987046.914702:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993683840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987046.914731:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993683840:12345-0@lo:400:kworker.0 Request processed in 29us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987046.914737:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00080000:1.0:1788987046.914757:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788987046.914761:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987046.914790:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993683456:0@lo:400:kworker.0 00000100:00100000:1.0:1788987046.914800:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993683328:0@lo:400:kworker.0 00000100:00100000:1.0:1788987046.914810:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993683840:0@lo:400:kworker.0 00000100:00100000:0.0:1788987046.914964:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993683584:0@lo:400:kworker.0 00000100:00100000:0.0:1788987046.914996:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987046.915025:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788987046.915032:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993683200:0@lo:400:kworker.0 00000100:00100000:0.0:1788987046.915064:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987046.915105:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993683712:0@lo:400:kworker.0 00000100:00100000:0.0:1788987046.915126:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987046.915185:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993683200 00000100:00100000:0.0:1788987046.915190:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993683200 00000100:00100000:0.0:1788987046.915224:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:0.0:1788987046.915232:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993683200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987046.915278:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993683200:12345-0@lo:400:kworker.0 Request processed in 47us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987046.915283:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00100000:0.0:1788987046.915311:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993683712 00000100:00100000:0.0:1788987046.915315:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993683712 00000100:00100000:0.0:1788987046.915343:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2031 00000100:00100000:0.0:1788987046.915349:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993683712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987046.915379:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993683712:12345-0@lo:400:kworker.0 Request processed in 31us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987046.915384:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2031 00000100:00100000:0.0:1788987046.915408:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993683200:0@lo:400:kworker.0 00000100:00100000:0.0:1788987046.915417:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993683712:0@lo:400:kworker.0 00000100:00100000:1.0:1788987046.916029:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993683584 00000100:00100000:1.0:1788987046.916035:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993683584 00000100:00100000:1.0:1788987046.916073:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:1.0:1788987046.916082:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993683584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987046.916173:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993683584:12345-0@lo:400:kworker.0 Request processed in 93us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987046.916180:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00080000:1.0:1788987046.916198:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987046.916322:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993683584:0@lo:400:kworker.0 00010000:00010000:3.0:1788987046.977273:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987047.439151:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993683968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788987047.439221:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987047.439957:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993683968 00000100:00100000:0.0:1788987047.439967:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993683968 00000100:00100000:0.0:1788987047.440031:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:0.0:1788987047.440040:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993683968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987047.440107:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987047.441436:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993683968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1392us (2210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987047.441446:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:2.0:1788987047.456359:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993683968:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788987048.000871:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788987048.434586:0:105224:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffeafed13e0 20000000:00000080:0.0:1788987048.434603:0:105224:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80874800 uarg=0000000000000000 10000000:01000000:3.0:1788987048.441712:0:105224:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788987048.441737:0:105224:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987048.441755:0:105224:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a91e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a917 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987048.441765:0:105224:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987048.441801:0:105224:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a91e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a917 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987048.441816:0:105224:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a91e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a917 expref: 18 pid: 5849 timeout: 2932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987048.441830:0:105224:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105224:1875885993684096:0@lo:104: 00000100:00100000:3.0:1788987048.441886:0:105224:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987048.441991:0:105224:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76582780 going to sleep for 11 seconds 00000100:00100000:2.0:1788987048.447410:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993684096 00000100:00100000:2.0:1788987048.447425:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993684096 00000100:00100000:2.0:1788987048.448390:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 409 00000100:00100000:2.0:1788987048.448407:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105224:x1875885993684096:12345-0@lo:104: 00010000:00010000:2.0:1788987048.448425:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a91e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987048.448541:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788987048.448547:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105224:x1875885993684096:12345-0@lo:104: Request processed in 147us (6661us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987048.448554:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 409 00010000:00010000:1.0:1788987048.448627:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788987048.448634:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a91e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.448642:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788987048.448646:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a91e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.448655:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a91e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788987048.448673:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a91e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987048.448678:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788987048.448716:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a91e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.448722:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788987048.448743:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a91e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.448749:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030000/0xc20d828fcf54a917 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a91e expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.448766:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987048.448768:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987048.448769:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987048.448814:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993684224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788987048.448849:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987048.448981:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993684224 00000100:00100000:1.0:1788987048.448986:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993684224 00010000:00010000:1.0:1788987048.449009:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a91e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a917 expref: 19 pid: 5849 timeout: 2932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987048.449032:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1788987048.449038:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993684224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788987048.449048:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788987048.449053:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a91e lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a917 expref: 19 pid: 5849 timeout: 2932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.449064:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a91e lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a917 expref: 19 pid: 5849 timeout: 2932 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.449080:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.449108:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.449125:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.449146:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.449153:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.449160:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.449166:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788987048.449170:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.449177:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.449186:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987048.449200:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788987048.449230:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993684224:12345-0@lo:103:ldlm_bl.0 Request processed in 192us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987048.449236:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 00000100:00100000:1.0:1788987048.449270:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993684224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987048.449553:0:105224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a91e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a917 expref: 18 pid: 5849 timeout: 2932 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987048.449565:0:105224:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105224:1875885993684096:0@lo:104: 00010000:00010000:3.0:1788987048.449580:0:105224:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987048.449589:0:105224:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987048.449597:0:105224:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987048.449604:0:105224:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a925 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987049.026852:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788987049.344170:0:105274:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff0e4c2e30 20000000:00000080:2.0:1788987049.344187:0:105274:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0942780c00 uarg=0000000000000000 10000000:01000000:2.0:1788987049.346165:0:105274:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987049.346193:0:105274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a92c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.346210:0:105274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a92c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.346221:0:105274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a92c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.346229:0:105274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a92c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.346236:0:105274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a92c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.346244:0:105274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a92c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.346250:0:105274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0e00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987049.346254:0:105274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a92c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.346262:0:105274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a92c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.346275:0:105274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a92c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.346283:0:105274:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a92c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.346289:0:105274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0e00/0xc20d828fcf54a92c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105274 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987049.920396:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788987049.920404:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788987049.920409:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788987049.920455:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.920468:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.920479:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987049.920507:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993684352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788987049.920579:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987049.920732:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993684352 00000100:00100000:3.0:1788987049.920741:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993684352 00000100:00100000:3.0:1788987049.920799:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:3.0:1788987049.920809:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993684352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987049.920822:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788987049.920835:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a93a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a933 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987049.920857:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a93a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a933 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987049.920868:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a93a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a933 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987049.920878:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2800, rc 0) 00000100:00100000:3.0:1788987049.920910:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993684352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987049.920917:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1788987049.921274:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eac180 going to sleep for 11 seconds 00000100:00100000:2.0:1788987049.921300:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993684352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987049.921315:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a93a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.921325:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a93a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987049.921343:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788987049.921348:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a93a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987049.921356:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a93a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987050.050299:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987051.009236:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987051.019060:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993684480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788987051.019176:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987051.019418:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993684480 00000100:00100000:0.0:1788987051.019433:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993684480 00000100:00100000:0.0:1788987051.019519:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:0.0:1788987051.019530:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45a55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993684480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788987051.019566:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987051.019664:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45a55050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993684480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987051.019671:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00080000:1.0:1788987051.019920:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788987051.020472:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993684480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788987051.073307:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987052.046854:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993684736:0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.046915:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987052.046960:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993685248:0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.046984:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987052.047006:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788987052.047011:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993684608:0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047035:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987052.047054:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993685120:0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047070:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987052.047129:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993684864:0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047149:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987052.047165:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788987052.047171:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993684992:0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047189:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987052.047215:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993684736 00000100:00100000:0.0:1788987052.047221:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993684736 00000100:00100000:0.0:1788987052.047260:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993685120 00000100:00100000:0.0:1788987052.047263:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993685120 00000100:00100000:0.0:1788987052.047291:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993684864 00000100:00100000:0.0:1788987052.047294:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993684864 00000100:00100000:0.0:1788987052.047313:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2032 00000100:00100000:0.0:1788987052.047320:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993684736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047367:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993684736:12345-0@lo:400:kworker.0 Request processed in 46us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987052.047374:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2032 00000100:00100000:0.0:1788987052.047389:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2033 00000100:00100000:0.0:1788987052.047395:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993685120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047421:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993685120:12345-0@lo:400:kworker.0 Request processed in 27us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987052.047426:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2033 00000100:00100000:0.0:1788987052.047437:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2034 00000100:00100000:0.0:1788987052.047443:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993684864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047472:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993684864:12345-0@lo:400:kworker.0 Request processed in 29us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987052.047477:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2034 00000100:00100000:0.0:1788987052.047498:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993685248 00000100:00100000:0.0:1788987052.047501:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993685248 00000100:00100000:0.0:1788987052.047525:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993684992 00000100:00100000:0.0:1788987052.047528:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993684992 00000100:00100000:0.0:1788987052.047547:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:0.0:1788987052.047553:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993685248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047582:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993685248:12345-0@lo:400:kworker.0 Request processed in 30us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987052.047588:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:0.0:1788987052.047600:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:0.0:1788987052.047605:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993684992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047630:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993684992:12345-0@lo:400:kworker.0 Request processed in 26us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987052.047635:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:0.0:1788987052.047665:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993684608 00000100:00100000:0.0:1788987052.047668:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993684608 00000100:00100000:0.0:1788987052.047693:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:0.0:1788987052.047700:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993684608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047727:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993684608:12345-0@lo:400:kworker.0 Request processed in 28us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987052.047733:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00080000:0.0:1788987052.047766:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788987052.047770:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987052.047801:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993684992:0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047811:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993684864:0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047836:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993684608:0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047843:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993685120:0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047851:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993684736:0@lo:400:kworker.0 00000100:00100000:0.0:1788987052.047858:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993685248:0@lo:400:kworker.0 00010000:00010000:3.0:1788987052.098123:0:59237:0:(ldlm_pool.c:1330:ldlm_pools_recalc_task()) Negative interval(0) 00010000:00010000:0.0:1788987052.098253:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987052.544996:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993685376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788987052.545062:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987052.545201:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993685376 00000100:00100000:3.0:1788987052.545210:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993685376 00000100:00100000:3.0:1788987052.545258:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:3.0:1788987052.545268:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993685376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788987052.545305:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987052.545394:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993685376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987052.545402:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:1.0:1788987052.547366:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993685376:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788987053.122253:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788987053.891956:0:105472:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff8c612b00 20000000:00000080:1.0:1788987053.891973:0:105472:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a5abf0000 uarg=0000000000000000 10000000:01000000:1.0:1788987053.892582:0:105472:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788987053.892606:0:105472:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987053.892624:0:105472:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a93a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a933 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987053.892643:0:105472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987053.892684:0:105472:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a93a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a933 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987053.892699:0:105472:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a93a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a933 expref: 18 pid: 5848 timeout: 2937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987053.892719:0:105472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105472:1875885993685504:0@lo:104: 00000100:00100000:1.0:1788987053.892787:0:105472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987053.892902:0:105472:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a45664540 going to sleep for 11 seconds 00000100:00100000:0.0:1788987053.893044:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993685504 00000100:00100000:0.0:1788987053.893053:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993685504 00000100:00100000:0.0:1788987053.893557:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 410 00000100:00100000:0.0:1788987053.893570:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105472:x1875885993685504:12345-0@lo:104: 00010000:00010000:0.0:1788987053.893587:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a93a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.893710:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987053.893717:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105472:x1875885993685504:12345-0@lo:104: Request processed in 151us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987053.893724:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 410 00000100:00100000:1.0:1788987053.893816:0:105472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105472:1875885993685504:0@lo:104: 00010000:00010000:1.0:1788987053.893837:0:105472:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987053.893874:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987053.893881:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a93a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987053.893888:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0400 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987053.893893:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a93a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987053.893900:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a93a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987053.893907:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a93a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987053.893912:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788987053.893948:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a93a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987053.893954:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788987053.894001:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993685632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788987053.894034:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788987053.894163:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a93a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987053.894172:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0400/0xc20d828fcf54a933 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a93a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987053.894187:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987053.894189:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987053.894191:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987053.894326:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993685632 00000100:00100000:0.0:1788987053.894332:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993685632 00010000:00010000:0.0:1788987053.894359:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a93a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a933 expref: 19 pid: 5848 timeout: 2937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987053.894422:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 00000100:00100000:0.0:1788987053.894430:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993685632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987053.894443:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987053.894448:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a93a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a933 expref: 19 pid: 5848 timeout: 2937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.894459:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a93a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a933 expref: 19 pid: 5848 timeout: 2937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.894471:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54a93a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a933 expref: 19 pid: 5848 timeout: 2937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.894482:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.894490:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.894503:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.894515:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.894522:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.894528:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.894533:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788987053.894538:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.894545:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.894565:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987053.894574:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788987053.894622:0:105472:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987053.894639:0:105472:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987053.894645:0:105472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030c00/0xc20d828fcf54a941 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105472 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987053.897146:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993685632:12345-0@lo:103:ldlm_bl.0 Request processed in 2707us (3101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987053.897161:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1788987053.897456:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993685632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788987054.149593:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987055.168667:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788987055.552650:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788987055.552658:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788987055.552663:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788987055.552706:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987055.552728:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987055.552740:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987055.552768:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993685760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788987055.552832:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987055.552883:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a511f8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788987055.552988:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993685760 00000100:00100000:2.0:1788987055.552996:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993685760 00000100:00100000:2.0:1788987055.553051:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:2.0:1788987055.553060:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993685760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987055.553073:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788987055.553085:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a94f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a948 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987055.553144:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a94f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a948 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987055.553154:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a94f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a948 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987055.553162:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0800, rc 0) 00000100:00100000:2.0:1788987055.553206:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993685760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987055.553213:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00100000:3.0:1788987055.553297:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993685760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987055.553313:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a94f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987055.553322:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a94f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987055.553339:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788987055.553343:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a94f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987055.553350:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a94f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987056.137950:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788987056.137971:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993685888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987056.138034:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987056.138129:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993685888 00000100:00100000:3.0:1788987056.138138:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993685888 00000100:00100000:3.0:1788987056.138195:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:3.0:1788987056.138204:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993685888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987056.138234:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987056.138290:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993685888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987056.138297:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00080000:3.0:1788987056.138317:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788987056.138685:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993685888:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788987056.196670:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987057.152643:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993686144:0@lo:400:kworker.0 00000100:00100000:3.0:1788987057.152707:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987057.152757:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993686656:0@lo:400:kworker.0 00000100:00100000:3.0:1788987057.152782:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987057.152805:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788987057.152811:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993686272:0@lo:400:kworker.0 00000100:00100000:3.0:1788987057.152831:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987057.153010:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993686400:0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153039:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987057.153070:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788987057.153076:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993686016:0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153124:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987057.153148:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993686528:0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153170:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987057.153199:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993686144 00000100:00100000:0.0:1788987057.153207:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993686144 00000100:00100000:0.0:1788987057.153248:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993686272 00000100:00100000:0.0:1788987057.153251:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993686272 00000100:00100000:0.0:1788987057.153275:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993686528 00000100:00100000:0.0:1788987057.153278:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993686528 00000100:00100000:0.0:1788987057.153294:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2035 00000100:00100000:0.0:1788987057.153303:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993686144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153352:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993686144:12345-0@lo:400:kworker.0 Request processed in 50us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987057.153359:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2035 00000100:00100000:0.0:1788987057.153377:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2036 00000100:00100000:0.0:1788987057.153383:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993686272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153410:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993686272:12345-0@lo:400:kworker.0 Request processed in 28us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987057.153416:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2036 00000100:00100000:0.0:1788987057.153426:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1788987057.153432:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993686528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153461:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993686528:12345-0@lo:400:kworker.0 Request processed in 28us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987057.153466:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2037 00000100:00100000:0.0:1788987057.153484:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993686656 00000100:00100000:0.0:1788987057.153487:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993686656 00000100:00100000:0.0:1788987057.153510:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993686400 00000100:00100000:0.0:1788987057.153513:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993686400 00000100:00100000:0.0:1788987057.153532:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:0.0:1788987057.153538:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993686656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153649:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993686656:12345-0@lo:400:kworker.0 Request processed in 111us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987057.153656:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:0.0:1788987057.153667:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:0.0:1788987057.153673:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993686400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153699:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993686400:12345-0@lo:400:kworker.0 Request processed in 27us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987057.153704:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00100000:0.0:1788987057.153726:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993686016 00000100:00100000:0.0:1788987057.153730:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993686016 00000100:00100000:0.0:1788987057.153754:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:0.0:1788987057.153760:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993686016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153791:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993686016:12345-0@lo:400:kworker.0 Request processed in 31us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987057.153796:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00080000:0.0:1788987057.153826:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788987057.153830:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987057.153865:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993686016:0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153878:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993686528:0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153886:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993686400:0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153915:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993686272:0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153925:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993686144:0@lo:400:kworker.0 00000100:00100000:0.0:1788987057.153934:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993686656:0@lo:400:kworker.0 00010000:00010000:1.0:1788987057.223366:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987057.665304:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993686784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788987057.665369:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987057.665436:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993686784 00000100:00100000:1.0:1788987057.665455:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993686784 00000100:00100000:1.0:1788987057.665498:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1788987057.665507:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993686784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788987057.665538:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987057.665597:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993686784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987057.665604:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:1.0:1788987057.665743:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993686784:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788987058.240641:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788987058.965187:0:105670:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd8e66bfd0 20000000:00000080:1.0:1788987058.965205:0:105670:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a79743800 uarg=0000000000000000 10000000:01000000:1.0:1788987058.965863:0:105670:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788987058.965889:0:105670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987058.965910:0:105670:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a94f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a948 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987058.965919:0:105670:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987058.965968:0:105670:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a94f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a948 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987058.965986:0:105670:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a94f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a948 expref: 18 pid: 5846 timeout: 2942 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987058.966302:0:105670:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105670:1875885993686912:0@lo:104: 00000100:00100000:1.0:1788987058.966380:0:105670:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987058.966724:0:105670:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76582480 going to sleep for 11 seconds 00000100:00100000:2.0:1788987058.967136:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993686912 00000100:00100000:2.0:1788987058.967144:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993686912 00000100:00100000:2.0:1788987058.967191:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 411 00000100:00100000:2.0:1788987058.967199:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105670:x1875885993686912:12345-0@lo:104: 00010000:00010000:2.0:1788987058.967216:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a94f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.967279:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788987058.967285:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105670:x1875885993686912:12345-0@lo:104: Request processed in 86us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987058.967291:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 411 00010000:00010000:1.0:1788987058.968017:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788987058.968023:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a94f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987058.968031:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788987058.968035:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a94f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987058.968044:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a94f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788987058.968051:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a94f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987058.968056:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788987058.968119:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a94f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987058.968126:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788987058.968174:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993687040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788987058.968218:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788987058.968372:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a94f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987058.968380:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40031c00/0xc20d828fcf54a948 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a94f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987058.968398:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987058.968400:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987058.968401:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987058.968430:0:105670:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105670:1875885993686912:0@lo:104: 00010000:00010000:1.0:1788987058.968462:0:105670:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987058.968584:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993687040 00000100:00100000:2.0:1788987058.968590:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993687040 00010000:00010000:2.0:1788987058.968624:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a94f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a948 expref: 19 pid: 5846 timeout: 2942 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987058.968678:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:2.0:1788987058.968690:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993687040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987058.968704:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987058.968711:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a94f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a948 expref: 19 pid: 5846 timeout: 2942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.968729:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a94f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a948 expref: 19 pid: 5846 timeout: 2942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.968742:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54a94f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a948 expref: 19 pid: 5846 timeout: 2942 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.968754:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.968762:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.968774:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.968781:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.968787:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.968792:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.968796:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987058.968800:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.968806:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.968820:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987058.968828:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788987058.969151:0:105670:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987058.969160:0:105670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987058.969167:0:105670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a956 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987058.979005:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993687040:12345-0@lo:103:ldlm_bl.0 Request processed in 10307us (10775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987058.979019:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:0.0:1788987058.996618:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993687040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987059.273530:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788987060.224214:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788987060.224221:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788987060.224226:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788987060.224267:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987060.224279:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987060.224290:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987060.224319:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993687168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788987060.224384:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987060.224433:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a439f1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788987060.225709:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993687168 00000100:00100000:2.0:1788987060.225721:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993687168 00000100:00100000:2.0:1788987060.225772:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00100000:2.0:1788987060.225781:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993687168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987060.225796:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788987060.225813:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54a964 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a95d expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987060.225837:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54a964 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a95d expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987060.225848:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54a964 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a95d expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987060.225856:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1800, rc 0) 00000100:00100000:2.0:1788987060.225928:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993687168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 148us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987060.225935:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00100000:1.0:1788987060.226029:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993687168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987060.226045:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a964 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.226055:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a964 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987060.226113:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788987060.226119:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a964 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.226128:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a964 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.292284:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788987060.353053:0:105718:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffd9e9dbc90 20000000:00000080:3.0:1788987060.353186:0:105718:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7fbb8c00 uarg=0000000000000000 10000000:01000000:3.0:1788987060.353418:0:105718:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788987060.353437:0:105718:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987060.353455:0:105718:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54a964 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a95d expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987060.353539:0:105718:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987060.353576:0:105718:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54a964 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a95d expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987060.353591:0:105718:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54a964 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a95d expref: 18 pid: 5849 timeout: 2944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987060.353615:0:105718:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105718:1875885993687296:0@lo:104: 00000100:00100000:3.0:1788987060.353678:0:105718:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987060.353788:0:105718:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a439f1f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788987060.353862:0:7642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788987060.353874:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993687296 00000100:00100000:0.0:1788987060.353879:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993687296 00000100:00100000:0.0:1788987060.353958:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 412 00000100:00100000:0.0:1788987060.353967:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a76061050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105718:x1875885993687296:12345-0@lo:104: 00010000:00010000:0.0:1788987060.353979:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a964 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987060.354107:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987060.354113:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a76061050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105718:x1875885993687296:12345-0@lo:104: Request processed in 148us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987060.354120:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 412 00000100:00100000:3.0:1788987060.354210:0:105718:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105718:1875885993687296:0@lo:104: 00010000:00010000:3.0:1788987060.354226:0:105718:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354372:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788987060.354379:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a964 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354388:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788987060.354391:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a964 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354400:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a964 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788987060.354408:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a964 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987060.354413:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788987060.354490:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a964 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354497:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788987060.354523:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a964 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354530:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2600/0xc20d828fcf54a95d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a964 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354546:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987060.354547:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987060.354549:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987060.354556:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788987060.354566:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993687424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788987060.354610:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987060.354647:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993687424 00000100:00100000:1.0:1788987060.354651:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993687424 00010000:00010000:1.0:1788987060.354668:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54a964 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a95d expref: 19 pid: 5849 timeout: 2944 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987060.354690:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1788987060.354696:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45613050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993687424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788987060.354705:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788987060.354710:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54a964 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a95d expref: 19 pid: 5849 timeout: 2944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354719:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54a964 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a95d expref: 19 pid: 5849 timeout: 2944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354731:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1800/0xc20d828fcf54a964 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a95d expref: 19 pid: 5849 timeout: 2944 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354742:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354749:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354763:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354770:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354777:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354788:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354793:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788987060.354797:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354803:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354815:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987060.354824:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788987060.354853:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45613050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993687424:12345-0@lo:103:ldlm_bl.0 Request processed in 157us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987060.354859:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00000100:00100000:1.0:1788987060.354907:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993687424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987060.355320:0:105718:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987060.355334:0:105718:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987060.355340:0:105718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54a96b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105718 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987061.249987:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993687552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788987061.250055:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987061.252892:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993687552 00000100:00100000:2.0:1788987061.252907:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993687552 00000100:00100000:2.0:1788987061.252970:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1788987061.252980:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993687552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788987061.253010:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987061.253120:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993687552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (3065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987061.253127:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:2.0:1788987061.253187:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993687552:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788987061.253385:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788987061.316319:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987062.272524:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993687808:0@lo:400:kworker.0 00000100:00100000:3.0:1788987062.272606:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987062.272649:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993688320:0@lo:400:kworker.0 00000100:00100000:3.0:1788987062.272672:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987062.272692:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788987062.272698:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993687936:0@lo:400:kworker.0 00000100:00100000:3.0:1788987062.272717:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987062.272824:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993688064:0@lo:400:kworker.0 00000100:00100000:2.0:1788987062.272851:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987062.272882:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788987062.272887:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993687680:0@lo:400:kworker.0 00000100:00100000:2.0:1788987062.272910:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987062.272930:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993688192:0@lo:400:kworker.0 00000100:00100000:2.0:1788987062.272948:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987062.272974:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993687680 00000100:00100000:2.0:1788987062.272980:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993687680 00000100:00100000:2.0:1788987062.273015:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:2.0:1788987062.273022:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993687680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987062.273063:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993687680:12345-0@lo:400:kworker.0 Request processed in 41us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987062.273069:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00100000:2.0:1788987062.273117:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993687808 00000100:00100000:2.0:1788987062.273120:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993687808 00000100:00100000:2.0:1788987062.273140:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993687936 00000100:00100000:2.0:1788987062.273143:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993687936 00000100:00100000:2.0:1788987062.273163:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993688192 00000100:00100000:2.0:1788987062.273165:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993688192 00000100:00100000:2.0:1788987062.273177:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2038 00000100:00100000:2.0:1788987062.273182:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993687808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987062.273214:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993687808:12345-0@lo:400:kworker.0 Request processed in 32us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987062.273220:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2038 00000100:00100000:2.0:1788987062.273243:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2039 00000100:00100000:2.0:1788987062.273248:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993687936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987062.273271:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993687936:12345-0@lo:400:kworker.0 Request processed in 24us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987062.273277:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2039 00000100:00100000:2.0:1788987062.273286:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2040 00000100:00100000:2.0:1788987062.273291:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993688192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987062.273312:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993688192:12345-0@lo:400:kworker.0 Request processed in 21us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987062.273321:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2040 00000100:00080000:2.0:1788987062.273340:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987062.273364:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993687680:0@lo:400:kworker.0 00000100:00100000:2.0:1788987062.273375:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993688192:0@lo:400:kworker.0 00000100:00100000:2.0:1788987062.273398:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993687936:0@lo:400:kworker.0 00000100:00100000:2.0:1788987062.273406:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993687808:0@lo:400:kworker.0 00000100:00100000:0.0:1788987062.273518:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993688320 00000100:00100000:0.0:1788987062.273523:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993688320 00000100:00100000:0.0:1788987062.273564:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993688064 00000100:00100000:0.0:1788987062.273567:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993688064 00000100:00100000:0.0:1788987062.273581:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00100000:0.0:1788987062.273598:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993688320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987062.273633:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993688320:12345-0@lo:400:kworker.0 Request processed in 36us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987062.273638:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00100000:0.0:1788987062.273649:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:0.0:1788987062.273654:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993688064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987062.273680:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993688064:12345-0@lo:400:kworker.0 Request processed in 27us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987062.273686:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00100000:0.0:1788987062.273716:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80715c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993688320:0@lo:400:kworker.0 00000100:00080000:2.0:1788987062.275075:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788987062.275139:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80717b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993688064:0@lo:400:kworker.0 10000000:01000000:1.0:1788987062.336384:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788987062.336390:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788987062.336395:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788987062.336413:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987062.336435:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987062.336447:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987062.336459:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987062.336487:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993688448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788987062.336566:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987062.336618:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c616c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788987062.336627:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993688448 00000100:00100000:3.0:1788987062.336636:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993688448 00000100:00100000:3.0:1788987062.336688:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:3.0:1788987062.336697:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993688448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987062.336710:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788987062.336723:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a979 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a972 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987062.336745:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a979 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a972 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987062.336756:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a979 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a972 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987062.336764:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2a00, rc 0) 00000100:00100000:3.0:1788987062.336808:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993688448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987062.336816:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00100000:1.0:1788987062.337080:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993688448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987062.337125:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a979 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987062.337135:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a979 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987062.337151:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788987062.337156:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a979 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987062.337164:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a979 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987062.786390:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788987062.786412:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993688576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788987062.786472:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987062.788513:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993688576 00000100:00100000:2.0:1788987062.788523:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993688576 00000100:00100000:2.0:1788987062.788608:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:2.0:1788987062.788618:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993688576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788987062.788651:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987062.788724:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993688576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987062.788730:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:2.0:1788987062.788877:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993688576:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788987063.366142:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788987064.194602:0:105915:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe30e99120 20000000:00000080:1.0:1788987064.194620:0:105915:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a79743c00 uarg=0000000000000000 10000000:01000000:1.0:1788987064.195238:0:105915:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788987064.195258:0:105915:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987064.195274:0:105915:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a979 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a972 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987064.195281:0:105915:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987064.195329:0:105915:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a979 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a972 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987064.195343:0:105915:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a979 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a972 expref: 18 pid: 5848 timeout: 2948 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987064.195357:0:105915:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105915:1875885993688704:0@lo:104: 00000100:00100000:1.0:1788987064.195415:0:105915:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987064.195459:0:105915:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eac180 going to sleep for 11 seconds 00000100:00100000:0.0:1788987064.196007:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993688704 00000100:00100000:0.0:1788987064.196016:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993688704 00000100:00100000:0.0:1788987064.196073:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 413 00000100:00100000:0.0:1788987064.196083:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105915:x1875885993688704:12345-0@lo:104: 00010000:00010000:0.0:1788987064.196117:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a979 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987064.196408:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987064.196415:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105915:x1875885993688704:12345-0@lo:104: Request processed in 334us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987064.196423:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 413 00000100:00100000:1.0:1788987064.197434:0:105915:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105915:1875885993688704:0@lo:104: 00010000:00010000:1.0:1788987064.197466:0:105915:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.201640:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788987064.201653:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a979 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.201664:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788987064.201669:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a979 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.201683:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a979 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788987064.201690:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a979 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987064.201695:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788987064.201783:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a979 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.201789:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788987064.201818:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a979 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.201825:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54a972 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a979 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.201845:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987064.201847:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987064.201849:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987064.201920:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993688832:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788987064.201979:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987064.202291:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993688832 00000100:00100000:2.0:1788987064.202298:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993688832 00010000:00010000:2.0:1788987064.202333:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a979 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a972 expref: 19 pid: 5848 timeout: 2948 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987064.202364:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1788987064.202371:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993688832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987064.202382:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987064.202387:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a979 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a972 expref: 19 pid: 5848 timeout: 2948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.202398:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a979 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a972 expref: 19 pid: 5848 timeout: 2948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.202412:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2a00/0xc20d828fcf54a979 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a972 expref: 19 pid: 5848 timeout: 2948 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.202424:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.202433:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.202447:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.202455:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.202470:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.202477:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.202483:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40031a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987064.202487:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.202494:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.202513:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987064.202522:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987064.202567:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993688832:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987064.202584:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:2.0:1788987064.202622:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993688832:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987064.202812:0:105915:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987064.202821:0:105915:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987064.202827:0:105915:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40031a00/0xc20d828fcf54a980 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105915 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987064.384235:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987065.433085:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788987065.436817:0:105965:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2458a340 20000000:00000080:2.0:1788987065.436837:0:105965:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b0a797dd800 uarg=0000000000000000 20000000:01000000:2.0:1788987065.436875:0:105965:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='nodemap..fileset=/c0dir' 20000000:01000000:2.0:1788987065.436880:0:105965:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'nodemap..fileset=/c0dir' 20000000:01000000:2.0:1788987065.436885:0:105965:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/nodemap..fileset=/c0dir del=0 00000040:00080000:2.0:1788987065.444767:0:105966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788987065.444937:0:105965:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.nodemap..fileset=/c0dir in log params 00000040:00080000:1.0:1788987065.455419:0:105965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788987065.455476:0:105965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 112 off9648 00000040:00080000:1.0:1788987065.455530:0:105965:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9872 10000000:01000000:1.0:1788987065.455549:0:105965:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788987065.455581:0:105965:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.455599:0:105965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ee200/0xc20d828fcf544351 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54434a expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.455607:0:105965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a43d49c00/0xc20d828fcf54435f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf544358 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.455614:0:105965:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54436d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf544366 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.455623:0:105965:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 6/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.455673:0:105965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54436d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf544366 expref: 17 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.455688:0:105965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54436d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf544366 expref: 17 pid: 5849 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987065.455704:0:105965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105965:1875885993688960:0@lo:104: 00000100:00100000:1.0:1788987065.455760:0:105965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788987065.455955:0:105965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a43d49c00/0xc20d828fcf54435f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf544358 expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.455964:0:105965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a43d49c00/0xc20d828fcf54435f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf544358 expref: 17 pid: 5846 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987065.455973:0:105965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105965:1875885993689088:0@lo:104: 00000100:00100000:1.0:1788987065.455997:0:105965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788987065.457149:0:105965:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ee200/0xc20d828fcf544351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54434a expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.457161:0:105965:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ee200/0xc20d828fcf544351 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54434a expref: 17 pid: 5846 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987065.457247:0:105965:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105965:1875885993689216:0@lo:104: 00000100:00100000:1.0:1788987065.457284:0:105965:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987065.457321:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993688960 00000100:00100000:0.0:1788987065.457330:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993688960 00000100:00100000:0.0:1788987065.457385:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993689088 00000100:00100000:0.0:1788987065.457389:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993689088 00000100:00100000:0.0:1788987065.457404:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1788987065.457413:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+4:105965:x1875885993688960:12345-0@lo:104: 00010000:00010000:0.0:1788987065.457427:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48200/0xc20d828fcf544366 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54436d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.457478:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987065.457485:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+4:105965:x1875885993688960:12345-0@lo:104: Request processed in 73us (1725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987065.457491:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 414 00000100:00100000:0.0:1788987065.457508:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 415 00000100:00100000:0.0:1788987065.457513:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105965:x1875885993689088:12345-0@lo:104: 00010000:00010000:0.0:1788987065.457520:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a6b031c00/0xc20d828fcf544358 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54435f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.457553:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788987065.457558:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105965:x1875885993689088:12345-0@lo:104: Request processed in 46us (1561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987065.457563:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 415 00010000:00010000:0.0:1788987065.457593:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788987065.457599:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48200/0xc20d828fcf544366 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54436d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.457606:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48200 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788987065.457611:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48200/0xc20d828fcf544366 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54436d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.457620:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48200/0xc20d828fcf544366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54436d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788987065.457628:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48200/0xc20d828fcf544366 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54436d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987065.457634:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788987065.457671:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48200/0xc20d828fcf544366 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54436d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.457677:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788987065.457697:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48200/0xc20d828fcf544366 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54436d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.457704:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48200/0xc20d828fcf544366 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54436d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.457718:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788987065.457721:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a6b031c00/0xc20d828fcf544358 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54435f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.457727:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a6b031c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788987065.457730:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a6b031c00/0xc20d828fcf544358 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54435f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.457737:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a6b031c00/0xc20d828fcf544358 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54435f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788987065.457747:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a6b031c00/0xc20d828fcf544358 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54435f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987065.457752:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788987065.458595:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a6b031c00/0xc20d828fcf544358 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54435f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.458603:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788987065.458621:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a6b031c00/0xc20d828fcf544358 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54435f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.458628:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a6b031c00/0xc20d828fcf544358 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54435f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.458649:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987065.458650:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987065.458652:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987065.458675:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993689344:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788987065.458714:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987065.458752:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993689344 00000100:00100000:0.0:1788987065.458756:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993689344 00010000:00010000:0.0:1788987065.458883:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54436d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf544366 expref: 18 pid: 5849 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987065.458908:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1788987065.458915:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993689344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987065.458926:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987065.458931:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54436d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf544366 expref: 18 pid: 5849 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.458941:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54436d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf544366 expref: 18 pid: 5849 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.458956:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788987065.458984:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993689344:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987065.458990:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1788987065.459024:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993689344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987065.460309:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987065.460330:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993689472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788987065.460370:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987065.461421:0:105965:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5ab389c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788987065.461445:0:105965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54436d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf544366 expref: 17 pid: 5849 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987065.461460:0:105965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105965:1875885993688960:0@lo:104: 00000100:00100000:1.0:1788987065.461469:0:105965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105965:1875885993689088:0@lo:104: 00000100:00100000:0.0:1788987065.461623:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993689472 00000100:00100000:0.0:1788987065.461629:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993689472 00010000:00010000:0.0:1788987065.461657:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a43d49c00/0xc20d828fcf54435f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf544358 expref: 17 pid: 5846 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987065.461802:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993689216 00000100:00100000:3.0:1788987065.461808:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993689216 00000100:00100000:0.0:1788987065.461826:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1788987065.461837:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+17:3320:x1875885993689472:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788987065.461848:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 416 00010000:00010000:0.0:1788987065.461849:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987065.461857:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a43d49c00/0xc20d828fcf54435f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf544358 expref: 17 pid: 5846 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987065.461862:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105965:x1875885993689216:12345-0@lo:104: 00010000:00010000:0.0:1788987065.461873:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a43d49c00/0xc20d828fcf54435f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf544358 expref: 17 pid: 5846 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.461877:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a6b030000/0xc20d828fcf54434a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf544351 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.461891:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d49c00/0xc20d828fcf54435f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf544358 expref: 17 pid: 5846 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.461904:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788987065.461942:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+16:3320:x1875885993689472:12345-0@lo:103:ldlm_bl.0 Request processed in 108us (1571us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987065.461953:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00010000:00010000:3.0:1788987065.461967:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788987065.462021:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993689472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788987065.462124:0:105965:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:105965:1875885993689216:0@lo:104: 00010000:00010000:1.0:1788987065.462151:0:105965:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987065.462197:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:105965:x1875885993689216:12345-0@lo:104: Request processed in 118us (4690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987065.462205:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 416 00010000:00010000:3.0:1788987065.462222:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987065.462229:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a6b030000/0xc20d828fcf54434a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf544351 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462237:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a6b030000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987065.462242:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a6b030000/0xc20d828fcf54434a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf544351 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462251:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a6b030000/0xc20d828fcf54434a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf544351 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987065.462259:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a6b030000/0xc20d828fcf54434a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf544351 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987065.462265:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788987065.462302:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a6b030000/0xc20d828fcf54434a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf544351 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462310:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987065.462334:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a6b030000/0xc20d828fcf54434a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf544351 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462342:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a6b030000/0xc20d828fcf54434a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf544351 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987065.462349:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1788987065.462358:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987065.462361:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987065.462362:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993689600:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987065.462364:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987065.462395:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987065.462485:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993689600 00000100:00100000:3.0:1788987065.462489:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993689600 00010000:00010000:3.0:1788987065.462504:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ee200/0xc20d828fcf544351 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54434a expref: 16 pid: 5846 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987065.462556:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1788987065.462564:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+16:3320:x1875885993689600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987065.462584:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788987065.462589:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ee200/0xc20d828fcf544351 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54434a expref: 16 pid: 5846 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462599:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ee200/0xc20d828fcf544351 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54434a expref: 16 pid: 5846 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462609:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee200/0xc20d828fcf544351 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54434a expref: 16 pid: 5846 timeout: 2949 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462621:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462635:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462647:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462654:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462661:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462668:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462673:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987065.462677:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462685:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462709:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987065.462717:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788987065.462751:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+15:3320:x1875885993689600:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987065.462757:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00010000:00010000:1.0:1788987065.462797:0:105965:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.462807:0:105965:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.462814:0:105965:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a987 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 105965 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987065.463028:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993689600:0@lo:103:ldlm_bl.0 10000000:01000000:1.0:1788987065.616197:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788987065.616204:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b0a7630e000 from 7 10000000:01000000:1.0:1788987065.616209:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788987065.616252:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.616264:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.616276:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987065.616301:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993689728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788987065.616372:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987065.616419:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5ab389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788987065.617037:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993689728 00000100:00100000:2.0:1788987065.617045:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993689728 00000100:00100000:2.0:1788987065.617123:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:2.0:1788987065.617133:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+15:5851:x1875885993689728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987065.617146:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788987065.617161:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a995 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a98e expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987065.617188:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a98e expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987065.617199:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a98e expref: 16 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987065.617208:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1000, rc 0) 00000100:00100000:2.0:1788987065.617261:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+16:5851:x1875885993689728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987065.617267:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00100000:1.0:1788987065.620268:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993689728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987065.620293:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.620306:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987065.620381:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993689856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788987065.620448:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987065.620494:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5ab389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788987065.620563:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993689856 00000100:00100000:0.0:1788987065.620581:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993689856 00000100:00100000:0.0:1788987065.620621:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:0.0:1788987065.620629:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+16:5851:x1875885993689856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.620878:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+16:5851:x1875885993689856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987065.620886:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:1.0:1788987065.621749:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993689856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788987065.621789:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993689984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788987065.621833:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987065.621866:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5ab389c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788987065.628789:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993689984 00000100:00100000:0.0:1788987065.628802:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993689984 00000100:00100000:0.0:1788987065.628849:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:0.0:1788987065.628858:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+16:5851:x1875885993689984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.629108:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+16:5851:x1875885993689984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (7255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987065.629116:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:0.0:1788987065.629183:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993689984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.629348:0:105972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b823764-e7a6-4601-a766-b07f91a03a4c:105972:1875885993690112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788987065.629385:0:105972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987065.629408:0:105972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a5ab389c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788987065.629561:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993690112 00000100:00100000:2.0:1788987065.629574:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993690112 00000100:00100000:2.0:1788987065.629608:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:2.0:1788987065.629615:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+16:105972:x1875885993690112:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788987065.629744:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+16:105972:x1875885993690112:12345-0@lo:502:llog_process_th.0 Request processed in 129us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987065.629751:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:0.0:1788987065.630036:0:105972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b823764-e7a6-4601-a766-b07f91a03a4c:105972:1875885993690112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788987065.630059:0:105972:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788987065.630068:0:105972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788987065.630070:0:105972:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:0.0:1788987065.630076:0:105972:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b0a7630e000 00000020:00000080:0.0:1788987065.630078:0:105972:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:00020000:0.0:1788987065.632057:0:105972:0:(obd_config.c:1432:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 1937us 00000100:00100000:0.0:1788987065.671695:0:105972:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b823764-e7a6-4601-a766-b07f91a03a4c:105972:1875885993690240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788987065.671776:0:105972:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987065.671816:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993690240 00000100:00100000:0.0:1788987065.671823:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993690240 00000100:00100000:0.0:1788987065.671875:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:0.0:1788987065.671884:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+16:105972:x1875885993690240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788987065.672123:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+16:105972:x1875885993690240:12345-0@lo:502:llog_process_th.0 Request processed in 241us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987065.672131:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:0.0:1788987065.672179:0:105972:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812300 going to sleep for 11 seconds 00000100:00100000:0.0:1788987065.672199:0:105972:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b823764-e7a6-4601-a766-b07f91a03a4c:105972:1875885993690240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788987065.672226:0:105972:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788987065.672234:0:105972:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788987065.672237:0:105972:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:0.0:1788987065.672241:0:105972:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788987065.672295:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788987065.672318:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788987065.672327:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672337:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987065.672352:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788987065.672354:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788987065.672357:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788987065.672380:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672388:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672396:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987065.672410:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993690368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.672452:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987065.672471:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812300 going to sleep for 11 seconds 00000100:00100000:0.0:1788987065.672483:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993690368 00000100:00100000:0.0:1788987065.672487:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993690368 00000100:00100000:0.0:1788987065.672509:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:0.0:1788987065.672516:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+16:5851:x1875885993690368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987065.672525:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788987065.672536:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54a9a3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a99c expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672557:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54a9a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a99c expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672577:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54a9a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a99c expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672590:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef200, rc 0) 00000100:00100000:0.0:1788987065.672620:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993690368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987065.672625:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:0.0:1788987065.672653:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993690368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987065.672664:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9a3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672672:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a9a3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987065.672685:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788987065.672689:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9a3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672696:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9a3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987065.672702:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788987065.672704:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b0a457e9000 from 7 10000000:01000000:0.0:1788987065.672706:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788987065.672719:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672726:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672732:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987065.672744:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993690496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.672766:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987065.672778:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812300 going to sleep for 11 seconds 00000100:00100000:0.0:1788987065.672788:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993690496 00000100:00100000:0.0:1788987065.672791:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993690496 00000100:00100000:0.0:1788987065.672805:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:0.0:1788987065.672810:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993690496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987065.672816:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788987065.672823:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54a9b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a9aa expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672835:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54a9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a9aa expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672842:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54a9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a9aa expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672848:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508eea00, rc 0) 00000100:00100000:0.0:1788987065.672872:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993690496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987065.672877:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:0.0:1788987065.672902:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993690496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987065.672911:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.672918:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a9b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987065.672957:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993690624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.672977:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987065.672988:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812300 going to sleep for 11 seconds 00000100:00100000:0.0:1788987065.672997:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993690624 00000100:00100000:0.0:1788987065.673000:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993690624 00000100:00100000:0.0:1788987065.673014:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:0.0:1788987065.673019:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993690624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.673215:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993690624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 195us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987065.673222:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:0.0:1788987065.673248:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993690624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.673269:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993690752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.673300:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987065.673318:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812300 going to sleep for 11 seconds 00000100:00100000:0.0:1788987065.673329:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993690752 00000100:00100000:0.0:1788987065.673332:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993690752 00000100:00100000:0.0:1788987065.673351:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546 00000100:00100000:0.0:1788987065.673356:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993690752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.673462:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993690752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987065.673469:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546 00000100:00100000:0.0:1788987065.682117:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993690752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788987065.682725:0:105976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80716680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b823764-e7a6-4601-a766-b07f91a03a4c:105976:1875885993690880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788987065.682786:0:105976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987065.682823:0:105976:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f550cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788987065.683007:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993690880 00000100:00100000:1.0:1788987065.683014:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993690880 00000100:00100000:1.0:1788987065.683058:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:1.0:1788987065.683066:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:105976:x1875885993690880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788987065.683277:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:105976:x1875885993690880:12345-0@lo:502:llog_process_th.0 Request processed in 211us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987065.683285:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1788987065.683367:0:105976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80716680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b823764-e7a6-4601-a766-b07f91a03a4c:105976:1875885993690880:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788987065.683392:0:105976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788987065.683401:0:105976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788987065.683403:0:105976:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:3.0:1788987065.683411:0:105976:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b0a457e9000 00000020:00000080:3.0:1788987065.683413:0:105976:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:00020000:2.0:1788987065.686779:0:105976:0:(obd_config.c:1432:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 3351us 00000100:00100000:2.0:1788987065.686835:0:105976:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b823764-e7a6-4601-a766-b07f91a03a4c:105976:1875885993691008:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788987065.687226:0:105976:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987065.687271:0:105976:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941eac9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788987065.687687:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993691008 00000100:00100000:0.0:1788987065.687695:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993691008 00000100:00100000:0.0:1788987065.687745:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:0.0:1788987065.687754:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:105976:x1875885993691008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788987065.688274:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:105976:x1875885993691008:12345-0@lo:502:llog_process_th.0 Request processed in 520us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987065.688282:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00100000:2.0:1788987065.688386:0:105976:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b823764-e7a6-4601-a766-b07f91a03a4c:105976:1875885993691008:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788987065.688418:0:105976:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788987065.688425:0:105976:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788987065.688429:0:105976:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:2.0:1788987065.688433:0:105976:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788987065.695215:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788987065.695251:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788987065.695262:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.695275:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987065.695286:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788987065.695288:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b0a48710000 from 7 10000000:01000000:0.0:1788987065.695291:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788987065.695328:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.695337:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.695349:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987065.695375:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993691136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.695451:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987065.695493:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812300 going to sleep for 11 seconds 00000100:00100000:2.0:1788987065.696175:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993691136 00000100:00100000:2.0:1788987065.696184:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993691136 00000100:00100000:2.0:1788987065.696231:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:2.0:1788987065.696240:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993691136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987065.696253:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788987065.696267:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54a9bf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a9b8 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987065.696291:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54a9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a9b8 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987065.696303:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54a9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a9b8 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987065.696311:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1600, rc 0) 00000100:00100000:2.0:1788987065.696365:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993691136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987065.696372:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:0.0:1788987065.697935:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993691136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987065.697959:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987065.697970:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a9bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987065.698035:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993691264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.698078:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987065.698136:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812300 going to sleep for 11 seconds 00000100:00100000:1.0:1788987065.698243:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993691264 00000100:00100000:1.0:1788987065.698249:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993691264 00000100:00100000:1.0:1788987065.698284:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:1.0:1788987065.698292:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993691264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788987065.698557:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993691264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 264us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987065.698564:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:0.0:1788987065.698836:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993691264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.698865:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993691392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788987065.698902:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987065.698933:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a80812300 going to sleep for 11 seconds 00000100:00100000:3.0:1788987065.700115:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993691392 00000100:00100000:3.0:1788987065.700122:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993691392 00000100:00100000:3.0:1788987065.700160:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1788987065.700167:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993691392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788987065.700335:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993691392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987065.700342:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:0.0:1788987065.701065:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993691392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788987065.720737:0:105978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b823764-e7a6-4601-a766-b07f91a03a4c:105978:1875885993691520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788987065.720808:0:105978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987065.720857:0:105978:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a44db3240 going to sleep for 11 seconds 00000100:00100000:1.0:1788987065.720944:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993691520 00000100:00100000:1.0:1788987065.720951:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993691520 00000100:00100000:1.0:1788987065.720992:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:1.0:1788987065.721000:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:105978:x1875885993691520:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788987065.721212:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:105978:x1875885993691520:12345-0@lo:502:llog_process_th.0 Request processed in 212us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987065.721220:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00100000:1.0:1788987065.721271:0:105978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b823764-e7a6-4601-a766-b07f91a03a4c:105978:1875885993691520:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788987065.721295:0:105978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788987065.721303:0:105978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788987065.721305:0:105978:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) general nodemap..fileset 00000020:01000000:1.0:1788987065.721311:0:105978:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9b0a48710000 00000020:00000080:1.0:1788987065.721313:0:105978:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:00020000:1.0:1788987065.748724:0:105978:0:(obd_config.c:1432:process_param2_config()) lctl: error invoking upcall /usr/sbin/lctl set_param nodemap..fileset=/c0dir: rc = -2; time 27397us 00000100:00100000:1.0:1788987065.748783:0:105978:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b823764-e7a6-4601-a766-b07f91a03a4c:105978:1875885993691648:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788987065.748859:0:105978:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987065.748893:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993691648 00000100:00100000:1.0:1788987065.748899:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993691648 00000100:00100000:1.0:1788987065.748948:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00100000:1.0:1788987065.748956:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:105978:x1875885993691648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788987065.749150:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:105978:x1875885993691648:12345-0@lo:502:llog_process_th.0 Request processed in 194us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987065.749161:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00100000:1.0:1788987065.749207:0:105978:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51df20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788987065.749225:0:105978:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:2b823764-e7a6-4601-a766-b07f91a03a4c:105978:1875885993691648:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788987065.749249:0:105978:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788987065.749256:0:105978:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788987065.749258:0:105978:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) general nodemap..fileset 00000040:00080000:1.0:1788987065.749262:0:105978:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788987065.749315:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788987065.749332:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788987065.749341:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987065.749351:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987066.368667:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987066.368687:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993691776:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788987066.368749:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987066.368840:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993691776 00000100:00100000:3.0:1788987066.368848:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993691776 00000100:00100000:3.0:1788987066.368908:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1788987066.368917:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993691776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987066.368947:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987066.368990:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993691776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987066.368997:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00080000:1.0:1788987066.369054:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788987066.369114:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993691776:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788987066.432365:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987067.405500:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993692160:0@lo:400:kworker.0 00000100:00100000:0.0:1788987067.405575:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987067.405632:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788987067.405639:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993692032:0@lo:400:kworker.0 00000100:00100000:0.0:1788987067.405664:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987067.405683:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993692544:0@lo:400:kworker.0 00000100:00100000:0.0:1788987067.405705:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987067.405736:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993692160 00000100:00100000:0.0:1788987067.405743:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993692160 00000100:00100000:0.0:1788987067.405789:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993692032 00000100:00100000:0.0:1788987067.405792:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993692032 00000100:00100000:0.0:1788987067.405813:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2041 00000100:00100000:0.0:1788987067.405822:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993692160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987067.405882:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993692160:12345-0@lo:400:kworker.0 Request processed in 61us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987067.405889:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2041 00000100:00100000:0.0:1788987067.405907:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2042 00000100:00100000:0.0:1788987067.405914:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993692032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987067.405941:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993692032:12345-0@lo:400:kworker.0 Request processed in 28us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987067.405947:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2042 00000100:00100000:0.0:1788987067.405971:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993692544 00000100:00100000:0.0:1788987067.405975:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993692544 00000100:00100000:0.0:1788987067.406004:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1788987067.406010:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993692544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987067.406053:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993692544:12345-0@lo:400:kworker.0 Request processed in 43us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987067.406059:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1788987067.406131:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993692032:0@lo:400:kworker.0 00000100:00100000:0.0:1788987067.406142:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993692544:0@lo:400:kworker.0 00000100:00100000:0.0:1788987067.406150:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993692160:0@lo:400:kworker.0 00000100:00100000:1.0:1788987067.406647:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993691904:0@lo:400:kworker.0 00000100:00100000:1.0:1788987067.406682:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987067.406720:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993692416:0@lo:400:kworker.0 00000100:00100000:1.0:1788987067.406742:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987067.406764:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987067.406769:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993692288:0@lo:400:kworker.0 00000100:00100000:1.0:1788987067.406790:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788987067.406813:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788987067.406818:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987067.406827:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993692416 00000100:00100000:1.0:1788987067.406831:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993692416 00000100:00100000:1.0:1788987067.406865:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2043 00000100:00100000:1.0:1788987067.406872:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993692416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987067.406907:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993692416:12345-0@lo:400:kworker.0 Request processed in 36us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987067.406928:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2043 00000100:00100000:1.0:1788987067.406946:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993692288 00000100:00100000:1.0:1788987067.406950:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993692288 00000100:00100000:1.0:1788987067.406973:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:1.0:1788987067.406979:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993692288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987067.407010:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993692288:12345-0@lo:400:kworker.0 Request processed in 31us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987067.407016:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00080000:1.0:1788987067.407044:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987067.407064:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993692288:0@lo:400:kworker.0 00000100:00100000:1.0:1788987067.407074:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993692416:0@lo:400:kworker.0 00000100:00100000:0.0:1788987067.411141:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993691904 00000100:00100000:0.0:1788987067.411156:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993691904 00000100:00100000:0.0:1788987067.411207:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:0.0:1788987067.411217:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993691904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987067.411301:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993691904:12345-0@lo:400:kworker.0 Request processed in 85us (4617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987067.411309:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00100000:3.0:1788987067.417200:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993691904:0@lo:400:kworker.0 00010000:00010000:3.0:1788987067.456205:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987067.906133:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788987067.906153:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993692672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788987067.906209:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987067.906259:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993692672 00000100:00100000:0.0:1788987067.906265:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993692672 00000100:00100000:0.0:1788987067.906302:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1788987067.906309:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993692672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987067.906338:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987067.906373:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993692672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987067.906379:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:0.0:1788987067.906415:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993692672:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788987068.482836:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987069.507936:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987070.536173:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987071.514348:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993692800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788987071.514426:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987071.514506:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993692800 00000100:00100000:2.0:1788987071.514512:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993692800 00000100:00100000:2.0:1788987071.514571:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:2.0:1788987071.514579:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993692800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788987071.514610:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987071.514657:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993692800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987071.514663:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00080000:2.0:1788987071.514680:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788987071.514713:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993692800:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788987071.555459:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987072.519573:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993692928:0@lo:400:kworker.0 00000100:00100000:0.0:1788987072.519641:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987072.519758:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993692928 00000100:00100000:1.0:1788987072.519766:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993692928 00000100:00100000:1.0:1788987072.520577:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:1.0:1788987072.520587:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993692928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987072.523022:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993692928:12345-0@lo:400:kworker.0 Request processed in 2430us (3373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987072.523039:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:1.0:1788987072.523137:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993693056:0@lo:400:kworker.0 00000100:00100000:3.0:1788987072.523148:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993693184:0@lo:400:kworker.0 00000100:00100000:2.0:1788987072.523241:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993693312:0@lo:400:kworker.0 00000100:00100000:0.0:1788987072.526396:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993692928:0@lo:400:kworker.0 00000100:00100000:0.0:1788987072.526432:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993693440:0@lo:400:kworker.0 00000100:00100000:3.0:1788987072.529660:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987072.529713:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788987072.529738:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993693568:0@lo:400:kworker.0 00000100:00100000:3.0:1788987072.529783:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987072.529823:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993693184 00000100:00100000:3.0:1788987072.529831:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993693184 00000100:00100000:3.0:1788987072.529886:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2044 00000100:00100000:3.0:1788987072.529895:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993693184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987072.529942:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993693184:12345-0@lo:400:kworker.0 Request processed in 49us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987072.529949:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2044 00000100:00100000:3.0:1788987072.529972:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993693568 00000100:00100000:3.0:1788987072.529975:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993693568 00000100:00100000:3.0:1788987072.530000:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:3.0:1788987072.530007:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993693568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987072.530035:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993693568:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987072.530041:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:3.0:1788987072.530074:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80905180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993693568:0@lo:400:kworker.0 00000100:00100000:3.0:1788987072.530085:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993693184:0@lo:400:kworker.0 00000100:00080000:3.0:1788987072.530204:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788987072.530208:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987072.530385:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987072.530593:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993693056 00000100:00100000:3.0:1788987072.530598:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993693056 00000100:00100000:3.0:1788987072.530670:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2045 00000100:00100000:3.0:1788987072.530678:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993693056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987072.530800:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993693056:0@lo:400:kworker.0 00000100:00100000:3.0:1788987072.530846:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993693056:12345-0@lo:400:kworker.0 Request processed in 43us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987072.530854:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2045 00000100:00100000:2.0:1788987072.531312:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987072.531407:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993693312 00000100:00100000:1.0:1788987072.531413:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993693312 00000100:00100000:1.0:1788987072.531488:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:1.0:1788987072.531497:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993693312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987072.531562:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993693312:12345-0@lo:400:kworker.0 Request processed in 66us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987072.531569:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00100000:0.0:1788987072.533618:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987072.533692:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993693440 00000100:00100000:0.0:1788987072.533700:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993693440 00000100:00100000:0.0:1788987072.533822:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2046 00000100:00100000:0.0:1788987072.533831:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993693440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987072.533894:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993693440:12345-0@lo:400:kworker.0 Request processed in 64us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987072.533901:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2046 00000100:00080000:0.0:1788987072.533920:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987072.533961:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993693440:0@lo:400:kworker.0 00000100:00100000:3.0:1788987072.534544:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993693312:0@lo:400:kworker.0 00010000:00010000:1.0:1788987072.576846:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987073.024354:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993693696:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788987073.024427:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987073.024554:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993693696 00000100:00100000:0.0:1788987073.024564:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993693696 00000100:00100000:0.0:1788987073.024622:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1788987073.024632:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993693696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987073.024668:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987073.024714:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993693696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987073.024721:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1788987073.024812:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993693696:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788987073.518665:0:106266:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-sec: start setup 16:51:11 (1788987071) === 00010000:00010000:0.0:1788987073.600853:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987074.625662:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987075.649203:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987076.608436:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788987076.608456:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993693824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987076.608527:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987076.608590:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993693824 00000100:00100000:3.0:1788987076.608597:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993693824 00000100:00100000:3.0:1788987076.608646:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:3.0:1788987076.608655:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993693824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987076.608686:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987076.608733:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993693824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987076.608741:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00080000:3.0:1788987076.608761:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788987076.608794:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993693824:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788987076.678083:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987077.632418:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993694208:0@lo:400:kworker.0 00000100:00100000:1.0:1788987077.632482:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987077.632556:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788987077.632562:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993694080:0@lo:400:kworker.0 00000100:00100000:1.0:1788987077.632585:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987077.632602:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993694592:0@lo:400:kworker.0 00000100:00100000:1.0:1788987077.632625:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987077.632655:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993694208 00000100:00100000:1.0:1788987077.632662:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993694208 00000100:00100000:1.0:1788987077.632711:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993694080 00000100:00100000:1.0:1788987077.632715:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993694080 00000100:00100000:1.0:1788987077.632734:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2047 00000100:00100000:1.0:1788987077.632742:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993694208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987077.632792:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993694208:12345-0@lo:400:kworker.0 Request processed in 50us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987077.632799:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2047 00000100:00100000:1.0:1788987077.632816:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2048 00000100:00100000:1.0:1788987077.632822:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993694080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987077.632848:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993694080:12345-0@lo:400:kworker.0 Request processed in 26us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987077.632854:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2048 00000100:00100000:2.0:1788987077.633161:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993694336:0@lo:400:kworker.0 00000100:00100000:2.0:1788987077.633190:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987077.633224:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788987077.633230:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993693952:0@lo:400:kworker.0 00000100:00100000:2.0:1788987077.633256:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987077.633279:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993694464:0@lo:400:kworker.0 00000100:00100000:2.0:1788987077.633298:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987077.633326:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993694592 00000100:00100000:2.0:1788987077.633329:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993694592 00000100:00100000:2.0:1788987077.633357:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993694336 00000100:00100000:2.0:1788987077.633360:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993694336 00000100:00100000:2.0:1788987077.633377:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:2.0:1788987077.633383:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993694592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987077.633416:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993694592:12345-0@lo:400:kworker.0 Request processed in 33us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987077.633425:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:2.0:1788987077.633438:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:2.0:1788987077.633444:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993694336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987077.633477:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993694336:12345-0@lo:400:kworker.0 Request processed in 33us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987077.633483:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000100:00100000:2.0:1788987077.633499:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993694464 00000100:00100000:2.0:1788987077.633512:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993694464 00000100:00100000:2.0:1788987077.633530:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2049 00000100:00100000:2.0:1788987077.633536:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993694464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987077.633567:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80906300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993694464:12345-0@lo:400:kworker.0 Request processed in 32us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987077.633573:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2049 00000100:00100000:2.0:1788987077.633615:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993694464:0@lo:400:kworker.0 00000100:00100000:2.0:1788987077.633626:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993694336:0@lo:400:kworker.0 00000100:00080000:1.0:1788987077.633838:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788987077.633843:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987077.633858:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993693952 00000100:00100000:1.0:1788987077.633872:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993693952 00000100:00100000:1.0:1788987077.633895:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:1.0:1788987077.633902:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993693952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987077.633934:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993693952:12345-0@lo:400:kworker.0 Request processed in 33us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987077.633939:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:1.0:1788987077.634194:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993694080:0@lo:400:kworker.0 00000100:00100000:1.0:1788987077.634207:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993694592:0@lo:400:kworker.0 00000100:00100000:1.0:1788987077.634216:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993694208:0@lo:400:kworker.0 00000100:00100000:2.0:1788987077.634403:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993693952:0@lo:400:kworker.0 00010000:00010000:0.0:1788987077.697799:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987078.159942:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993694720:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788987078.160014:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987078.160080:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993694720 00000100:00100000:0.0:1788987078.160255:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993694720 00000100:00100000:0.0:1788987078.160302:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1788987078.160310:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993694720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987078.160339:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987078.160390:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993694720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (375us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987078.160397:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:0.0:1788987078.160439:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993694720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788987078.723944:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987079.748873:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987080.768287:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987081.728640:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788987081.728663:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993694848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788987081.728729:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987081.728819:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993694848 00000100:00100000:2.0:1788987081.728827:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993694848 00000100:00100000:2.0:1788987081.728887:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:2.0:1788987081.728897:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993694848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788987081.728932:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987081.729005:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993694848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987081.729012:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:2.0:1788987081.729062:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80904e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993694848:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788987081.729769:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788987081.792392:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987082.752775:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993695232:0@lo:400:kworker.0 00000100:00100000:0.0:1788987082.752840:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987082.752902:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788987082.752909:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993695104:0@lo:400:kworker.0 00000100:00100000:0.0:1788987082.752934:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987082.753218:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993695616:0@lo:400:kworker.0 00000100:00100000:0.0:1788987082.753246:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987082.753319:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993695616 00000100:00100000:3.0:1788987082.753326:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993695616 00000100:00100000:3.0:1788987082.753384:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1561 00000100:00100000:3.0:1788987082.753392:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993695616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987082.753458:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993695616:12345-0@lo:400:kworker.0 Request processed in 67us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987082.753466:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1561 00000100:00100000:3.0:1788987082.753517:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993695616:0@lo:400:kworker.0 00000100:00100000:2.0:1788987082.753644:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993695232 00000100:00100000:2.0:1788987082.753650:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993695232 00000100:00100000:2.0:1788987082.753687:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993695104 00000100:00100000:2.0:1788987082.753691:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993695104 00000100:00100000:2.0:1788987082.753710:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2050 00000100:00100000:2.0:1788987082.753718:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993695232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987082.753762:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993695232:12345-0@lo:400:kworker.0 Request processed in 45us (922us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987082.753768:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2050 00000100:00100000:2.0:1788987082.753781:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2051 00000100:00100000:2.0:1788987082.753787:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993695104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987082.753816:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993695104:12345-0@lo:400:kworker.0 Request processed in 29us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987082.753821:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2051 00000100:00100000:2.0:1788987082.753843:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993694976:0@lo:400:kworker.0 00000100:00100000:2.0:1788987082.753873:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987082.753896:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993695488:0@lo:400:kworker.0 00000100:00100000:2.0:1788987082.753917:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987082.753935:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788987082.754151:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993695360:0@lo:400:kworker.0 00000100:00100000:2.0:1788987082.754177:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987082.754205:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993695360 00000100:00100000:2.0:1788987082.754209:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993695360 00000100:00100000:2.0:1788987082.754233:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:2.0:1788987082.754239:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993695360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987082.754272:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993695360:12345-0@lo:400:kworker.0 Request processed in 33us (94us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987082.754278:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:2.0:1788987082.754308:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993695360:0@lo:400:kworker.0 00000100:00080000:0.0:1788987082.754370:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788987082.754375:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788987082.754511:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993695488 00000100:00100000:1.0:1788987082.754516:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993695488 00000100:00100000:1.0:1788987082.754564:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2052 00000100:00100000:1.0:1788987082.754571:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993695488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987082.754590:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79795f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993695104:0@lo:400:kworker.0 00000100:00100000:3.0:1788987082.754601:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993695232:0@lo:400:kworker.0 00000100:00100000:1.0:1788987082.754607:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80904e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993695488:12345-0@lo:400:kworker.0 Request processed in 38us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987082.754612:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2052 00000100:00100000:1.0:1788987082.754632:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993694976 00000100:00100000:1.0:1788987082.754635:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993694976 00000100:00100000:1.0:1788987082.754655:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:1.0:1788987082.754660:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993694976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987082.754688:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993694976:12345-0@lo:400:kworker.0 Request processed in 27us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987082.754693:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:3.0:1788987082.754720:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79797800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993694976:0@lo:400:kworker.0 00000100:00100000:3.0:1788987082.754731:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993695488:0@lo:400:kworker.0 00000100:00080000:0.0:1788987082.754756:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788987082.821350:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987083.265652:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788987083.265673:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993695744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788987083.265745:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987083.267422:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993695744 00000100:00100000:2.0:1788987083.267433:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993695744 00000100:00100000:2.0:1788987083.267507:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:2.0:1788987083.267517:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993695744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788987083.267552:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987083.267641:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993695744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (1896us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987083.267649:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:1.0:1788987083.267805:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993695744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788987083.840982:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987084.865184:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987085.892861:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987086.856187:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987086.856216:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993695872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788987086.856306:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987086.856398:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993695872 00000100:00100000:1.0:1788987086.856408:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993695872 00000100:00100000:1.0:1788987086.856508:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1788987086.856520:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993695872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788987086.856564:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987086.856619:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993695872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987086.856627:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:1.0:1788987086.858136:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993695872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788987086.858663:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788987086.919120:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788987087.463543:0:106673:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg621-server.virtnet: executing load_modules_local 00000100:00100000:2.0:1788987087.876692:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993696256:0@lo:400:kworker.0 00000100:00100000:2.0:1788987087.876755:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987087.876818:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788987087.876824:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993696128:0@lo:400:kworker.0 00000100:00100000:2.0:1788987087.876844:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987087.876858:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993696640:0@lo:400:kworker.0 00000100:00100000:2.0:1788987087.876877:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987087.876915:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993696256 00000100:00100000:2.0:1788987087.876923:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993696256 00000100:00100000:2.0:1788987087.876992:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993696128 00000100:00100000:2.0:1788987087.876996:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993696128 00000100:00100000:2.0:1788987087.877017:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2053 00000100:00100000:2.0:1788987087.877026:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993696256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987087.877077:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993696256:12345-0@lo:400:kworker.0 Request processed in 51us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987087.877084:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2053 00000100:00100000:2.0:1788987087.877135:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2054 00000100:00100000:2.0:1788987087.877141:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993696128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987087.877170:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993696128:12345-0@lo:400:kworker.0 Request processed in 29us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987087.877176:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2054 00000100:00080000:2.0:1788987087.877192:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987087.877221:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993696128:0@lo:400:kworker.0 00000100:00100000:2.0:1788987087.877231:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993696256:0@lo:400:kworker.0 00000100:00100000:1.0:1788987087.878683:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993696000:0@lo:400:kworker.0 00000100:00100000:1.0:1788987087.878745:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987087.878786:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993696512:0@lo:400:kworker.0 00000100:00100000:1.0:1788987087.878809:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987087.878834:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987087.878841:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993696384:0@lo:400:kworker.0 00000100:00100000:1.0:1788987087.878862:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987087.878895:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993696512 00000100:00100000:1.0:1788987087.878912:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993696512 00000100:00100000:1.0:1788987087.878970:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2055 00000100:00100000:1.0:1788987087.878986:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993696512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987087.879036:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993696512:12345-0@lo:400:kworker.0 Request processed in 58us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987087.879042:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2055 00000100:00100000:1.0:1788987087.879064:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993696640 00000100:00100000:1.0:1788987087.879068:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993696640 00000100:00100000:1.0:1788987087.879117:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993696384 00000100:00100000:1.0:1788987087.879121:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993696384 00000100:00100000:1.0:1788987087.879139:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:1.0:1788987087.879146:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993696640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987087.879182:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993696640:12345-0@lo:400:kworker.0 Request processed in 37us (2303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987087.879188:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:1.0:1788987087.879201:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:1.0:1788987087.879207:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993696384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987087.879235:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993696384:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987087.879240:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00080000:1.0:1788987087.879665:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788987087.879670:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987087.879696:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993696384:0@lo:400:kworker.0 00000100:00100000:1.0:1788987087.879706:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993696512:0@lo:400:kworker.0 00000100:00100000:1.0:1788987087.879741:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993696640:0@lo:400:kworker.0 00000100:00100000:2.0:1788987087.882839:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993696000 00000100:00100000:2.0:1788987087.882852:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993696000 00000100:00100000:2.0:1788987087.882914:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1558 00000100:00100000:2.0:1788987087.882923:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993696000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987087.883039:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993696000:12345-0@lo:400:kworker.0 Request processed in 117us (4293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987087.883045:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1558 00000100:00100000:3.0:1788987087.883219:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993696000:0@lo:400:kworker.0 00010000:00010000:0.0:1788987087.938239:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987088.412254:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993696768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788987088.412320:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987088.412386:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993696768 00000100:00100000:0.0:1788987088.412393:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993696768 00000100:00100000:0.0:1788987088.412436:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1788987088.412460:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993696768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987088.412491:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987088.412539:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993696768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987088.412547:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1788987088.412589:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993696768:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788987088.968997:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987089.985401:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987091.010240:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987091.969324:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993696896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987091.969389:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987091.969470:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993696896 00000100:00100000:3.0:1788987091.969478:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993696896 00000100:00100000:3.0:1788987091.969731:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1788987091.969742:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993696896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987091.969782:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987091.969831:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993696896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987091.969837:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00080000:3.0:1788987091.969858:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788987091.969895:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80714a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993696896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788987092.053847:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987092.992571:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993697408:0@lo:400:kworker.0 00000100:00100000:1.0:1788987092.992674:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987092.992959:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788987092.992970:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993697024:0@lo:400:kworker.0 00000100:00100000:1.0:1788987092.993008:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987092.993035:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993697536:0@lo:400:kworker.0 00000100:00100000:1.0:1788987092.993068:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987092.993138:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993697152:0@lo:400:kworker.0 00000100:00100000:1.0:1788987092.993167:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987092.993186:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993697664:0@lo:400:kworker.0 00000100:00100000:1.0:1788987092.993210:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987092.993229:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788987092.993235:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993697280:0@lo:400:kworker.0 00000100:00100000:1.0:1788987092.993262:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987092.993503:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993697408 00000100:00100000:1.0:1788987092.993514:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993697408 00000100:00100000:1.0:1788987092.993581:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993697664 00000100:00100000:1.0:1788987092.993585:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993697664 00000100:00100000:1.0:1788987092.993794:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:1.0:1788987092.993806:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993697408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987092.993905:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:3.0:1788987092.993917:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993697664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987092.993977:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993697664:12345-0@lo:400:kworker.0 Request processed in 62us (765us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987092.993984:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:1.0:1788987092.994921:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993697408:12345-0@lo:400:kworker.0 Request processed in 1112us (2242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987092.994931:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00100000:1.0:1788987092.994973:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993697024 00000100:00100000:1.0:1788987092.994979:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993697024 00000100:00100000:1.0:1788987092.995016:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1559 00000100:00100000:1.0:1788987092.995025:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993697024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987092.995066:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993697024:12345-0@lo:400:kworker.0 Request processed in 42us (2058us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987092.995072:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1559 00000100:00100000:1.0:1788987092.995124:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993697536 00000100:00100000:1.0:1788987092.995129:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993697536 00000100:00100000:1.0:1788987092.995165:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993697152 00000100:00100000:1.0:1788987092.995168:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993697152 00000100:00100000:1.0:1788987092.995187:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993697280 00000100:00100000:1.0:1788987092.995190:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993697280 00000100:00100000:1.0:1788987092.995207:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2056 00000100:00100000:1.0:1788987092.995213:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993697536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987092.995247:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993697536:12345-0@lo:400:kworker.0 Request processed in 34us (2178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987092.995253:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2056 00000100:00100000:1.0:1788987092.995272:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2057 00000100:00100000:1.0:1788987092.995279:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993697152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987092.995310:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80999f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993697152:12345-0@lo:400:kworker.0 Request processed in 32us (2142us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987092.995316:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2057 00000100:00100000:1.0:1788987092.995328:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2058 00000100:00100000:1.0:1788987092.995335:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993697280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987092.995363:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80998700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993697280:12345-0@lo:400:kworker.0 Request processed in 29us (2101us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987092.995369:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2058 00000100:00080000:1.0:1788987092.995401:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788987092.995406:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788987092.995588:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993697024:0@lo:400:kworker.0 00000100:00100000:3.0:1788987092.995607:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993697536:0@lo:400:kworker.0 00000100:00100000:3.0:1788987092.995619:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993697408:0@lo:400:kworker.0 00000100:00100000:3.0:1788987092.998532:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993697280:0@lo:400:kworker.0 00000100:00100000:3.0:1788987092.998556:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993697152:0@lo:400:kworker.0 00000100:00100000:3.0:1788987092.998570:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993697664:0@lo:400:kworker.0 00010000:00010000:3.0:1788987093.060764:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788987093.406068:0:106934:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00000100:00100000:3.0:1788987093.504444:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788987093.504466:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a8099b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993697792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788987093.504528:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987093.504625:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993697792 00000100:00100000:1.0:1788987093.504634:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993697792 00000100:00100000:1.0:1788987093.504683:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:1.0:1788987093.504692:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993697792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788987093.504723:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987093.504770:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993697792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987093.504777:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:1.0:1788987093.504818:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a8099b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993697792:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788987094.088519:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987095.106169:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987096.131146:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987097.088268:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993697920:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987097.088370:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987097.088599:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993697920 00000100:00100000:1.0:1788987097.088609:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993697920 00000100:00100000:1.0:1788987097.088688:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:1.0:1788987097.088701:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993697920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788987097.088745:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987097.088812:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993697920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987097.088821:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00080000:1.0:1788987097.088850:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788987097.088918:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993697920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788987097.169971:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987098.112596:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993698176:0@lo:400:kworker.0 00000100:00100000:2.0:1788987098.112704:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987098.112782:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993698688:0@lo:400:kworker.0 00000100:00100000:2.0:1788987098.112808:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987098.112852:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788987098.112859:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993698304:0@lo:400:kworker.0 00000100:00100000:2.0:1788987098.112883:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987098.112918:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993698688 00000100:00100000:2.0:1788987098.112924:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993698688 00000100:00100000:2.0:1788987098.112977:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:2.0:1788987098.112987:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993698688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987098.113038:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993698688:12345-0@lo:400:kworker.0 Request processed in 52us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987098.113045:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00100000:2.0:1788987098.113069:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993698176 00000100:00100000:2.0:1788987098.113073:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993698176 00000100:00100000:2.0:1788987098.113135:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993698304 00000100:00100000:2.0:1788987098.113139:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993698304 00000100:00100000:2.0:1788987098.113160:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2059 00000100:00100000:2.0:1788987098.113167:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993698176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987098.113199:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993698176:12345-0@lo:400:kworker.0 Request processed in 33us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987098.113204:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2059 00000100:00100000:2.0:1788987098.113216:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2060 00000100:00100000:2.0:1788987098.113221:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993698304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987098.113246:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993698304:12345-0@lo:400:kworker.0 Request processed in 26us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987098.113252:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2060 00000100:00080000:2.0:1788987098.113268:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788987098.113272:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788987098.113306:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993698304:0@lo:400:kworker.0 00000100:00100000:2.0:1788987098.113317:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993698176:0@lo:400:kworker.0 00000100:00100000:2.0:1788987098.113328:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993698688:0@lo:400:kworker.0 00000100:00100000:0.0:1788987098.113620:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993698048:0@lo:400:kworker.0 00000100:00100000:0.0:1788987098.113657:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987098.113693:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993698560:0@lo:400:kworker.0 00000100:00100000:0.0:1788987098.113716:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987098.113745:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788987098.113751:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993698432:0@lo:400:kworker.0 00000100:00100000:0.0:1788987098.113774:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987098.113806:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993698432 00000100:00100000:0.0:1788987098.113810:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993698432 00000100:00100000:0.0:1788987098.113840:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:0.0:1788987098.113846:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993698432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987098.113880:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993698432:12345-0@lo:400:kworker.0 Request processed in 34us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987098.113886:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00000100:00100000:0.0:1788987098.113912:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993698432:0@lo:400:kworker.0 00000100:00100000:3.0:1788987098.113970:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993698560 00000100:00100000:3.0:1788987098.113975:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993698560 00000100:00100000:3.0:1788987098.114015:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2061 00000100:00100000:3.0:1788987098.114022:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993698560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987098.114056:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993698560:12345-0@lo:400:kworker.0 Request processed in 36us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987098.114062:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2061 00000100:00080000:0.0:1788987098.114662:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987098.114686:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993698560:0@lo:400:kworker.0 00000100:00100000:2.0:1788987098.114794:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993698048 00000100:00100000:2.0:1788987098.114800:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993698048 00000100:00100000:2.0:1788987098.115038:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1560 00000100:00100000:2.0:1788987098.115048:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993698048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987098.115123:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993698048:12345-0@lo:400:kworker.0 Request processed in 77us (1465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987098.115130:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1560 00000100:00100000:0.0:1788987098.115198:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993698048:0@lo:400:kworker.0 00010000:00010000:1.0:1788987098.177286:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788987098.435540:0:107131:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00000020:00000004:0.0:1788987098.449525:0:107132:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00000020:00000004:1.0:1788987098.485050:0:107133:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from lsi ino=0, dev=0 00000100:00100000:1.0:1788987098.635011:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993698816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788987098.635081:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987098.646694:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993698816 00000100:00100000:2.0:1788987098.646710:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993698816 00000100:00100000:2.0:1788987098.646830:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:2.0:1788987098.646842:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993698816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788987098.646892:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987098.648022:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993698816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1177us (12934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987098.648033:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1788987098.659192:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993698816:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788987099.200441:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788987099.513233:0:107181:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd03c65710 20000000:00000080:2.0:1788987099.513250:0:107181:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b0a45073000 uarg=0000000000000000 20000000:01000000:2.0:1788987099.513282:0:107181:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788987099.513328:0:107181:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788987099.513333:0:107181:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788987099.513997:0:107182:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788987099.516784:0:107181:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788987099.529946:0:107181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788987099.529979:0:107181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987099.529998:0:107181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a995 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a98e expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987099.530006:0:107181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54a9b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a9aa expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987099.530012:0:107181:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54a9bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a9b8 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987099.530019:0:107181:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 6/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987099.530069:0:107181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54a9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a9b8 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987099.530085:0:107181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54a9bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a9b8 expref: 18 pid: 5846 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987099.531320:0:107181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107181:1875885993698944:0@lo:104: 00000100:00100000:2.0:1788987099.531389:0:107181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788987099.531463:0:107181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54a9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a9aa expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987099.531473:0:107181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54a9b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a9aa expref: 18 pid: 5846 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987099.531482:0:107181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107181:1875885993699072:0@lo:104: 00000100:00100000:1.0:1788987099.531493:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993698944 00000100:00100000:2.0:1788987099.531505:0:107181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987099.531512:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993698944 00010000:00010000:2.0:1788987099.531580:0:107181:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a995 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a98e expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987099.531589:0:107181:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a995 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a98e expref: 18 pid: 5849 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987099.531598:0:107181:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107181:1875885993699200:0@lo:104: 00000100:00100000:2.0:1788987099.531625:0:107181:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987099.539360:0:107181:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7fe23240 going to sleep for 11 seconds 00000100:00100000:1.0:1788987099.543301:0:5837:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788987099.543338:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993699072 00000100:00100000:1.0:1788987099.543352:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993699072 00000100:00100000:1.0:1788987099.543425:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993699200 00000100:00100000:1.0:1788987099.543432:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993699200 00000100:00100000:1.0:1788987099.543462:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 417 00000100:00100000:1.0:1788987099.543475:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+5:107181:x1875885993698944:12345-0@lo:104: 00010000:00010000:1.0:1788987099.543516:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a9bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987099.544962:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788987099.544973:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+5:107181:x1875885993698944:12345-0@lo:104: Request processed in 1500us (13590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987099.544982:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 417 00000100:00100000:2.0:1788987099.545007:0:107181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107181:1875885993698944:0@lo:104: 00000100:00100000:1.0:1788987099.545011:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 418 00000100:00100000:1.0:1788987099.545019:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+4:107181:x1875885993699072:12345-0@lo:104: 00010000:00010000:1.0:1788987099.545032:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a9b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987099.545140:0:107181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ae300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107181:1875885993699072:0@lo:104: 00000100:00100000:0.0:1788987099.546574:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00000100:00100000:0.0:1788987099.546592:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 419 00000100:00100000:0.0:1788987099.546610:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a794a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+4:107181:x1875885993699200:12345-0@lo:104: 00010000:00010000:0.0:1788987099.546625:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.546707:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788987099.546713:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a794a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+4:107181:x1875885993699200:12345-0@lo:104: Request processed in 114us (15088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987099.546721:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 419 00010000:00010000:0.0:1788987099.546866:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788987099.546873:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a9bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.546881:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eec00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788987099.546886:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a9bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.546895:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a9bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788987099.546902:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a9bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987099.546909:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788987099.546951:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.546957:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788987099.546981:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.546988:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508eec00/0xc20d828fcf54a9b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9bf expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.547003:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788987099.547006:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.547012:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a40030600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788987099.547015:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.547021:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788987099.547028:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987099.547033:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788987099.547045:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.547051:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788987099.547057:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.547064:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a40030600/0xc20d828fcf54a98e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a995 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.547074:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987099.547077:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987099.547078:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987099.547131:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993699328:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788987099.547171:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987099.547206:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788987099.547213:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993699456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788987099.547234:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987099.547260:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993699328 00000100:00100000:0.0:1788987099.547267:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993699328 00010000:00010000:0.0:1788987099.547291:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54a9bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a9b8 expref: 19 pid: 5846 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987099.547314:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993699456 00000100:00100000:0.0:1788987099.547317:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993699456 00010000:00010000:0.0:1788987099.547328:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a995 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a98e expref: 20 pid: 5849 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987099.547346:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1788987099.547353:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+20:3318:x1875885993699328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987099.547363:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987099.547368:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54a9bf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a9b8 expref: 20 pid: 5846 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.547378:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54a9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a9b8 expref: 20 pid: 5846 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.547405:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54a9bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a9b8 expref: 20 pid: 5846 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.547417:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788987099.547447:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993699328:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987099.547454:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:0.0:1788987099.547468:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1788987099.547474:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993699456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987099.547482:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987099.547486:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a995 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a98e expref: 18 pid: 5849 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.547494:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a995 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a98e expref: 18 pid: 5849 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.547503:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788987099.547523:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993699456:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987099.547529:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:0.0:1788987099.547567:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993699456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788987099.547575:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993699328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987099.547737:0:107181:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54a995 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a98e expref: 17 pid: 5849 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987099.547748:0:107181:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:107181:1875885993699200:0@lo:104: 00010000:00010000:2.0:1788987099.547773:0:107181:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.548977:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987099.549953:0:7642:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 0 new 8192-byte reqbufs (1/2 left), rc = 0 00010000:00010000:1.0:1788987099.550944:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788987099.550963:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:107181:x1875885993699072:12345-0@lo:104: Request processed in 5939us (19450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987099.550978:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 418 00010000:00010000:0.0:1788987099.551014:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788987099.551023:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a9b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551032:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef000 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788987099.551037:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a9b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551046:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a9b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788987099.551054:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a9b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987099.551060:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788987099.551141:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551148:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788987099.551183:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551190:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef000/0xc20d828fcf54a9aa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9b1 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551206:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987099.551208:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987099.551210:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987099.551297:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788987099.551314:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993699584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788987099.551373:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987099.551458:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993699584 00000100:00100000:0.0:1788987099.551465:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993699584 00010000:00010000:0.0:1788987099.551491:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54a9b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a9aa expref: 17 pid: 5846 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987099.551522:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:0.0:1788987099.551530:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45610c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+17:3321:x1875885993699584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987099.551542:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987099.551546:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54a9b1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a9aa expref: 17 pid: 5846 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551557:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54a9b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a9aa expref: 17 pid: 5846 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551571:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54a9b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a9aa expref: 17 pid: 5846 timeout: 2983 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551584:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551592:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551607:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551614:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551620:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551626:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551631:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788987099.551635:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.551641:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987099.555470:0:107181:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987099.555486:0:107181:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.558561:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.558584:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54a9c6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 107181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987099.558606:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788987099.560130:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45610c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+16:3321:x1875885993699584:12345-0@lo:103:ldlm_bl.0 Request processed in 8594us (8749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987099.560144:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1788987099.562243:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993699584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987100.245513:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788987100.801736:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788987100.801743:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b0a7630e000 from 10 10000000:01000000:0.0:1788987100.801748:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788987100.801787:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987100.801798:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987100.801808:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987100.801830:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993699712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788987100.801898:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987100.801935:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09489bfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788987100.801954:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993699712 00000100:00100000:0.0:1788987100.801959:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993699712 00000100:00100000:0.0:1788987100.801998:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1561 00000100:00100000:0.0:1788987100.802005:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+16:5851:x1875885993699712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987100.802016:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788987100.802027:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54a9d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a9cd expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987100.802048:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54a9d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a9cd expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987100.802058:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54a9d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a9cd expref: 17 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987100.802067:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef600, rc 0) 00000100:00100000:0.0:1788987100.802119:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993699712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987100.802125:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1561 00000100:00100000:0.0:1788987100.802165:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993699712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987100.802177:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987100.802186:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a9d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987100.802231:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993699840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788987100.802256:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987100.802269:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09489bfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788987100.802280:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993699840 00000100:00100000:0.0:1788987100.802283:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993699840 00000100:00100000:0.0:1788987100.802300:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1562 00000100:00100000:0.0:1788987100.802305:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993699840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788987100.803623:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993699840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1314us (1363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987100.803704:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1562 00000100:00100000:0.0:1788987100.803800:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993699840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788987100.803937:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993699968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788987100.803996:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987100.804027:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09489bfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788987100.804048:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993699968 00000100:00100000:0.0:1788987100.804054:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993699968 00000100:00100000:0.0:1788987100.804132:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1563 00000100:00100000:0.0:1788987100.804143:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993699968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788987100.804323:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993699968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987100.806568:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1563 00000100:00100000:0.0:1788987100.807025:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993699968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788987100.811466:0:107217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788987100.819960:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788987100.820000:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788987100.820013:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987100.820030:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987100.825575:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788987100.825581:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b0a457e9000 from 10 10000000:01000000:3.0:1788987100.825585:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788987100.825625:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987100.825693:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987100.825704:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987100.825727:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993700096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788987100.826420:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987100.826460:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a76058f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788987100.826762:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993700096 00000100:00100000:0.0:1788987100.826771:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993700096 00000100:00100000:0.0:1788987100.826944:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:0.0:1788987100.826954:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993700096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987100.826968:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788987100.826981:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a9e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a9db expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987100.827004:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a9e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a9db expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987100.827020:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a9e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a9db expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987100.827031:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508efa00, rc 0) 00000100:00100000:0.0:1788987100.827138:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993700096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987100.827147:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:0.0:1788987100.827235:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993700096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987100.830125:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987100.830145:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a9e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987100.830269:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993700224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788987100.830345:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987100.830388:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09489bf480 going to sleep for 11 seconds 00000100:00100000:2.0:1788987100.833903:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993700224 00000100:00100000:2.0:1788987100.833915:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993700224 00000100:00100000:2.0:1788987100.833967:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1565 00000100:00100000:2.0:1788987100.833977:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993700224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788987100.834262:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993700224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 287us (3916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987100.834273:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1565 00000100:00100000:2.0:1788987100.834341:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993700224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788987100.834400:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993700352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788987100.834446:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987100.834476:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a500cce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788987100.834489:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993700352 00000100:00100000:2.0:1788987100.834504:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993700352 00000100:00100000:2.0:1788987100.834527:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1566 00000100:00100000:2.0:1788987100.834534:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993700352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788987100.834677:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993700352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987100.834683:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1566 00000100:00100000:2.0:1788987100.834725:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993700352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788987100.841146:0:107219:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788987100.841450:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788987100.841472:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788987100.841482:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987100.841504:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987100.841515:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788987100.841518:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b0a48710000 from 10 10000000:01000000:2.0:1788987100.841521:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788987100.841556:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987100.841570:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987100.841580:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987100.841605:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993700480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788987100.841807:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987100.841984:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0948b95780 going to sleep for 11 seconds 00000100:00100000:1.0:1788987100.842415:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993700480 00000100:00100000:1.0:1788987100.842423:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993700480 00000100:00100000:1.0:1788987100.842461:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:1.0:1788987100.842470:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993700480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987100.842483:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987100.842556:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a9f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54a9e9 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987100.842579:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54a9e9 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987100.842590:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a9e9 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987100.842597:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788987100.842713:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993700480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 242us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987100.842719:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00100000:2.0:1788987100.842928:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993700480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987100.842943:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987100.842951:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54a9f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987100.842998:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993700608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788987100.843023:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987100.843054:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0948b95780 going to sleep for 11 seconds 00000100:00100000:1.0:1788987100.843178:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993700608 00000100:00100000:1.0:1788987100.843183:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993700608 00000100:00100000:1.0:1788987100.843254:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1568 00000100:00100000:1.0:1788987100.843262:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993700608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788987100.843510:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993700608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987100.843517:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1568 00000100:00100000:2.0:1788987100.843662:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993700608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788987100.843689:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993700736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788987100.843727:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987100.858477:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993700736 00000100:00100000:3.0:1788987100.859590:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993700736 00000100:00100000:2.0:1788987100.859786:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0948b95780 going to sleep for 11 seconds 00000100:00100000:3.0:1788987100.860370:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569 00000100:00100000:3.0:1788987100.860396:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993700736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788987100.861765:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993700736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788987100.862573:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993700736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1097us (17758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987100.862589:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569 00000040:00080000:2.0:1788987100.865986:0:107221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788987100.866577:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788987100.866599:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788987100.866610:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987100.866622:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54a9f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:2.0:1788987101.056431:0:107234:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from lsi ino=8776, dev=0 00010000:00010000:1.0:1788987101.248599:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987102.211563:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788987102.211585:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993700864:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788987102.211650:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987102.211725:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993700864 00000100:00100000:1.0:1788987102.211733:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993700864 00000100:00100000:1.0:1788987102.211787:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:1.0:1788987102.211796:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993700864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788987102.211826:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987102.211881:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993700864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987102.211888:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00080000:1.0:1788987102.211908:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788987102.212273:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993700864:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788987102.272268:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987103.232419:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993701248:0@lo:400:kworker.0 00000100:00100000:3.0:1788987103.232483:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987103.232556:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788987103.232564:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993701376:0@lo:400:kworker.0 00000100:00100000:3.0:1788987103.232590:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987103.232626:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993701376 00000100:00100000:3.0:1788987103.232634:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993701376 00000100:00100000:3.0:1788987103.232712:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569 00000100:00100000:3.0:1788987103.232724:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993701376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987103.232783:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993701376:12345-0@lo:400:kworker.0 Request processed in 62us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987103.232790:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569 00000100:00100000:3.0:1788987103.232845:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993701376:0@lo:400:kworker.0 00000100:00100000:2.0:1788987103.233243:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993701120:0@lo:400:kworker.0 00000100:00100000:2.0:1788987103.233274:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987103.233317:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993701632:0@lo:400:kworker.0 00000100:00100000:2.0:1788987103.233344:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987103.233373:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788987103.233379:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993700992:0@lo:400:kworker.0 00000100:00100000:2.0:1788987103.233403:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987103.233426:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993701504:0@lo:400:kworker.0 00000100:00100000:2.0:1788987103.233446:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987103.233475:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993700992 00000100:00100000:2.0:1788987103.233479:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993700992 00000100:00100000:2.0:1788987103.233503:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:2.0:1788987103.233509:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993700992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987103.233544:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993700992:12345-0@lo:400:kworker.0 Request processed in 35us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987103.233549:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00100000:2.0:1788987103.233587:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80716680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993700992:0@lo:400:kworker.0 00000100:00100000:1.0:1788987103.233867:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993701248 00000100:00100000:1.0:1788987103.233872:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993701248 00000100:00100000:1.0:1788987103.233912:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993701120 00000100:00100000:1.0:1788987103.233915:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993701120 00000100:00100000:1.0:1788987103.233929:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993701504 00000100:00100000:1.0:1788987103.233931:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993701504 00000100:00100000:1.0:1788987103.233946:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2062 00000100:00100000:1.0:1788987103.233952:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993701248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987103.233990:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993701248:12345-0@lo:400:kworker.0 Request processed in 38us (1507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987103.233996:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2062 00000100:00100000:1.0:1788987103.234008:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1788987103.234013:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993701120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987103.234045:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993701120:12345-0@lo:400:kworker.0 Request processed in 31us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987103.234058:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2063 00000100:00100000:1.0:1788987103.234070:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2064 00000100:00100000:1.0:1788987103.234076:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993701504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987103.234124:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993701504:12345-0@lo:400:kworker.0 Request processed in 49us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987103.234130:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2064 00000100:00100000:1.0:1788987103.234159:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993701504:0@lo:400:kworker.0 00000100:00100000:1.0:1788987103.234168:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993701120:0@lo:400:kworker.0 00000100:00080000:0.0:1788987103.234238:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987103.234334:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993701632 00000100:00100000:3.0:1788987103.234339:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993701632 00000100:00100000:3.0:1788987103.234395:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1570 00000100:00100000:3.0:1788987103.234408:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993701632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987103.234447:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993701632:12345-0@lo:400:kworker.0 Request processed in 46us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987103.234453:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1570 00000100:00100000:3.0:1788987103.234491:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993701248:0@lo:400:kworker.0 00000100:00100000:3.0:1788987103.234534:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993701632:0@lo:400:kworker.0 00000100:00080000:0.0:1788987103.234603:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788987103.308526:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987103.744279:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993701760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788987103.744344:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987103.744535:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993701760 00000100:00100000:0.0:1788987103.744543:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993701760 00000100:00100000:0.0:1788987103.744592:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1788987103.744600:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993701760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987103.744632:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987103.744683:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993701760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987103.744690:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:3.0:1788987103.744768:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993701760:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788987104.320427:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987105.344379:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788987106.089737:0:107430:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from lsi ino=8776, dev=0 00000020:00000004:2.0:1788987106.101813:0:107431:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from lsi ino=8776, dev=0 00000020:00000004:2.0:1788987106.135732:0:107432:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from lsi ino=8776, dev=0 00010000:00010000:2.0:1788987106.373243:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987107.328835:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788987107.328858:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993701888:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987107.328920:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987107.328980:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993701888 00000100:00100000:3.0:1788987107.328987:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993701888 00000100:00100000:3.0:1788987107.329048:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1788987107.329057:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993701888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987107.329111:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987107.329155:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79795f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993701888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987107.329162:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00080000:3.0:1788987107.329183:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788987107.329221:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79794e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993701888:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788987107.398149:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987108.355596:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993702144:0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.355690:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987108.355751:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993702656:0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.355781:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987108.355823:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788987108.355829:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993702016:0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.355877:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987108.355903:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993702528:0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.355925:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987108.355954:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993702272:0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.355982:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987108.356003:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788987108.356010:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993702400:0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.356032:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987108.356067:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993702144 00000100:00100000:0.0:1788987108.356076:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993702144 00000100:00100000:0.0:1788987108.356161:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2065 00000100:00100000:0.0:1788987108.356170:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993702144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.356232:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993702144:12345-0@lo:400:kworker.0 Request processed in 62us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987108.356240:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2065 00000100:00100000:0.0:1788987108.356263:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993702528 00000100:00100000:0.0:1788987108.356266:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993702528 00000100:00100000:3.0:1788987108.356532:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993702016 00000100:00100000:3.0:1788987108.356538:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993702016 00000100:00100000:3.0:1788987108.356605:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:3.0:1788987108.356616:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993702016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987108.356661:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993702016:12345-0@lo:400:kworker.0 Request processed in 49us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987108.356666:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:0.0:1788987108.356932:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993702272 00000100:00100000:0.0:1788987108.356938:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993702272 00000100:00100000:0.0:1788987108.356968:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2066 00000100:00100000:0.0:1788987108.356975:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993702528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.357013:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993702528:12345-0@lo:400:kworker.0 Request processed in 39us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987108.357020:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2066 00000100:00100000:0.0:1788987108.357031:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2067 00000100:00100000:0.0:1788987108.357037:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993702272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.357084:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993702272:12345-0@lo:400:kworker.0 Request processed in 46us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987108.357117:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2067 00000100:00100000:0.0:1788987108.357141:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993702656 00000100:00100000:0.0:1788987108.357145:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993702656 00000100:00100000:0.0:1788987108.357176:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993702400 00000100:00100000:0.0:1788987108.357179:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993702400 00000100:00100000:0.0:1788987108.357194:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:0.0:1788987108.357200:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993702656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.357233:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993702656:12345-0@lo:400:kworker.0 Request processed in 34us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987108.357240:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:0.0:1788987108.357251:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:0.0:1788987108.357257:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993702400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.357283:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993702400:12345-0@lo:400:kworker.0 Request processed in 27us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987108.357289:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:3.0:1788987108.357953:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993702400:0@lo:400:kworker.0 00000100:00100000:3.0:1788987108.357970:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993702272:0@lo:400:kworker.0 00000100:00080000:0.0:1788987108.358488:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788987108.358496:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987108.358521:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993702016:0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.358536:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993702528:0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.358548:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993702144:0@lo:400:kworker.0 00000100:00100000:0.0:1788987108.358559:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993702656:0@lo:400:kworker.0 00010000:00010000:2.0:1788987108.424426:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987108.865638:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993702784:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788987108.865711:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987108.865825:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993702784 00000100:00100000:1.0:1788987108.865833:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993702784 00000100:00100000:1.0:1788987108.865888:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:1.0:1788987108.865899:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993702784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788987108.865932:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987108.865978:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993702784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987108.865985:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:3.0:1788987108.866354:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993702784:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788987109.452354:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788987109.722549:0:107578:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from lsi ino=51239, dev=0 00010000:00010000:2.0:1788987110.467591:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987111.496283:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987112.448366:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993702912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788987112.448450:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987112.458943:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993702912 00000100:00100000:3.0:1788987112.458962:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993702912 00000100:00100000:3.0:1788987112.459038:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1788987112.459048:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993702912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987112.459086:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987112.459178:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993702912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (10729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987112.459199:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1788987112.459275:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993702912:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788987112.459332:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788987112.512342:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987113.472325:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987113.474199:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993703168:0@lo:400:kworker.0 00000100:00100000:1.0:1788987113.474270:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987113.474443:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993703168 00000100:00100000:3.0:1788987113.474454:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993703168 00000100:00100000:3.0:1788987113.474541:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2068 00000100:00100000:3.0:1788987113.474554:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993703168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987113.474634:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993703168:12345-0@lo:400:kworker.0 Request processed in 84us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987113.474642:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2068 00000100:00100000:1.0:1788987113.475223:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993703040:0@lo:400:kworker.0 00000100:00100000:1.0:1788987113.475260:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987113.475318:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993703168:0@lo:400:kworker.0 00000100:00100000:1.0:1788987113.475406:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993703040 00000100:00100000:1.0:1788987113.475410:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993703040 00000100:00100000:1.0:1788987113.475439:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1572 00000100:00100000:1.0:1788987113.475446:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993703040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987113.475664:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993703040:12345-0@lo:400:kworker.0 Request processed in 217us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987113.475671:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1572 00000100:00100000:1.0:1788987113.475709:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c19180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993703040:0@lo:400:kworker.0 00000100:00100000:0.0:1788987113.477819:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788987113.477840:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993703296:0@lo:400:kworker.0 00000100:00100000:0.0:1788987113.477912:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987113.477964:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993703296 00000100:00100000:0.0:1788987113.477973:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993703296 00000100:00100000:0.0:1788987113.478027:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2069 00000100:00100000:0.0:1788987113.478039:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993703296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987113.478137:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c19180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993703296:12345-0@lo:400:kworker.0 Request processed in 100us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987113.478145:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2069 00000100:00080000:0.0:1788987113.478172:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987113.478203:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993703296:0@lo:400:kworker.0 00000100:00100000:0.0:1788987113.478255:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993703424:0@lo:400:kworker.0 00000100:00100000:0.0:1788987113.478287:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987113.478872:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993703424 00000100:00100000:0.0:1788987113.478880:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993703424 00000100:00100000:0.0:1788987113.481469:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573 00000100:00100000:0.0:1788987113.481487:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993703424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987113.484732:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993703424:12345-0@lo:400:kworker.0 Request processed in 3245us (6437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987113.484746:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573 00000100:00100000:0.0:1788987113.484839:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993703552:0@lo:400:kworker.0 00000100:00100000:0.0:1788987113.484872:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987113.484911:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993703552 00000100:00100000:0.0:1788987113.484918:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993703552 00000100:00100000:0.0:1788987113.484977:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2070 00000100:00100000:0.0:1788987113.484987:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993703552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987113.485029:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993703552:12345-0@lo:400:kworker.0 Request processed in 43us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987113.485038:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2070 00000100:00080000:0.0:1788987113.485062:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987113.485133:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993703552:0@lo:400:kworker.0 00000100:00100000:0.0:1788987113.485185:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788987113.485196:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993703680:0@lo:400:kworker.0 00000100:00100000:0.0:1788987113.485232:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987113.485270:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993703680 00000100:00100000:0.0:1788987113.485275:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993703680 00000100:00100000:0.0:1788987113.485331:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1574 00000100:00100000:0.0:1788987113.485341:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993703680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987113.485393:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993703680:12345-0@lo:400:kworker.0 Request processed in 53us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987113.485400:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1574 00000100:00080000:0.0:1788987113.485423:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788987113.485451:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993703680:0@lo:400:kworker.0 00000100:00100000:1.0:1788987113.486760:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993703424:0@lo:400:kworker.0 00010000:00010000:2.0:1788987113.536456:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987113.986318:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788987113.986348:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993703808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788987113.986437:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987113.986725:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993703808 00000100:00100000:0.0:1788987113.986745:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993703808 00000100:00100000:0.0:1788987113.986829:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1788987113.986841:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993703808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987113.986886:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987113.986951:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993703808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987113.986959:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:2.0:1788987113.987031:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993703808:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788987114.565019:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788987114.713618:0:107774:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from lsi ino=51239, dev=0 00000020:00000004:3.0:1788987114.719901:0:107775:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from lsi ino=51239, dev=0 00000020:00000004:3.0:1788987114.740974:0:107776:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from lsi ino=51239, dev=0 00010000:00010000:2.0:1788987115.586602:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987116.608723:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987117.518493:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987117.520175:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971477632 00000100:00100000:3.0:1788987117.520196:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971477632 00000100:00100000:3.0:1788987117.520280:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1573 00000100:00100000:3.0:1788987117.520300:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2345:x1875885971477632:12345-192.168.206.21@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788987117.520336:0:5849:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6035c4df-8d96-4dc5-b6ad-0c187c6bd172@192.168.206.21@tcp t0 exp 0000000000000000 cur 2901 last 0 00000020:00000080:3.0:1788987117.520380:0:5849:0:(genops.c:1384:class_connect()) connect: client 6035c4df-8d96-4dc5-b6ad-0c187c6bd172, cookie 0xc20d828fcf54a9f7 00000100:00080000:3.0:1788987117.520445:0:5849:0:(import.c:65:import_set_state_nolock()) ffff9b0a4321d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788987117.520558:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+5:2345:x1875885971477632:12345-192.168.206.21@tcp:250:mount.lustre.0 Request processed in 248us (2065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987117.520568:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1573 00000100:00100000:1.0:1788987117.548216:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987117.548371:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971477760 00000100:00100000:3.0:1788987117.548380:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971477760 00000100:00100000:3.0:1788987117.548434:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1574 00000100:00100000:3.0:1788987117.548444:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+5:64440:x1875885971477760:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788987117.548460:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788987117.548477:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54a9fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d17b3 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987117.548504:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54a9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17b3 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987117.548514:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54a9fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17b3 expref: 6 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987117.548523:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3200, rc 0) 00000100:00100000:3.0:1788987117.548580:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+6:64440:x1875885971477760:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 137us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987117.548587:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1574 00000100:00100000:0.0:1788987117.558220:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987117.559960:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971477888 00000100:00100000:1.0:1788987117.559972:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971477888 00000100:00100000:1.0:1788987117.560036:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1575 00000100:00100000:1.0:1788987117.560046:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+6:64440:x1875885971477888:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788987117.560362:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+6:64440:x1875885971477888:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 317us (2150us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788987117.560370:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1575 00000100:00100000:0.0:1788987117.566961:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987117.567056:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971478016 00000100:00100000:2.0:1788987117.567066:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971478016 00000100:00100000:2.0:1788987117.567153:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1576 00000100:00100000:2.0:1788987117.567163:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+6:64440:x1875885971478016:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788987117.567180:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788987117.567197:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aa05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d17ba expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987117.567224:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aa05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17ba expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987117.567538:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aa05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17ba expref: 7 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987117.567548:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1400, rc 0) 00000100:00100000:2.0:1788987117.567606:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+7:64440:x1875885971478016:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 445us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987117.567613:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1576 00000100:00100000:3.0:1788987117.572781:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993703936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987117.572844:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987117.572958:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993703936 00000100:00100000:2.0:1788987117.572966:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993703936 00000100:00100000:2.0:1788987117.573020:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1788987117.573029:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993703936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788987117.573060:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987117.573131:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993703936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987117.573138:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00080000:3.0:1788987117.573196:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788987117.573243:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993703936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987117.573677:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987117.573760:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971478144 00000100:00100000:2.0:1788987117.573765:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971478144 00000100:00100000:2.0:1788987117.573803:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1577 00000100:00100000:2.0:1788987117.573811:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+7:64440:x1875885971478144:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788987117.574110:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+8:64440:x1875885971478144:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 275us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987117.574119:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1577 00000100:00100000:0.0:1788987117.578630:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987117.578753:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971478272 00000100:00100000:2.0:1788987117.578762:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971478272 00000100:00100000:2.0:1788987117.578852:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1578 00000100:00100000:2.0:1788987117.578864:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+8:64440:x1875885971478272:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788987117.579304:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+8:64440:x1875885971478272:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 441us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987117.579312:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1578 00000100:00100000:0.0:1788987117.581480:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987117.581637:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971478400 00000100:00100000:3.0:1788987117.581645:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971478400 00000100:00100000:3.0:1788987117.581699:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1579 00000100:00100000:3.0:1788987117.581709:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+8:64458:x1875885971478400:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788987117.582239:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+8:64458:x1875885971478400:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 519us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987117.582248:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1579 00000100:00100000:1.0:1788987117.619739:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987117.619839:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971478528 00000100:00100000:2.0:1788987117.619849:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971478528 00000100:00100000:2.0:1788987117.619904:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1580 00000100:00100000:2.0:1788987117.619913:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+8:64458:x1875885971478528:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788987117.620241:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+8:64458:x1875885971478528:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 328us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987117.620249:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1580 00000100:00100000:0.0:1788987117.627014:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987117.632326:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971478656 00000100:00100000:3.0:1788987117.632339:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971478656 00010000:00010000:2.0:1788987117.632455:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987117.633912:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1581 00000100:00100000:3.0:1788987117.633931:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+8:64440:x1875885971478656:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788987117.633949:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788987117.633967:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf54aa0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d17e4 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987117.633995:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf54aa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17e4 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987117.634005:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf54aa0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17e4 expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987117.634013:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2000, rc 0) 00000100:00100000:3.0:1788987117.634070:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+9:64440:x1875885971478656:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 146us (7064us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987117.634076:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1581 00000100:00100000:0.0:1788987117.640039:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987117.640229:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971478784 00000100:00100000:2.0:1788987117.640239:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971478784 00000100:00100000:2.0:1788987117.640301:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1582 00000100:00100000:2.0:1788987117.640311:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+9:64440:x1875885971478784:12345-192.168.206.21@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788987117.640337:0:5849:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788987117.640366:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788987117.640371:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788987117.640374:0:5849:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788987117.640376:0:5849:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788987117.646046:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+9:64440:x1875885971478784:12345-192.168.206.21@tcp:256:mount.lustre.0 Request processed in 5727us (6008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987117.646060:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1582 00000100:00100000:0.0:1788987117.650151:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987117.650314:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971478912 00000100:00100000:3.0:1788987117.650324:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971478912 00000100:00100000:3.0:1788987117.650376:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1583 00000100:00100000:3.0:1788987117.650386:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+9:64440:x1875885971478912:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788987117.650401:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788987117.650418:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54aa13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d17eb expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987117.650445:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54aa13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17eb expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987117.650455:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54aa13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17eb expref: 10 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987117.650463:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a3000, rc 0) 00000100:00100000:3.0:1788987117.650632:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64440:x1875885971478912:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 246us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987117.650640:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1583 00000100:00100000:0.0:1788987117.654685:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987117.654776:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971479040 00000100:00100000:3.0:1788987117.654785:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971479040 00000100:00100000:3.0:1788987117.654842:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1584 00000100:00100000:3.0:1788987117.654852:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64440:x1875885971479040:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788987117.655156:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64440:x1875885971479040:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 304us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987117.655165:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1584 00000100:00100000:1.0:1788987117.659650:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987117.659749:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971479168 00000100:00100000:3.0:1788987117.659917:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971479168 00000100:00100000:3.0:1788987117.659978:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1585 00000100:00100000:3.0:1788987117.659988:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64440:x1875885971479168:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788987117.660332:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64440:x1875885971479168:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 344us (688us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987117.660340:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1585 00000100:00100000:0.0:1788987117.676000:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987117.680327:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971479296 00000100:00100000:1.0:1788987117.680343:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971479296 00000100:00100000:1.0:1788987117.680407:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1586 00000100:00100000:1.0:1788987117.680416:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64462:x1875885971479296:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788987117.681214:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64462:x1875885971479296:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 797us (5220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987117.681224:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1586 00000100:00100000:0.0:1788987117.708577:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987117.710277:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971479424 00000100:00100000:3.0:1788987117.710300:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971479424 00000100:00100000:3.0:1788987117.710364:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1587 00000100:00100000:3.0:1788987117.710374:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64462:x1875885971479424:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788987117.710655:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64462:x1875885971479424:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 281us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987117.710664:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1587 00000100:00100000:2.0:1788987117.717926:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987117.719415:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971479552 00000100:00100000:1.0:1788987117.719428:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971479552 00000100:00100000:1.0:1788987117.719494:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1251 00000100:00100000:1.0:1788987117.719501:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2345:x1875885971479552:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788987117.719532:0:7899:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e1c892ff-5835-4823-91fb-89889326365b@192.168.206.21@tcp t0 exp 0000000000000000 cur 2901 last 0 00000020:00000080:1.0:1788987117.719582:0:7899:0:(genops.c:1384:class_connect()) connect: client e1c892ff-5835-4823-91fb-89889326365b, cookie 0xc20d828fcf54aa1a 00000004:00100000:1.0:1788987117.719639:0:7899:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788987117.719922:0:7899:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f9ed000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788987117.720000:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1c892ff-5835-4823-91fb-89889326365b+6:2345:x1875885971479552:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 497us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987117.720007:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1251 00000100:00100000:0.0:1788987117.727230:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987117.727336:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987117.727421:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971479680 00000100:00100000:1.0:1788987117.727430:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971479680 00000100:00100000:1.0:1788987117.727511:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971479808 00000100:00100000:1.0:1788987117.727515:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971479808 00000100:00100000:1.0:1788987117.727540:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1252 00000100:00100000:1.0:1788987117.727550:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1c892ff-5835-4823-91fb-89889326365b+7:0:x1875885971479680:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788987117.727591:0:15241:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1788987117.727675:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1c892ff-5835-4823-91fb-89889326365b+7:0:x1875885971479680:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 126us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987117.727686:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1252 00000100:00100000:1.0:1788987117.727704:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1253 00000100:00100000:1.0:1788987117.727711:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1c892ff-5835-4823-91fb-89889326365b+6:64440:x1875885971479808:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788987117.727722:0:15241:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1788987117.727743:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1c892ff-5835-4823-91fb-89889326365b+6:64440:x1875885971479808:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 32us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987117.727749:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1253 00000100:00080000:0.0:1788987117.728348:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987117.730510:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987117.732033:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971479936 00000100:00100000:0.0:1788987117.732047:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971479936 00000100:00100000:0.0:1788987117.732155:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1254 00000100:00100000:0.0:1788987117.732167:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1c892ff-5835-4823-91fb-89889326365b+6:64440:x1875885971479936:12345-192.168.206.21@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788987117.732271:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1c892ff-5835-4823-91fb-89889326365b+6:64440:x1875885971479936:12345-192.168.206.21@tcp:40:mount.lustre.0 Request processed in 106us (1769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987117.732279:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1254 00000100:00100000:2.0:1788987117.742232:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987117.742272:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987117.742703:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971480064 00000100:00100000:1.0:1788987117.742713:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971480064 00000100:00100000:1.0:1788987117.742766:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971480192 00000100:00100000:1.0:1788987117.742770:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971480192 00000100:00100000:1.0:1788987117.742792:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 690 00000100:00100000:1.0:1788987117.742800:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875885971480064:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788987117.742839:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e1c892ff-5835-4823-91fb-89889326365b@192.168.206.21@tcp t0 exp 0000000000000000 cur 2901 last 0 00000020:00000080:1.0:1788987117.742870:0:6697:0:(genops.c:1384:class_connect()) connect: client e1c892ff-5835-4823-91fb-89889326365b, cookie 0xc20d828fcf54aa21 00002000:00100000:1.0:1788987117.742907:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e1c892ff-5835-4823-91fb-89889326365b/ffff9b0a7f9ec800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788987117.742918:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788987117.743189:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788987117.743222:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f9e9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788987117.743294:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1c892ff-5835-4823-91fb-89889326365b+6:2345:x1875885971480064:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 482us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987117.743302:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 690 00000100:00100000:1.0:1788987117.743323:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 691 00000100:00100000:1.0:1788987117.743327:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2345:x1875885971480192:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788987117.743344:0:6697:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e1c892ff-5835-4823-91fb-89889326365b@192.168.206.21@tcp t0 exp 0000000000000000 cur 2901 last 0 00000020:00000080:1.0:1788987117.743363:0:6697:0:(genops.c:1384:class_connect()) connect: client e1c892ff-5835-4823-91fb-89889326365b, cookie 0xc20d828fcf54aa28 00002000:00100000:1.0:1788987117.743368:0:6697:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e1c892ff-5835-4823-91fb-89889326365b/ffff9b0a7f9ef800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788987117.743382:0:6697:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788987117.743511:0:6697:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788987117.743528:0:6697:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f9eb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788987117.743552:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e1c892ff-5835-4823-91fb-89889326365b+6:2345:x1875885971480192:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 223us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987117.743559:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 691 00000100:00100000:3.0:1788987117.748078:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987117.748221:0:5858:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971480320 00000100:00100000:3.0:1788987117.748230:0:5858:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971480320 00000100:00100000:3.0:1788987117.748278:0:5858:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 124 00000100:00100000:3.0:1788987117.748298:0:5858:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1c892ff-5835-4823-91fb-89889326365b+6:64440:x1875885971480320:12345-192.168.206.21@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788987117.748362:0:5858:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788987117.749393:0:5858:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e1c892ff-5835-4823-91fb-89889326365b+6:64440:x1875885971480320:12345-192.168.206.21@tcp:33:mount.lustre.0 Request processed in 1101us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987117.749403:0:5858:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 124 00000100:00100000:3.0:1788987117.962156:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987117.962395:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971480448 00000100:00100000:1.0:1788987117.962410:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971480448 00000100:00100000:1.0:1788987117.962482:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1255 00000100:00100000:1.0:1788987117.962502:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1c892ff-5835-4823-91fb-89889326365b+6:64482:x1875885971480448:12345-192.168.206.21@tcp:101:mkdir.0 00010000:00010000:1.0:1788987117.962521:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987117.962596:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54aa2f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1815 expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987117.962658:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54aa36 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987117.962671:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54aa36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987117.962685:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54aa36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788987117.962719:0:7899:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788987117.962723:0:7899:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788987117.962746:0:7899:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54aa36 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987117.962769:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030200/0xc20d828fcf54aa2f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1815 expref: 8 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987117.962792:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54aa36 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1815 expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987117.962800:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:1.0:1788987117.962803:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788987117.962806:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030c00, rc 0) 00000100:00100000:1.0:1788987117.962886:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1c892ff-5835-4823-91fb-89889326365b+7:64482:x1875885971480448:12345-192.168.206.21@tcp:101:mkdir.0 Request processed in 395us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987117.962892:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1255 00000100:00100000:1.0:1788987118.593143:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993704192:0@lo:400:kworker.0 00000100:00100000:1.0:1788987118.593212:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987118.593216:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993704064:0@lo:400:kworker.0 00000100:00100000:0.0:1788987118.593262:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987118.593303:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993704704:0@lo:400:kworker.0 00000100:00100000:0.0:1788987118.593309:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993704576:0@lo:400:kworker.0 00000100:00100000:1.0:1788987118.593337:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987118.593351:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987118.593381:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993704704 00000100:00100000:1.0:1788987118.593388:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993704704 00000100:00100000:0.0:1788987118.593400:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993704192 00000100:00100000:0.0:1788987118.593406:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993704192 00000100:00100000:1.0:1788987118.593444:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:1.0:1788987118.593455:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993704704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987118.593504:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993704704:12345-0@lo:400:kworker.0 Request processed in 51us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987118.593511:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00080000:1.0:1788987118.593531:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788987118.593557:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993704704:0@lo:400:kworker.0 00000100:00100000:1.0:1788987118.593577:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993704576 00000100:00100000:1.0:1788987118.593581:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993704576 00000100:00100000:1.0:1788987118.593607:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2071 00000100:00100000:1.0:1788987118.593613:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993704192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987118.593648:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3319:x1875885993704192:12345-0@lo:400:kworker.0 Request processed in 36us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987118.593655:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2071 00000100:00100000:0.0:1788987118.593662:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2072 00000100:00100000:0.0:1788987118.593673:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993704576:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788987118.593674:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987118.593694:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3319:1875885993704192:0@lo:400:kworker.0 00000100:00100000:0.0:1788987118.593722:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993704576:12345-0@lo:400:kworker.0 Request processed in 50us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987118.593726:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993704064 00000100:00100000:1.0:1788987118.593730:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993704064 00000100:00100000:1.0:1788987118.593821:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:1.0:1788987118.593829:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993704064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987118.593863:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993704064:12345-0@lo:400:kworker.0 Request processed in 35us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987118.593870:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00100000:1.0:1788987118.593913:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993704064:0@lo:400:kworker.0 00000100:00100000:1.0:1788987118.593924:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993704576:0@lo:400:kworker.0 00000100:00100000:0.0:1788987118.594048:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2072 00000100:00100000:3.0:1788987118.594161:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993704320:0@lo:400:kworker.0 00000100:00100000:3.0:1788987118.594194:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987118.594224:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788987118.594231:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993704448:0@lo:400:kworker.0 00000100:00100000:3.0:1788987118.594254:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987118.594367:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993704320 00000100:00100000:2.0:1788987118.594372:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993704320 00000100:00100000:2.0:1788987118.594424:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2073 00000100:00100000:2.0:1788987118.594432:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993704320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987118.594479:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993704320:12345-0@lo:400:kworker.0 Request processed in 48us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987118.594485:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2073 00000100:00100000:0.0:1788987118.594547:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993704448 00000100:00100000:0.0:1788987118.594551:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993704448 00000100:00100000:0.0:1788987118.594583:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1576 00000100:00100000:0.0:1788987118.594590:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993704448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987118.594621:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993704448:12345-0@lo:400:kworker.0 Request processed in 32us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987118.594627:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1576 00000100:00080000:1.0:1788987118.594719:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987118.595606:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993704448:0@lo:400:kworker.0 00000100:00100000:3.0:1788987118.595618:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993704320:0@lo:400:kworker.0 00010000:00010000:0.0:1788987118.656611:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987119.104951:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993704832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788987119.105025:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987119.105217:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993704832 00000100:00100000:2.0:1788987119.105227:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993704832 00000100:00100000:2.0:1788987119.105290:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:2.0:1788987119.105299:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993704832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788987119.105335:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987119.105401:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993704832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987119.105409:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:0.0:1788987119.105690:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993704832:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788987119.692428:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788987120.204129:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e1c892ff-5835-4823-91fb-89889326365b 00000100:00100000:2.0:1788987120.354583:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987120.354967:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971480576 00000100:00100000:1.0:1788987120.354977:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971480576 00000100:00100000:1.0:1788987120.355170:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1256 00000100:00100000:1.0:1788987120.355181:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1c892ff-5835-4823-91fb-89889326365b+6:64534:x1875885971480576:12345-192.168.206.21@tcp:41:lfs.0 00000100:00080000:2.0:1788987120.355406:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:1.0:1788987120.355916:0:7899:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:1.0:1788987120.356230:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1c892ff-5835-4823-91fb-89889326365b+6:64534:x1875885971480576:12345-192.168.206.21@tcp:41:lfs.0 Request processed in 1048us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987120.356238:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1256 00000100:00100000:3.0:1788987120.361594:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987120.362061:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971480704 00000100:00100000:2.0:1788987120.362073:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971480704 00000100:00100000:2.0:1788987120.362185:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1062 00000100:00080000:1.0:1788987120.362542:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788987120.362585:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1c892ff-5835-4823-91fb-89889326365b+6:64534:x1875885971480704:12345-192.168.206.21@tcp:13:lfs.0 00002000:00000024:2.0:1788987120.362621:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987120.363022:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1c892ff-5835-4823-91fb-89889326365b+6:64534:x1875885971480704:12345-192.168.206.21@tcp:13:lfs.0 Request processed in 439us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987120.368285:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1062 00000100:00100000:3.0:1788987120.375491:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987120.376282:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971480832 00000100:00100000:0.0:1788987120.376292:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971480832 00000100:00100000:0.0:1788987120.376371:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1063 00000100:00100000:0.0:1788987120.376380:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1c892ff-5835-4823-91fb-89889326365b+6:64534:x1875885971480832:12345-192.168.206.21@tcp:13:lfs.0 00002000:00000024:0.0:1788987120.376406:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987120.376480:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:e1c892ff-5835-4823-91fb-89889326365b+6:64534:x1875885971480832:12345-192.168.206.21@tcp:13:lfs.0 Request processed in 100us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987120.376488:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1063 00000100:00080000:1.0:1788987120.376495:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788987120.708081:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987121.728487:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987122.688674:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993704960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788987122.688766:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987122.689347:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993704960 00000100:00100000:3.0:1788987122.689357:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993704960 00000100:00100000:3.0:1788987122.689415:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:3.0:1788987122.689423:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993704960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987122.689469:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987122.689523:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993704960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987122.689530:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00080000:3.0:1788987122.689551:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788987122.694614:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993704960:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788987122.760306:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788987122.780421:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e1c892ff-5835-4823-91fb-89889326365b 00000001:00100000:2.0:1788987122.809204:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e1c892ff-5835-4823-91fb-89889326365b 00000100:00100000:0.0:1788987122.815969:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987122.816001:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987122.816024:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987122.816050:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987122.816080:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971481088 00000100:00100000:0.0:1788987122.816120:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971481088 00000100:00100000:0.0:1788987122.816184:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2074 00000100:00100000:0.0:1788987122.816194:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1c892ff-5835-4823-91fb-89889326365b+6:2346:x1875885971481088:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987122.816276:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e1c892ff-5835-4823-91fb-89889326365b+6:2346:x1875885971481088:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 83us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987122.816283:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2074 00000100:00080000:0.0:1788987122.816321:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987122.816898:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971480960 00000100:00100000:2.0:1788987122.816905:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971480960 00000100:00100000:2.0:1788987122.816950:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1589 00000100:00100000:2.0:1788987122.816958:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:2347:x1875885971480960:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987122.817003:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:2347:x1875885971480960:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 46us (1043us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987122.817010:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1589 00000100:00100000:2.0:1788987122.817044:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971481216 00000100:00100000:2.0:1788987122.817047:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971481216 00000100:00100000:2.0:1788987122.817081:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971481344 00000100:00100000:2.0:1788987122.817084:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971481344 00000100:00100000:2.0:1788987122.817152:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1577 00000100:00100000:2.0:1788987122.817160:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1c892ff-5835-4823-91fb-89889326365b+5:2347:x1875885971481216:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987122.817187:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1c892ff-5835-4823-91fb-89889326365b+5:2347:x1875885971481216:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 28us (1185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987122.817193:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1577 00000100:00100000:2.0:1788987122.817207:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1578 00000100:00100000:2.0:1788987122.817214:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1c892ff-5835-4823-91fb-89889326365b+5:2346:x1875885971481344:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987122.817239:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1c892ff-5835-4823-91fb-89889326365b+5:2346:x1875885971481344:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987122.817245:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1578 00000100:00080000:2.0:1788987122.817289:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788987122.817293:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788987123.721468:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993705088:0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.721535:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987123.721576:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993705600:0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.721603:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987123.721641:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788987123.721648:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993705216:0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.721672:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987123.721690:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993705728:0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.721714:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987123.722781:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993705344:0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.722824:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987123.722847:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788987123.722853:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993705472:0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.722876:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987123.722907:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993705088 00000100:00100000:3.0:1788987123.722914:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993705088 00000100:00100000:3.0:1788987123.722956:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:3.0:1788987123.722965:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993705088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.723014:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993705088:12345-0@lo:400:kworker.0 Request processed in 50us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987123.723020:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00100000:3.0:1788987123.723050:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993705600 00000100:00100000:3.0:1788987123.723054:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993705600 00000100:00100000:3.0:1788987123.723104:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993705216 00000100:00100000:3.0:1788987123.723108:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993705216 00000100:00100000:3.0:1788987123.723128:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993705344 00000100:00100000:3.0:1788987123.723131:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993705344 00000100:00100000:3.0:1788987123.723383:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2075 00000100:00100000:3.0:1788987123.723390:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993705600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.723437:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993705600:12345-0@lo:400:kworker.0 Request processed in 47us (1833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987123.723443:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2075 00000100:00100000:3.0:1788987123.723456:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2076 00000100:00100000:3.0:1788987123.723461:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993705216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.723485:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993705216:12345-0@lo:400:kworker.0 Request processed in 24us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987123.723491:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2076 00000100:00100000:3.0:1788987123.723502:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2077 00000100:00100000:3.0:1788987123.723508:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993705344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.723540:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993705344:12345-0@lo:400:kworker.0 Request processed in 32us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987123.723545:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2077 00000100:00100000:3.0:1788987123.723567:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993705728 00000100:00100000:3.0:1788987123.723571:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993705728 00000100:00100000:3.0:1788987123.723597:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993705472 00000100:00100000:3.0:1788987123.723600:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993705472 00000100:00100000:3.0:1788987123.723811:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1579 00000100:00100000:3.0:1788987123.723819:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993705728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.723855:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993705728:12345-0@lo:400:kworker.0 Request processed in 38us (2141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987123.723862:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1579 00000100:00100000:3.0:1788987123.723873:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1580 00000100:00100000:3.0:1788987123.723879:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993705472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.723904:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993705472:12345-0@lo:400:kworker.0 Request processed in 26us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987123.723910:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1580 00000100:00080000:3.0:1788987123.723935:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788987123.723940:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987123.723979:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993705472:0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.723989:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993705344:0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.724020:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993705216:0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.724028:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993705728:0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.724037:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993705088:0@lo:400:kworker.0 00000100:00100000:3.0:1788987123.724046:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993705600:0@lo:400:kworker.0 00010000:00010000:0.0:1788987123.777461:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788987124.154031:0:107975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788987124.225804:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993705856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788987124.225874:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987124.226775:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993705856 00000100:00100000:1.0:1788987124.226785:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993705856 00000100:00100000:1.0:1788987124.226846:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1788987124.226857:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993705856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788987124.226890:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987124.226945:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993705856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987124.226952:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1788987124.227049:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993705856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788987124.801815:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987125.824420:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987126.848953:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987127.810165:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993705984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788987127.810257:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987127.812355:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993705984 00000100:00100000:1.0:1788987127.812369:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993705984 00000100:00100000:1.0:1788987127.812443:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1788987127.812455:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993705984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788987127.812487:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987127.812581:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993705984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (2323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987127.812587:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1788987127.812646:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993705984:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788987127.817011:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788987127.873955:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987127.921109:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987127.921153:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971481600 00000100:00100000:1.0:1788987127.921163:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971481600 00000100:00100000:1.0:1788987127.921249:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2078 00000100:00100000:0.0:1788987127.921251:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987127.921259:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1c892ff-5835-4823-91fb-89889326365b+6:2348:x1875885971481600:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987127.921275:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987127.921297:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987127.921321:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971481472 00000100:00100000:1.0:1788987127.921324:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1c892ff-5835-4823-91fb-89889326365b+6:2348:x1875885971481600:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 68us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987127.921325:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971481472 00000100:00100000:1.0:1788987127.921331:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2078 00000100:00100000:0.0:1788987127.921347:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1591 00000100:00100000:0.0:1788987127.921353:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:2349:x1875885971481472:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987127.921376:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:2349:x1875885971481472:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 23us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987127.921383:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1591 00000100:00100000:0.0:1788987127.921407:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971481856 00000100:00100000:0.0:1788987127.921410:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971481856 00000100:00100000:0.0:1788987127.921432:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971481728 00000100:00100000:0.0:1788987127.921434:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971481728 00000100:00100000:0.0:1788987127.921454:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1581 00000100:00100000:0.0:1788987127.921460:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1c892ff-5835-4823-91fb-89889326365b+5:2348:x1875885971481856:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987127.921486:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1c892ff-5835-4823-91fb-89889326365b+5:2348:x1875885971481856:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987127.921492:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1581 00000100:00100000:0.0:1788987127.921504:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1582 00000100:00100000:0.0:1788987127.921511:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1c892ff-5835-4823-91fb-89889326365b+5:2349:x1875885971481728:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:2.0:1788987127.921609:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788987127.921612:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788987127.921615:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987127.922657:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1c892ff-5835-4823-91fb-89889326365b+5:2349:x1875885971481728:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 1141us (1353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987127.922668:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1582 00000020:00000080:0.0:1788987128.580414:0:108124:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc59866360 20000000:00000080:0.0:1788987128.580428:0:108124:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9b0a49822000 uarg=0000000000000000 20000000:01000000:0.0:1788987128.580462:0:108124:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788987128.580468:0:108124:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788987128.580472:0:108124:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788987128.581564:0:108125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788987128.581708:0:108124:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788987128.587635:0:108124:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788987128.588574:0:108124:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987128.588593:0:108124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54a9d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a9cd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987128.588601:0:108124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a9e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a9db expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987128.588608:0:108124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a9f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a9e9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987128.588617:0:108124:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54aa13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17eb expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987128.588624:0:108124:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987128.588665:0:108124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54aa13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17eb expref: 9 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987128.588679:0:108124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54aa13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17eb expref: 9 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987128.589412:0:108124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f350700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108124:1875885993706112:192.168.206.21@tcp:104: 00010000:00010000:0.0:1788987128.589577:0:108124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a9f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a9e9 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987128.589587:0:108124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a9f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a9e9 expref: 18 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987128.589598:0:108124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108124:1875885993706240:0@lo:104: 00000100:00100000:0.0:1788987128.589636:0:108124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788987128.589672:0:108124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a9e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a9db expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987128.589681:0:108124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a9e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a9db expref: 18 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987128.589690:0:108124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108124:1875885993706368:0@lo:104: 00000100:00100000:0.0:1788987128.589722:0:108124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788987128.589797:0:108124:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54a9d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a9cd expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987128.589805:0:108124:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54a9d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a9cd expref: 18 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987128.589814:0:108124:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108124:1875885993706496:0@lo:104: 00000100:00100000:0.0:1788987128.590004:0:108124:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987128.593413:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993706240 00000100:00100000:2.0:1788987128.593427:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993706240 00000100:00100000:2.0:1788987128.593470:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993706368 00000100:00100000:2.0:1788987128.593473:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993706368 00000100:00100000:2.0:1788987128.593483:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993706496 00000100:00100000:2.0:1788987128.593485:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993706496 00000100:00100000:2.0:1788987128.593499:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1788987128.593507:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+5:108124:x1875885993706240:12345-0@lo:104: 00010000:00010000:2.0:1788987128.593524:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a9f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.593584:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788987128.593589:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+5:108124:x1875885993706240:12345-0@lo:104: Request processed in 83us (3953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987128.593595:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 420 00000100:00100000:2.0:1788987128.593612:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1788987128.593618:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+4:108124:x1875885993706368:12345-0@lo:104: 00010000:00010000:2.0:1788987128.593625:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a9e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987128.593635:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00010000:00010000:2.0:1788987128.593653:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788987128.593657:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971481984 00000100:00100000:2.0:1788987128.593658:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+4:108124:x1875885993706368:12345-0@lo:104: Request processed in 41us (3935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987128.593661:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971481984 00000100:00100000:2.0:1788987128.593663:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 421 00000100:00100000:2.0:1788987128.593674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 422 00000100:00100000:2.0:1788987128.593678:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:108124:x1875885993706496:12345-0@lo:104: 00010000:00010000:2.0:1788987128.593685:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a9d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.593689:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54aa13 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17eb expref: 10 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987128.593709:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 496 00000100:00100000:3.0:1788987128.593718:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:2347:x1875885971481984:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788987128.593728:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788987128.593733:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54aa13 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17eb expref: 10 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.593743:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54aa13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17eb expref: 10 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.593761:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788987128.593797:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:2347:x1875885971481984:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 81us (164us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987128.593846:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 496 00010000:00010000:3.0:1788987128.593940:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788987128.593946:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a9f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.593953:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987128.593957:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a9f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.593965:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a9f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987128.593972:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a9f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987128.593978:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788987128.594013:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.594020:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987128.594040:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.594046:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1c00/0xc20d828fcf54a9e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9f0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.594058:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987128.594061:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a9e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.594066:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987128.594069:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a9e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.594075:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a9e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987128.594081:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a9e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987128.594105:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788987128.594119:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.594124:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987128.594131:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.594137:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54a9db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9e2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.594146:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987128.594148:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987128.594149:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987128.594156:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987128.594175:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993706624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788987128.594207:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987128.594251:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788987128.594256:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993706752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788987128.594275:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987128.594301:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993706624 00000100:00100000:3.0:1788987128.594304:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993706624 00010000:00010000:3.0:1788987128.594323:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a9f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a9e9 expref: 19 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987128.594340:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993706752 00000100:00100000:3.0:1788987128.594343:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993706752 00010000:00010000:2.0:1788987128.594343:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788987128.594348:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:108124:x1875885993706496:12345-0@lo:104: Request processed in 670us (4345us total) trans 0 rc 0/0 00010000:00010000:3.0:1788987128.594353:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a9e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a9db expref: 20 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987128.594355:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 422 00000100:00100000:3.0:1788987128.594365:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1788987128.594371:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+20:3318:x1875885993706624:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788987128.594372:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1788987128.594378:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+20:3318:x1875885993706752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987128.594379:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788987128.594383:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a9f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a9e9 expref: 20 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.594384:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987128.594388:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a9e2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a9db expref: 20 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.594396:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a9f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a9e9 expref: 20 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.594404:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a9e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a9db expref: 20 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987128.594468:0:108124:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0943ab79c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788987128.594489:0:108124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3000/0xc20d828fcf54aa13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17eb expref: 9 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987128.594505:0:108124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f350700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108124:1875885993706112:192.168.206.21@tcp:104: 00000100:00100000:0.0:1788987128.594515:0:108124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108124:1875885993706240:0@lo:104: 00000100:00100000:0.0:1788987128.594523:0:108124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108124:1875885993706368:0@lo:104: 00000100:00100000:0.0:1788987128.594530:0:108124:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108124:1875885993706496:0@lo:104: 00010000:00010000:3.0:1788987128.594864:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54a9f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a9e9 expref: 20 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.594876:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788987128.594919:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993706624:12345-0@lo:103:ldlm_bl.0 Request processed in 548us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987128.594925:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00010000:00010000:3.0:1788987128.594970:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987128.594975:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a9d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.594981:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efe00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987128.594985:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a9d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.594992:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a9d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987128.594999:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a9d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987128.595004:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788987128.595025:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.595031:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788987128.595044:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993706624:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987128.595047:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.595053:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508efe00/0xc20d828fcf54a9cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9d4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987128.595064:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987128.595066:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987128.595068:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987128.595073:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788987128.595082:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993706880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788987128.595136:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987128.595158:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993706880 00000100:00100000:1.0:1788987128.595162:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993706880 00010000:00010000:1.0:1788987128.595178:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54a9d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a9cd expref: 19 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987128.595202:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1788987128.595209:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993706880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788987128.595218:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788987128.595222:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54a9d4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a9cd expref: 19 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987128.595242:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54a9d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a9cd expref: 19 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987128.595253:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54a9d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a9cd expref: 19 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987128.595262:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788987128.595288:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993706880:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987128.595295:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:3.0:1788987128.596473:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993706880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987128.596481:0:108124:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.596599:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efa00/0xc20d828fcf54a9e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a9db expref: 17 pid: 5846 timeout: 3012 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.596613:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.596622:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.596638:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.596646:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.596653:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.596661:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.596667:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987128.596671:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.596678:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.596686:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.596700:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987128.596978:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+16:3318:x1875885993706752:12345-0@lo:103:ldlm_bl.0 Request processed in 2597us (2699us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987128.596988:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:1.0:1788987128.597215:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993706752:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987128.597307:0:108124:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.597316:0:108124:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987128.597323:0:108124:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54aa3d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108124 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987128.841957:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993707008:0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.842016:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987128.842063:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993707520:0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.842082:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987128.842235:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788987128.842241:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993707392:0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.842262:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987128.842288:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993707136:0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.842306:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987128.842320:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987128.842324:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993707264:0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.842340:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987128.842365:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993707008 00000100:00100000:2.0:1788987128.842371:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993707008 00000100:00100000:2.0:1788987128.842406:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993707392 00000100:00100000:2.0:1788987128.842408:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993707392 00000100:00100000:2.0:1788987128.842428:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993707136 00000100:00100000:2.0:1788987128.842430:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993707136 00000100:00100000:2.0:1788987128.842443:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2079 00000100:00100000:2.0:1788987128.842449:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993707008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.842493:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993707008:12345-0@lo:400:kworker.0 Request processed in 44us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987128.842499:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2079 00000100:00100000:2.0:1788987128.842513:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2080 00000100:00100000:2.0:1788987128.842518:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993707392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.842537:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993707392:12345-0@lo:400:kworker.0 Request processed in 20us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987128.842542:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2080 00000100:00100000:2.0:1788987128.842551:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2081 00000100:00100000:2.0:1788987128.842556:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993707136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.842577:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993707136:12345-0@lo:400:kworker.0 Request processed in 22us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987128.842583:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2081 00000100:00100000:2.0:1788987128.842598:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993707520 00000100:00100000:2.0:1788987128.842600:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993707520 00000100:00100000:2.0:1788987128.842620:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993707264 00000100:00100000:2.0:1788987128.842623:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993707264 00000100:00100000:2.0:1788987128.842635:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1583 00000100:00100000:2.0:1788987128.842640:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993707520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.842663:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993707520:12345-0@lo:400:kworker.0 Request processed in 23us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987128.842669:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1583 00000100:00100000:2.0:1788987128.842678:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1584 00000100:00100000:2.0:1788987128.842682:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993707264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.842701:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993707264:12345-0@lo:400:kworker.0 Request processed in 19us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987128.842706:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1584 00000100:00080000:2.0:1788987128.842728:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788987128.842732:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987128.843667:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993707264:0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.843695:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993707136:0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.843734:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993707392:0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.843745:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993707008:0@lo:400:kworker.0 00000100:00100000:2.0:1788987128.844910:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993707520:0@lo:400:kworker.0 00010000:00010000:3.0:1788987128.897713:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987129.354704:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987129.354727:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993707648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788987129.354793:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987129.355805:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993707648 00000100:00100000:1.0:1788987129.355814:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993707648 00000100:00100000:1.0:1788987129.355979:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1788987129.355989:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993707648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788987129.356026:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987129.356103:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993707648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987129.356110:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1788987129.356154:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993707648:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1788987129.728473:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788987129.728480:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b0a7630e000 from 10 10000000:01000000:3.0:1788987129.728486:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788987129.728527:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf54aa44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987129.728650:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf54aa44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987129.728662:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf54aa44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987129.728687:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993707776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788987129.728749:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987129.728802:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f5500c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788987129.728844:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993707776 00000100:00100000:2.0:1788987129.728852:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993707776 00000100:00100000:1.0:1788987129.728977:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:1.0:1788987129.728988:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+16:5851:x1875885993707776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987129.729001:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987129.729017:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54aa4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54aa44 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.729038:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54aa4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54aa44 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.729049:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031c00/0xc20d828fcf54aa4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54aa44 expref: 17 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.729061:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031c00, rc 0) 00000100:00100000:1.0:1788987129.729145:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993707776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987129.729149:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993707776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788987129.729155:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00010000:00010000:3.0:1788987129.729168:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf54aa44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987129.729179:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf54aa44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54aa4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987129.729242:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993707904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788987129.729269:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987129.729312:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993707904 00000100:00100000:3.0:1788987129.729315:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f5500c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788987129.729317:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993707904 00000100:00100000:1.0:1788987129.729345:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00100000:1.0:1788987129.729352:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993707904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788987129.729584:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993707904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987129.729590:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00100000:3.0:1788987129.729715:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993707904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788987129.729745:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788987129.729786:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987129.729811:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f5500c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788987129.729825:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993708032 00000100:00100000:3.0:1788987129.729828:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993708032 00000100:00100000:3.0:1788987129.729852:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:3.0:1788987129.729859:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993708032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788987129.730007:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993708032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987129.730014:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00100000:2.0:1788987129.730043:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788987129.733577:0:108161:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788987129.734547:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788987129.734575:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788987129.734586:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf54aa44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.734609:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2a00/0xc20d828fcf54aa44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa4b expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987129.734619:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788987129.734623:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b0a457e9000 from 10 10000000:01000000:1.0:1788987129.734626:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788987129.734658:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54aa52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.734667:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54aa52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.734682:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54aa52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987129.734718:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788987129.734796:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987129.734839:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a432fc780 going to sleep for 11 seconds 00000100:00100000:2.0:1788987129.735410:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993708160 00000100:00100000:2.0:1788987129.735418:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993708160 00000100:00100000:2.0:1788987129.735467:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00100000:2.0:1788987129.735477:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+17:5851:x1875885993708160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987129.735489:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788987129.735502:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54aa59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54aa52 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987129.735529:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54aa59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54aa52 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987129.735540:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f1200/0xc20d828fcf54aa59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54aa52 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987129.735548:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1200, rc 0) 00000100:00100000:2.0:1788987129.735607:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993708160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (802us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987129.735615:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595 00000100:00100000:1.0:1788987129.736853:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987129.736874:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54aa52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.736886:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54aa52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54aa59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987129.736948:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788987129.736988:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987129.737026:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a432fc780 going to sleep for 11 seconds 00000100:00100000:3.0:1788987129.737182:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993708288 00000100:00100000:3.0:1788987129.737188:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993708288 00000100:00100000:3.0:1788987129.737271:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596 00000100:00100000:3.0:1788987129.737281:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993708288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788987129.737523:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993708288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 243us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987129.737531:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1596 00000100:00100000:1.0:1788987129.737599:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788987129.737628:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788987129.737670:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987129.737741:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a432fc780 going to sleep for 11 seconds 00000100:00100000:2.0:1788987129.737777:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993708416 00000100:00100000:2.0:1788987129.737781:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993708416 00000100:00100000:2.0:1788987129.737801:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1597 00000100:00100000:2.0:1788987129.737807:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993708416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788987129.737939:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993708416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987129.737946:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1597 00000100:00100000:0.0:1788987129.738211:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788987129.745457:0:108164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788987129.746578:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788987129.746606:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788987129.746615:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54aa52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.746634:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40031a00/0xc20d828fcf54aa52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa59 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987129.746644:0:5851:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788987129.746647:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9b0a48710000 from 10 10000000:01000000:1.0:1788987129.746650:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788987129.746681:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54aa60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.746689:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54aa60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.746699:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54aa60 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987129.746722:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788987129.746781:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987129.746818:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7977d000 going to sleep for 11 seconds 00000100:00100000:2.0:1788987129.747042:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993708544 00000100:00100000:2.0:1788987129.747049:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993708544 00000100:00100000:1.0:1788987129.747250:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1598 00000100:00100000:1.0:1788987129.747260:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993708544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987129.747273:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987129.747285:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54aa67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54aa60 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.747307:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54aa67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54aa60 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.747317:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40031600/0xc20d828fcf54aa67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54aa60 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987129.747326:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40031600, rc 0) 00000100:00100000:1.0:1788987129.747399:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993708544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987129.747406:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1598 00000100:00100000:0.0:1788987129.747632:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987129.747646:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54aa60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987129.747656:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54aa60 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54aa67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987129.747703:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788987129.747733:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987129.747798:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7977d000 going to sleep for 11 seconds 00000100:00100000:1.0:1788987129.747826:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993708672 00000100:00100000:1.0:1788987129.747830:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993708672 00000100:00100000:1.0:1788987129.747970:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:1.0:1788987129.747978:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993708672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788987129.748664:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993708672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 685us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987129.748673:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00100000:3.0:1788987129.748699:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788987129.748737:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788987129.748780:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987129.749622:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094390b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788987129.752816:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993708800 00000100:00100000:0.0:1788987129.752830:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993708800 00000100:00100000:0.0:1788987129.752885:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:0.0:1788987129.753056:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993708800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788987129.754255:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993708800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1200us (5470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987129.754269:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00100000:2.0:1788987129.754513:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993708800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788987129.759124:0:108166:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788987129.759292:0:5851:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788987129.759326:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788987129.759336:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54aa60 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987129.759421:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a40030200/0xc20d828fcf54aa60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa67 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987129.920246:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987130.610386:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987130.610534:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971482112 00000100:00100000:1.0:1788987130.610544:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971482112 00000100:00100000:1.0:1788987130.610602:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1601 00000100:00100000:1.0:1788987130.610612:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+9:64455:x1875885971482112:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987130.610627:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987130.610657:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54aa6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d181c expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987130.610687:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54aa6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d181c expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987130.610698:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54aa6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d181c expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987130.610710:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a40030600, rc 0) 00000100:00100000:1.0:1788987130.610772:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64455:x1875885971482112:12345-192.168.206.21@tcp:101:ll_cfg_requeue.0 Request processed in 161us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987130.610778:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1601 00000100:00100000:3.0:1788987130.627769:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987130.628497:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971482240 00000100:00100000:0.0:1788987130.628509:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971482240 00000100:00100000:0.0:1788987130.628559:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1602 00000100:00100000:0.0:1788987130.628570:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64455:x1875885971482240:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788987130.628881:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64455:x1875885971482240:12345-192.168.206.21@tcp:501:ll_cfg_requeue.0 Request processed in 312us (1121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987130.628889:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1602 00000100:00100000:1.0:1788987130.642021:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987130.644605:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971482368 00000100:00100000:3.0:1788987130.644619:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971482368 00000100:00100000:3.0:1788987130.646652:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1603 00000100:00100000:3.0:1788987130.646680:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64455:x1875885971482368:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788987130.646887:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:64455:x1875885971482368:12345-192.168.206.21@tcp:503:ll_cfg_requeue.0 Request processed in 222us (4877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987130.646896:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1603 00010000:00010000:3.0:1788987130.946012:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987131.968257:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987132.930966:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987132.930989:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993708928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788987132.931051:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987132.931130:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993708928 00000100:00100000:2.0:1788987132.931137:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993708928 00000100:00100000:2.0:1788987132.931183:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1788987132.931192:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993708928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788987132.931232:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788987132.932562:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788987132.933136:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993708928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1942us (2081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987132.933147:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1788987132.933222:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe83b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993708928:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788987132.992289:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987133.041286:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987133.041325:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987133.041351:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987133.041376:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987133.041413:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971482496 00000100:00100000:0.0:1788987133.041421:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971482496 00000100:00100000:0.0:1788987133.041473:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1604 00000100:00100000:0.0:1788987133.041483:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:2347:x1875885971482496:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987133.041542:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:2347:x1875885971482496:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 61us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987133.041549:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1604 00000100:00100000:0.0:1788987133.041578:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971482880 00000100:00100000:0.0:1788987133.041582:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971482880 00000100:00100000:2.0:1788987133.041592:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971482624 00000100:00100000:2.0:1788987133.041596:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971482624 00000100:00100000:0.0:1788987133.041612:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971482752 00000100:00100000:0.0:1788987133.041615:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971482752 00000100:00100000:2.0:1788987133.041625:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2082 00000100:00100000:0.0:1788987133.041631:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1585 00000100:00100000:2.0:1788987133.041632:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1c892ff-5835-4823-91fb-89889326365b+6:2347:x1875885971482624:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987133.041636:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1c892ff-5835-4823-91fb-89889326365b+5:2347:x1875885971482880:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788987133.041752:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1586 00000100:00100000:3.0:1788987133.041771:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1c892ff-5835-4823-91fb-89889326365b+5:2347:x1875885971482752:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987133.041808:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e1c892ff-5835-4823-91fb-89889326365b+5:2347:x1875885971482880:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987133.041816:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1585 00000100:00100000:2.0:1788987133.045143:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e1c892ff-5835-4823-91fb-89889326365b+6:2347:x1875885971482624:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 3501us (3856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987133.045158:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2082 00000100:00100000:3.0:1788987133.047410:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:e1c892ff-5835-4823-91fb-89889326365b+5:2347:x1875885971482752:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 5641us (6022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987133.047423:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1586 00000100:00080000:0.0:1788987133.048653:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788987133.048661:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788987133.048664:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788987133.952596:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993709440:0@lo:400:kworker.0 00000100:00100000:1.0:1788987133.952662:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987133.952722:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987133.952729:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993709312:0@lo:400:kworker.0 00000100:00100000:1.0:1788987133.952754:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987133.952882:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993709184:0@lo:400:kworker.0 00000100:00100000:3.0:1788987133.952911:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987133.952938:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993709696:0@lo:400:kworker.0 00000100:00100000:3.0:1788987133.952958:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987133.952981:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788987133.952987:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993709056:0@lo:400:kworker.0 00000100:00100000:3.0:1788987133.953015:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987133.953038:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993709568:0@lo:400:kworker.0 00000100:00100000:3.0:1788987133.953060:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987133.953119:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993709440 00000100:00100000:3.0:1788987133.953126:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993709440 00000100:00100000:0.0:1788987133.953311:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993709696 00000100:00100000:0.0:1788987133.953316:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993709696 00000100:00100000:1.0:1788987133.953405:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993709312 00000100:00100000:1.0:1788987133.953410:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993709312 00000100:00100000:1.0:1788987133.953436:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993709184 00000100:00100000:1.0:1788987133.953439:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993709184 00000100:00100000:1.0:1788987133.953451:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993709568 00000100:00100000:1.0:1788987133.953454:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993709568 00000100:00100000:1.0:1788987133.953468:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2083 00000100:00100000:1.0:1788987133.953475:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993709312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987133.953525:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993709312:12345-0@lo:400:kworker.0 Request processed in 50us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987133.953531:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2083 00000100:00100000:1.0:1788987133.953548:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2084 00000100:00100000:1.0:1788987133.953554:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993709184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987133.953586:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993709184:12345-0@lo:400:kworker.0 Request processed in 32us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987133.953595:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2084 00000100:00100000:1.0:1788987133.953606:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2085 00000100:00100000:1.0:1788987133.953612:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993709568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987133.953638:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993709568:12345-0@lo:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987133.953644:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2085 00000100:00100000:1.0:1788987133.953678:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993709312:0@lo:400:kworker.0 00000100:00100000:1.0:1788987133.953705:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c1b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993709568:0@lo:400:kworker.0 00000100:00100000:1.0:1788987133.953714:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993709184:0@lo:400:kworker.0 00000100:00080000:1.0:1788987133.953745:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788987133.953751:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788987133.953768:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993709056 00000100:00100000:1.0:1788987133.953771:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993709056 00000100:00100000:1.0:1788987133.953796:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1605 00000100:00100000:1.0:1788987133.953803:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993709056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987133.953838:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993709056:12345-0@lo:400:kworker.0 Request processed in 36us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987133.953843:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1605 00000100:00100000:1.0:1788987133.953871:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993709056:0@lo:400:kworker.0 00000100:00100000:0.0:1788987133.954983:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1587 00000100:00100000:0.0:1788987133.954998:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993709440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987133.955055:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943706a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993709440:12345-0@lo:400:kworker.0 Request processed in 63us (2393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987133.955061:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1587 00000100:00100000:0.0:1788987133.955848:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1588 00000100:00100000:0.0:1788987133.955857:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993709696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987133.955918:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993709696:12345-0@lo:400:kworker.0 Request processed in 63us (2959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987133.955924:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1588 00000100:00100000:1.0:1788987133.956139:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993709440:0@lo:400:kworker.0 00000100:00100000:1.0:1788987133.956309:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993709696:0@lo:400:kworker.0 00010000:00010000:3.0:1788987134.016406:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987134.464365:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993709824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788987134.464426:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987134.464614:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993709824 00000100:00100000:1.0:1788987134.464621:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993709824 00000100:00100000:2.0:1788987134.464739:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1788987134.464750:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993709824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788987134.464780:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987134.464842:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993709824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987134.464851:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1788987134.465131:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993709824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788987135.042903:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788987135.094211:0:108322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-sec: finish setup 16:52:13 (1788987133) === 00010000:00010000:3.0:1788987136.065048:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987136.882205:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987136.882239:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987136.882266:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987136.882295:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987136.882326:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971483008 00000100:00100000:0.0:1788987136.882335:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971483008 00000100:00100000:0.0:1788987136.882385:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 692 00000100:00100000:0.0:1788987136.882394:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1c892ff-5835-4823-91fb-89889326365b+5:2345:x1875885971483008:12345-192.168.206.21@tcp:9:umount.0 00000020:00000080:0.0:1788987136.882423:0:6695:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54aa28 00000100:00080000:0.0:1788987136.882432:0:6695:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f9eb800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788987136.882483:0:6695:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:0.0:1788987136.882762:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e1c892ff-5835-4823-91fb-89889326365b+2:2345:x1875885971483008:12345-192.168.206.21@tcp:9:umount.0 Request processed in 368us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987136.882771:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 692 00010000:00010000:0.0:1788987136.882795:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987136.883121:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971483136 00000100:00100000:2.0:1788987136.883127:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971483136 00000100:00100000:2.0:1788987136.883165:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971483392 00000100:00100000:2.0:1788987136.883169:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971483392 00000100:00100000:2.0:1788987136.883194:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971483264 00000100:00100000:2.0:1788987136.883197:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971483264 00000100:00100000:2.0:1788987136.883214:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:2.0:1788987136.883222:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+12:2346:x1875885971483136:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788987136.883234:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987136.883253:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aa05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17ba expref: 12 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987136.883271:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987136.883300:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+11:2346:x1875885971483136:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 80us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987136.883307:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 22 00000100:00100000:2.0:1788987136.883322:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:2.0:1788987136.883329:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+10:2346:x1875885971483392:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788987136.883335:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987136.883344:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a40030600/0xc20d828fcf54aa6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d181c expref: 10 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987136.883354:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987136.883370:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+9:2346:x1875885971483392:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 42us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987136.883375:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 23 00000100:00100000:2.0:1788987136.883386:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00100000:2.0:1788987136.883393:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45611450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+8:2346:x1875885971483264:12345-192.168.206.21@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788987136.883399:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987136.883407:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2000/0xc20d828fcf54aa0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17e4 expref: 8 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987136.883416:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987136.883431:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45611450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+7:2346:x1875885971483264:12345-192.168.206.21@tcp:103:ldlm_bl.0 Request processed in 39us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987136.883436:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 24 00000100:00080000:1.0:1788987136.883879:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788987136.889054:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987136.889209:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971483520 00000100:00100000:1.0:1788987136.889218:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971483520 00000100:00100000:1.0:1788987136.889282:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 693 00000100:00100000:1.0:1788987136.889291:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1c892ff-5835-4823-91fb-89889326365b+5:2345:x1875885971483520:12345-192.168.206.21@tcp:9:umount.0 00000020:00000080:1.0:1788987136.889317:0:86533:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54aa21 00000100:00080000:1.0:1788987136.889325:0:86533:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f9e9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788987136.889365:0:86533:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:1.0:1788987136.889608:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:e1c892ff-5835-4823-91fb-89889326365b+2:2345:x1875885971483520:12345-192.168.206.21@tcp:9:umount.0 Request processed in 317us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987136.889616:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 693 00000100:00080000:2.0:1788987136.889735:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788987136.890064:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987136.899313:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987136.899542:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971483776 00000100:00100000:1.0:1788987136.899552:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971483776 00000100:00100000:1.0:1788987136.899629:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1257 00000100:00100000:1.0:1788987136.899642:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1c892ff-5835-4823-91fb-89889326365b+6:2345:x1875885971483776:12345-192.168.206.21@tcp:39:umount.0 00000020:00000080:1.0:1788987136.900031:0:15241:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54aa1a 00000020:00010000:1.0:1788987136.900039:0:15241:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b0a7f9eb000: total 0 00000100:00080000:1.0:1788987136.900043:0:15241:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f9ed000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788987136.900070:0:15241:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967770 00000020:00010000:0.0:1788987136.900476:0:5843:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b0a7f9eb000: total 0 00010000:00010000:0.0:1788987136.900520:0:5843:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a7f9eb000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788987136.900558:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a45316800) 00010000:00010000:0.0:1788987136.900562:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788987136.900570:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a40030c00/0xc20d828fcf54aa36 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1815 expref: 5 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987136.900595:0:5843:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a7f9eb000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788987136.900607:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987136.900609:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987136.900611:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788987136.901194:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987136.901392:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e1c892ff-5835-4823-91fb-89889326365b+3:2345:x1875885971483776:12345-192.168.206.21@tcp:39:umount.0 Request processed in 1749us (2085us total) trans 4294967771 rc 0/0 00000100:00100000:1.0:1788987136.901401:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1257 00000100:00100000:1.0:1788987136.938400:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987136.938498:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971484032 00000100:00100000:2.0:1788987136.938507:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971484032 00000100:00100000:2.0:1788987136.938553:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1606 00000100:00100000:2.0:1788987136.938562:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+7:2345:x1875885971484032:12345-192.168.206.21@tcp:251:umount.0 00000020:00000080:2.0:1788987136.938596:0:5848:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54a9f7 00000020:00010000:2.0:1788987136.938603:0:5848:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9b0a43218000: total 0 00000100:00080000:2.0:1788987136.938608:0:5848:0:(import.c:65:import_set_state_nolock()) ffff9b0a4321d800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788987136.938682:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6035c4df-8d96-4dc5-b6ad-0c187c6bd172+3:2345:x1875885971484032:12345-192.168.206.21@tcp:251:umount.0 Request processed in 120us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987136.938689:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1606 00000020:00010000:3.0:1788987136.939003:0:5842:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9b0a43218000: total 0 00010000:00010000:3.0:1788987136.939007:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987136.939048:0:5842:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a43218000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788987136.939078:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54a9fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d17b3 expref: 2 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987136.939135:0:5842:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a43218000, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1788987136.939146:0:5842:0:(genops.c:885:class_export_put()) final put ffff9b0a43218000/6035c4df-8d96-4dc5-b6ad-0c187c6bd172 00010000:00010000:3.0:1788987136.939163:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987136.939165:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987136.939166:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788987136.939283:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a43218000/6035c4df-8d96-4dc5-b6ad-0c187c6bd172 for MGS 00000020:00000080:2.0:1788987136.939322:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a4321d800 for MGS 00010000:00010000:0.0:1788987137.088766:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987138.055988:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788987138.056013:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993709952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987138.056084:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987138.056190:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993709952 00000100:00100000:3.0:1788987138.056200:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993709952 00000100:00100000:3.0:1788987138.056260:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:3.0:1788987138.056270:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993709952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987138.056309:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987138.056356:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993709952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987138.056362:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00080000:3.0:1788987138.056381:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788987138.056415:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993709952:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788987138.105867:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e1c892ff-5835-4823-91fb-89889326365b 00000020:00000080:1.0:1788987138.105876:0:6721:0:(genops.c:885:class_export_put()) final put ffff9b0a7f9ec800/e1c892ff-5835-4823-91fb-89889326365b 00000020:00000080:1.0:1788987138.105909:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a7f9ec800/e1c892ff-5835-4823-91fb-89889326365b for lustre-OST0000 00000020:00000080:1.0:1788987138.105961:0:489:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a7f9e9000 for lustre-OST0000 00010000:00010000:3.0:1788987138.115481:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788987138.140350:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e1c892ff-5835-4823-91fb-89889326365b 00000020:00000080:1.0:1788987138.140358:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b0a7f9ef800/e1c892ff-5835-4823-91fb-89889326365b 00000020:00000080:3.0:1788987138.140410:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a7f9ef800/e1c892ff-5835-4823-91fb-89889326365b for lustre-OST0001 00000020:00000080:3.0:1788987138.140463:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a7f9eb800 for lustre-OST0001 00000100:00100000:1.0:1788987139.074322:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993710080:0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.074439:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987139.074524:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993710592:0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.074568:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987139.074612:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788987139.074623:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993710208:0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.074645:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987139.074663:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993710720:0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.074684:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987139.074714:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993710464:0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.074736:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987139.074755:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987139.074762:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993710336:0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.074783:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987139.074890:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993710080 00000100:00100000:0.0:1788987139.074904:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993710080 00000100:00100000:0.0:1788987139.074976:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607 00000100:00100000:0.0:1788987139.074987:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993710080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987139.075059:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993710080:12345-0@lo:400:kworker.0 Request processed in 73us (622us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987139.075070:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607 00000100:00100000:1.0:1788987139.083559:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993710592 00000100:00100000:1.0:1788987139.083584:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993710592 00000100:00100000:1.0:1788987139.083670:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993710208 00000100:00100000:1.0:1788987139.083674:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993710208 00000100:00100000:1.0:1788987139.083691:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993710336 00000100:00100000:1.0:1788987139.083693:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993710336 00000100:00100000:1.0:1788987139.083714:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2086 00000100:00100000:1.0:1788987139.083723:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993710592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.083808:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993710592:12345-0@lo:400:kworker.0 Request processed in 87us (9240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987139.083816:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2086 00000100:00100000:1.0:1788987139.083859:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2087 00000100:00100000:1.0:1788987139.083872:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993710208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.083924:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993710208:12345-0@lo:400:kworker.0 Request processed in 56us (9277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987139.083932:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2087 00000100:00100000:1.0:1788987139.083954:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2088 00000100:00100000:1.0:1788987139.083966:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993710336:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788987139.084296:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987139.084584:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943706680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993710336:12345-0@lo:400:kworker.0 Request processed in 619us (9796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987139.084595:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2088 00000100:00100000:1.0:1788987139.084632:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993710720 00000100:00100000:1.0:1788987139.084639:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993710720 00000100:00100000:1.0:1788987139.084707:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993710464 00000100:00100000:1.0:1788987139.084714:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993710464 00000100:00100000:1.0:1788987139.084743:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1589 00000100:00100000:1.0:1788987139.084750:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993710720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.084783:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993710720:12345-0@lo:400:kworker.0 Request processed in 34us (10099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987139.084789:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1589 00000100:00100000:1.0:1788987139.084800:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1590 00000100:00100000:1.0:1788987139.084806:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993710464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.084832:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943707800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993710464:12345-0@lo:400:kworker.0 Request processed in 27us (10096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987139.084837:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1590 00000100:00100000:1.0:1788987139.084882:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993710208:0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.084893:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941328380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993710720:0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.084904:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993710080:0@lo:400:kworker.0 00000100:00100000:1.0:1788987139.084914:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993710592:0@lo:400:kworker.0 00000100:00080000:3.0:1788987139.085019:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788987139.092735:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993710336:0@lo:400:kworker.0 00000100:00100000:2.0:1788987139.092758:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942ee9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993710464:0@lo:400:kworker.0 00010000:00010000:0.0:1788987139.147296:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987139.584430:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993710848:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788987139.584552:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987139.585546:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993710848 00000100:00100000:2.0:1788987139.585559:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993710848 00000100:00100000:2.0:1788987139.585614:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1788987139.585624:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993710848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788987139.585670:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987139.589469:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993710848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3829us (4902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987139.589490:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1788987139.591715:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993710848:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788987140.160226:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788987140.297755:0:108469:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff778aeaa0 20000000:00000080:0.0:1788987140.297774:0:108469:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a4324e400 uarg=0000000000000000 10000000:01000000:3.0:1788987140.419438:0:108469:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788987140.419589:0:108469:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987140.419613:0:108469:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54a9a3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54a99c expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987140.419623:0:108469:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987140.419667:0:108469:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54a9a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54a99c expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987140.419688:0:108469:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54a9a3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54a99c expref: 18 pid: 5846 timeout: 3024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987140.419702:0:108469:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108469:1875885993710976:0@lo:104: 00000100:00100000:3.0:1788987140.419771:0:108469:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987140.419948:0:108469:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a42c619c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788987140.420020:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993710976 00000100:00100000:0.0:1788987140.420028:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993710976 00000100:00100000:0.0:1788987140.420081:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 423 00000100:00100000:0.0:1788987140.420122:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:108469:x1875885993710976:12345-0@lo:104: 00010000:00010000:0.0:1788987140.420135:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a9a3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420210:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987140.420217:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:108469:x1875885993710976:12345-0@lo:104: Request processed in 129us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987140.420223:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 423 00010000:00010000:0.0:1788987140.420248:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788987140.420254:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54a9a3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420263:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef800 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:0.0:1788987140.420268:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54a9a3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420277:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54a9a3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788987140.420285:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54a9a3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987140.420288:0:108469:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108469:1875885993710976:0@lo:104: 10000000:01000000:0.0:1788987140.420299:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788987140.420319:0:108469:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420334:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9a3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420342:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788987140.420366:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9a3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420373:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508ef800/0xc20d828fcf54a99c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54a9a3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987140.420378:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788987140.420390:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987140.420393:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094132b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993711104:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987140.420394:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987140.420397:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987140.420428:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987140.420692:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993711104 00000100:00100000:0.0:1788987140.420697:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993711104 00010000:00010000:0.0:1788987140.420719:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54a9a3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a99c expref: 19 pid: 5846 timeout: 3024 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987140.420749:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1788987140.420756:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993711104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987140.420767:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987140.420772:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54a9a3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54a99c expref: 19 pid: 5846 timeout: 3024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420858:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54a9a3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54a99c expref: 19 pid: 5846 timeout: 3024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420872:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef200/0xc20d828fcf54a9a3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54a99c expref: 19 pid: 5846 timeout: 3024 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420886:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420894:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420909:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420916:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420923:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420929:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420934:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788987140.420939:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420946:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420956:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987140.420964:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788987140.420997:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993711104:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987140.421004:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:0.0:1788987140.421035:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094132b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993711104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987140.421128:0:108469:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987140.421136:0:108469:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987140.421142:0:108469:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3200/0xc20d828fcf54aa75 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108469 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1788987140.688790:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e1c892ff-5835-4823-91fb-89889326365b 00000001:00080000:0.0:1788987140.688806:0:5876:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967771 is committed 00000020:00000080:0.0:1788987140.688810:0:5876:0:(genops.c:885:class_export_put()) final put ffff9b0a7f9eb000/e1c892ff-5835-4823-91fb-89889326365b 00000020:00000080:2.0:1788987140.692048:0:100526:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a7f9eb000/e1c892ff-5835-4823-91fb-89889326365b for lustre-MDT0000 00000020:00000080:0.0:1788987140.692475:0:100526:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a7f9ed000 for lustre-MDT0000 00010000:00010000:3.0:1788987141.184214:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788987141.482935:0:108518:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe01d34930 20000000:00000080:1.0:1788987141.482958:0:108518:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7f58e800 uarg=0000000000000000 10000000:01000000:1.0:1788987141.491748:0:108518:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788987141.491779:0:108518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa7c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.491795:0:108518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa7c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.491805:0:108518:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa7c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.491813:0:108518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa7c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.491820:0:108518:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa7c lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.491827:0:108518:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa7c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.491833:0:108518:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788987141.491837:0:108518:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa7c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.491844:0:108518:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa7c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.491860:0:108518:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa7c lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.491868:0:108518:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa7c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.491875:0:108518:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa7c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987141.889123:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788987141.889141:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788987141.889146:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788987141.889202:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987141.889214:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987141.889225:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987141.889252:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993711232:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788987141.889330:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987141.889398:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788987141.889439:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993711232 00000100:00100000:1.0:1788987141.889447:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993711232 00000100:00100000:1.0:1788987141.889500:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608 00000100:00100000:1.0:1788987141.889510:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993711232:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987141.889525:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987141.889540:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa8a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54aa83 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.889566:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa8a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54aa83 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.889578:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa8a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54aa83 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987141.889588:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d48800, rc 0) 00000100:00100000:1.0:1788987141.890226:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a508e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993711232:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 715us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987141.890234:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00100000:2.0:1788987141.893464:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe82680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993711232:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987141.893491:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987141.893504:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54aa8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987141.893526:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788987141.893532:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987141.893539:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.209265:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788987142.608391:0:108566:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffd72655b0 20000000:00000080:2.0:1788987142.608418:0:108566:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a796fe400 uarg=0000000000000000 10000000:01000000:2.0:1788987142.608711:0:108566:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987142.608740:0:108566:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987142.608764:0:108566:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa8a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54aa83 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987142.608774:0:108566:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987142.608827:0:108566:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa8a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54aa83 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987142.608844:0:108566:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa8a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54aa83 expref: 18 pid: 5846 timeout: 3026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987142.608862:0:108566:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe82680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108566:1875885993711360:0@lo:104: 00000100:00100000:2.0:1788987142.608942:0:108566:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987142.609011:0:108566:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a511f89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788987142.609509:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993711360 00000100:00100000:1.0:1788987142.609519:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993711360 00000100:00100000:1.0:1788987142.609590:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 424 00000100:00100000:1.0:1788987142.609602:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:108566:x1875885993711360:12345-0@lo:104: 00010000:00010000:1.0:1788987142.609628:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54aa8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987142.609708:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788987142.609715:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:108566:x1875885993711360:12345-0@lo:104: Request processed in 116us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987142.609723:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 424 00010000:00010000:3.0:1788987142.609898:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987142.609908:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54aa8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.609917:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0600 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987142.609921:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54aa8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.609931:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54aa8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987142.609939:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54aa8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987142.609945:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:2.0:1788987142.609973:0:108566:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe82680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108566:1875885993711360:0@lo:104: 00010000:00010000:3.0:1788987142.609991:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aa8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987142.609996:0:108566:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.609998:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987142.610040:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aa8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987142.610052:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993711488:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987142.610053:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a581f0600/0xc20d828fcf54aa83 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aa8a expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610071:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987142.610073:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987142.610075:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987142.610104:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987142.610258:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993711488 00000100:00100000:3.0:1788987142.610262:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993711488 00010000:00010000:3.0:1788987142.610311:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa8a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54aa83 expref: 19 pid: 5846 timeout: 3026 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987142.610350:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1788987142.610359:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993711488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987142.610372:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788987142.610378:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa8a lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54aa83 expref: 19 pid: 5846 timeout: 3026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610390:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa8a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54aa83 expref: 19 pid: 5846 timeout: 3026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610406:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aa8a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54aa83 expref: 19 pid: 5846 timeout: 3026 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610420:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610429:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610450:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610458:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610464:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610471:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610476:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987142.610481:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610490:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610510:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987142.610523:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788987142.610562:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993711488:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987142.610569:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00010000:00010000:0.0:1788987142.610572:0:108566:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987142.610579:0:108566:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987142.610586:0:108566:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0c00/0xc20d828fcf54aa91 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108566 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987142.610866:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993711488:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788987143.168404:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788987143.168437:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993711616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788987143.168543:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987143.170072:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993711616 00000100:00100000:3.0:1788987143.170103:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993711616 00000100:00100000:3.0:1788987143.170185:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:3.0:1788987143.170214:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094132b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993711616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987143.170260:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987143.170375:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094132b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993711616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987143.170382:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00080000:0.0:1788987143.170575:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788987143.170633:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993711616:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788987143.232272:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788987143.691634:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788987143.691644:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788987143.691650:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788987143.691707:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987143.691720:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987143.691732:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987143.691763:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993711744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788987143.691842:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987143.691894:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a41254300 going to sleep for 11 seconds 00000100:00100000:0.0:1788987143.692908:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993711744 00000100:00100000:0.0:1788987143.692934:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993711744 00000100:00100000:0.0:1788987143.693005:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:0.0:1788987143.693016:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993711744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987143.693036:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788987143.693055:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54aa9f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54aa98 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.693107:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54aa9f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54aa98 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.693119:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54aa9f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54aa98 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.693128:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee400, rc 0) 00000100:00100000:0.0:1788987143.693218:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993711744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 203us (1376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987143.693226:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00100000:0.0:1788987143.693322:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993711744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987143.693344:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa9f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.693355:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54aa9f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987143.693382:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788987143.693389:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa9f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.693398:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aa9f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788987143.786310:0:108617:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe919f6e40 20000000:00000080:2.0:1788987143.786331:0:108617:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a796fe000 uarg=0000000000000000 10000000:01000000:2.0:1788987143.786562:0:108617:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987143.786586:0:108617:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987143.786604:0:108617:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54aa9f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54aa98 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987143.786872:0:108617:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987143.786979:0:108617:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54aa9f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54aa98 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987143.786997:0:108617:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54aa9f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54aa98 expref: 18 pid: 5848 timeout: 3027 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987143.787120:0:108617:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe82680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108617:1875885993711872:0@lo:104: 00000100:00100000:2.0:1788987143.788370:0:108617:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987143.788446:0:108617:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b094390b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788987143.788604:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993711872 00000100:00100000:1.0:1788987143.788626:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993711872 00000100:00100000:1.0:1788987143.788687:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 425 00000100:00100000:1.0:1788987143.788698:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:108617:x1875885993711872:12345-0@lo:104: 00010000:00010000:1.0:1788987143.788714:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54aa9f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987143.788773:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788987143.788779:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:108617:x1875885993711872:12345-0@lo:104: Request processed in 83us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987143.788785:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 425 00010000:00010000:1.0:1788987143.788807:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788987143.788814:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54aa9f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987143.788821:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d49a00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788987143.788825:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54aa9f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987143.788834:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54aa9f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788987143.788842:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54aa9f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987143.788848:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788987143.788890:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aa9f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987143.788897:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788987143.788919:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aa9f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987143.788926:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a43d49a00/0xc20d828fcf54aa98 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aa9f expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987143.788946:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987143.788948:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987143.788949:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987143.788957:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987143.788971:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993712000:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788987143.788999:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987143.789377:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993712000 00000100:00100000:0.0:1788987143.789383:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993712000 00010000:00010000:0.0:1788987143.789409:0:5841:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54aa9f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54aa98 expref: 19 pid: 5848 timeout: 3027 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987143.789438:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1788987143.789445:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993712000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987143.789455:0:5841:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788987143.789461:0:5841:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54aa9f lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54aa98 expref: 19 pid: 5848 timeout: 3027 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.789472:0:5841:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54aa9f lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54aa98 expref: 19 pid: 5848 timeout: 3027 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.789491:0:5841:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.789500:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.789516:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.789524:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.789530:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.789538:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.789543:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788987143.789547:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.789555:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.789564:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.789574:0:5841:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788987143.789603:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993712000:12345-0@lo:103:ldlm_bl.0 Request processed in 159us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987143.789627:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1788987143.789823:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943705c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993712000:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987143.790256:0:108617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54aa9f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54aa98 expref: 18 pid: 5848 timeout: 3027 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987143.790273:0:108617:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe82680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108617:1875885993711872:0@lo:104: 00010000:00010000:0.0:1788987143.790293:0:108617:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.790302:0:108617:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.790308:0:108617:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987143.790314:0:108617:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1400/0xc20d828fcf54aaa6 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108617 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987144.193521:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094132b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993712256:0@lo:400:kworker.0 00000100:00100000:0.0:1788987144.193604:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987144.193675:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993712768:0@lo:400:kworker.0 00000100:00100000:0.0:1788987144.193705:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987144.193730:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788987144.193735:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993712384:0@lo:400:kworker.0 00000100:00100000:0.0:1788987144.193755:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987144.193794:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993712256 00000100:00100000:0.0:1788987144.193802:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993712256 00000100:00100000:0.0:1788987144.193849:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993712384 00000100:00100000:0.0:1788987144.193852:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993712384 00000100:00100000:0.0:1788987144.193885:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2089 00000100:00100000:0.0:1788987144.193894:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993712256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987144.193943:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941329880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993712256:12345-0@lo:400:kworker.0 Request processed in 51us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987144.193950:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2089 00000100:00100000:0.0:1788987144.193968:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2090 00000100:00100000:0.0:1788987144.193974:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094132bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993712384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987144.193999:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094132bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993712384:12345-0@lo:400:kworker.0 Request processed in 26us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987144.194005:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2090 00000100:00080000:0.0:1788987144.194037:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987144.195204:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941329500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993712384:0@lo:400:kworker.0 00000100:00100000:0.0:1788987144.195225:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094132b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993712256:0@lo:400:kworker.0 00000100:00100000:1.0:1788987144.196564:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993712128:0@lo:400:kworker.0 00000100:00100000:1.0:1788987144.196656:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987144.196705:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094132a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993712640:0@lo:400:kworker.0 00000100:00100000:1.0:1788987144.196732:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987144.196763:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987144.196770:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993712512:0@lo:400:kworker.0 00000100:00100000:1.0:1788987144.196795:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987144.196841:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993712640 00000100:00100000:1.0:1788987144.196848:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993712640 00000100:00100000:1.0:1788987144.196905:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2091 00000100:00100000:1.0:1788987144.196914:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993712640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987144.196975:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943705c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3319:x1875885993712640:12345-0@lo:400:kworker.0 Request processed in 62us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987144.196982:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2091 00000100:00100000:1.0:1788987144.197006:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993712768 00000100:00100000:1.0:1788987144.197021:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993712768 00000100:00100000:1.0:1788987144.197436:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993712512 00000100:00100000:1.0:1788987144.197440:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993712512 00000100:00100000:1.0:1788987144.197467:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1591 00000100:00100000:1.0:1788987144.197474:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094132ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993712768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987144.197518:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094132ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993712768:12345-0@lo:400:kworker.0 Request processed in 45us (3813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987144.197534:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1591 00000100:00100000:1.0:1788987144.197547:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1592 00000100:00100000:1.0:1788987144.197553:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993712512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987144.197744:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094132a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3319:1875885993712640:0@lo:400:kworker.0 00000100:00100000:1.0:1788987144.197946:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993712512:12345-0@lo:400:kworker.0 Request processed in 392us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987144.197953:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1592 00000100:00100000:3.0:1788987144.199274:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941328000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993712512:0@lo:400:kworker.0 00000100:00100000:0.0:1788987144.200399:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993712128 00000100:00100000:0.0:1788987144.200411:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993712128 00000100:00100000:0.0:1788987144.200489:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:0.0:1788987144.200498:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993712128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987144.200886:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993712128:12345-0@lo:400:kworker.0 Request processed in 388us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987144.200894:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00080000:0.0:1788987144.200940:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788987144.200948:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987144.200986:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993712768:0@lo:400:kworker.0 00000100:00100000:3.0:1788987144.202177:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993712128:0@lo:400:kworker.0 00010000:00010000:3.0:1788987144.271832:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987144.706116:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993712896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788987144.706196:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987144.706276:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993712896 00000100:00100000:0.0:1788987144.706284:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993712896 00000100:00100000:0.0:1788987144.706330:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1788987144.706339:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993712896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987144.706369:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987144.706411:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094132b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993712896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987144.706418:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:0.0:1788987144.706474:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941328e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993712896:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788987145.280848:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788987145.344468:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788987145.344479:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788987145.344484:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788987145.344548:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987145.344563:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987145.344576:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987145.344606:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941328e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993713024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788987145.344692:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987145.344764:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941fe7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788987145.344945:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993713024 00000100:00100000:1.0:1788987145.344955:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993713024 00000100:00100000:1.0:1788987145.345011:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:1.0:1788987145.345021:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993713024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987145.345034:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987145.345047:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aab4 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54aaad expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987145.345084:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aab4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54aaad expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987145.345146:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aab4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54aaad expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987145.345160:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d49600, rc 0) 00000100:00100000:1.0:1788987145.345201:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993713024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987145.345208:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00100000:0.0:1788987145.345460:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941328e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993713024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987145.345475:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aab4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987145.345484:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54aab4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987145.345502:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788987145.345506:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aab4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987145.345513:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aab4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987146.309264:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987147.331371:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987148.291762:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993713152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987148.291865:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987148.292975:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993713152 00000100:00100000:0.0:1788987148.292999:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993713152 00000100:00100000:0.0:1788987148.293344:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:0.0:1788987148.293357:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993713152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788987148.293402:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987148.293484:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993713152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987148.293491:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00080000:0.0:1788987148.293515:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788987148.295374:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993713152:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788987148.352473:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788987148.820459:0:108813:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffccba74130 20000000:00000080:1.0:1788987148.820479:0:108813:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b09436cac00 uarg=0000000000000000 10000000:01000000:1.0:1788987148.821942:0:108813:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788987148.821967:0:108813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987148.821986:0:108813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aab4 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54aaad expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987148.821994:0:108813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987148.822194:0:108813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aab4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54aaad expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987148.822211:0:108813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aab4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54aaad expref: 18 pid: 5849 timeout: 3032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987148.822228:0:108813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108813:1875885993713280:0@lo:104: 00000100:00100000:1.0:1788987148.822653:0:108813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987148.822715:0:108813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0948541d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788987148.822899:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788987148.822926:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993713280 00000100:00100000:0.0:1788987148.822936:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993713280 00000100:00100000:0.0:1788987148.823020:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 426 00000100:00100000:0.0:1788987148.823032:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a73ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:108813:x1875885993713280:12345-0@lo:104: 00010000:00010000:0.0:1788987148.823052:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54aab4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987148.823763:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987148.823773:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a73ab5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:108813:x1875885993713280:12345-0@lo:104: Request processed in 743us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987148.823782:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 426 00010000:00010000:3.0:1788987148.823848:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987148.823857:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54aab4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.823867:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987148.823872:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54aab4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.823882:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54aab4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987148.823889:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54aab4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987148.823895:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00000100:00100000:2.0:1788987148.823913:0:108813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:108813:1875885993713280:0@lo:104: 00010000:00010000:2.0:1788987148.823942:0:108813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.823944:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aab4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.823951:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987148.823975:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aab4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.823983:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aaad lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aab4 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987148.824000:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993713408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987148.824002:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987148.824004:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987148.824006:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987148.824048:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987148.824135:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993713408 00000100:00100000:3.0:1788987148.824140:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993713408 00010000:00010000:3.0:1788987148.824167:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aab4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54aaad expref: 19 pid: 5849 timeout: 3032 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987148.824201:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1788987148.824209:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993713408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987148.824222:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788987148.824227:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aab4 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54aaad expref: 19 pid: 5849 timeout: 3032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.824238:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aab4 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54aaad expref: 19 pid: 5849 timeout: 3032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.824253:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aab4 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54aaad expref: 19 pid: 5849 timeout: 3032 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.824267:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.824277:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.824292:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.824299:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.824306:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.824313:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.824318:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987148.824322:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.824331:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.824363:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987148.824373:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788987148.824407:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993713408:12345-0@lo:103:ldlm_bl.0 Request processed in 199us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987148.824414:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00000100:00100000:3.0:1788987148.824446:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993713408:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987148.824791:0:108813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987148.824802:0:108813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987148.824808:0:108813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d48a00/0xc20d828fcf54aabb lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 108813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987149.317723:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993713536:0@lo:400:kworker.0 00000100:00100000:0.0:1788987149.317844:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987149.317959:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993713536 00000100:00100000:1.0:1788987149.317970:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993713536 00000100:00100000:1.0:1788987149.318050:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612 00000100:00100000:1.0:1788987149.318061:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993713536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987149.318452:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993713664:0@lo:400:kworker.0 00000100:00100000:2.0:1788987149.318504:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987149.322363:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993713536:12345-0@lo:400:kworker.0 Request processed in 4289us (4504us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987149.322384:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00000100:00100000:0.0:1788987149.322700:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993713536:0@lo:400:kworker.0 00000100:00100000:0.0:1788987149.322876:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993713664 00000100:00100000:0.0:1788987149.322885:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993713664 00000100:00100000:0.0:1788987149.322945:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2092 00000100:00100000:0.0:1788987149.322955:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993713664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987149.323317:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993713664:12345-0@lo:400:kworker.0 Request processed in 362us (4812us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987149.323325:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2092 00000100:00100000:0.0:1788987149.324075:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993714048:0@lo:400:kworker.0 00000100:00100000:0.0:1788987149.324168:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987149.324210:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788987149.324217:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993714176:0@lo:400:kworker.0 00000100:00100000:0.0:1788987149.324245:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987149.324279:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993714048 00000100:00100000:0.0:1788987149.324286:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993714048 00000100:00100000:0.0:1788987149.324340:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2093 00000100:00100000:0.0:1788987149.324349:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993714048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987149.324397:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941328e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993714048:12345-0@lo:400:kworker.0 Request processed in 49us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987149.324403:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2093 00000100:00100000:0.0:1788987149.324439:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993714176 00000100:00100000:0.0:1788987149.324442:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993714176 00000100:00100000:0.0:1788987149.324694:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1593 00000100:00100000:0.0:1788987149.324703:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993714176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987149.324738:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941329500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993714176:12345-0@lo:400:kworker.0 Request processed in 37us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987149.324756:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1593 00000100:00100000:3.0:1788987149.324888:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993713920:0@lo:400:kworker.0 00000100:00100000:3.0:1788987149.324922:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987149.324950:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788987149.324958:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993713792:0@lo:400:kworker.0 00000100:00100000:3.0:1788987149.324979:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987149.325204:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993713920 00000100:00100000:0.0:1788987149.325210:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993713920 00000100:00100000:0.0:1788987149.325247:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1594 00000100:00100000:0.0:1788987149.325255:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993713920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987149.325288:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993713920:12345-0@lo:400:kworker.0 Request processed in 34us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987149.325294:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1594 00000100:00080000:0.0:1788987149.325312:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788987149.325317:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987149.325358:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993714176:0@lo:400:kworker.0 00000100:00100000:0.0:1788987149.325371:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993714048:0@lo:400:kworker.0 00000100:00100000:3.0:1788987149.325656:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993713920:0@lo:400:kworker.0 00000100:00100000:0.0:1788987149.325937:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993713792 00000100:00100000:0.0:1788987149.325942:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993713792 00000100:00100000:0.0:1788987149.326141:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2094 00000100:00100000:0.0:1788987149.326150:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993713792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987149.326211:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993713792:12345-0@lo:400:kworker.0 Request processed in 62us (1229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987149.326217:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2094 00000100:00100000:0.0:1788987149.326249:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993713792:0@lo:400:kworker.0 00000100:00100000:2.0:1788987149.326447:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993713664:0@lo:400:kworker.0 00000100:00080000:1.0:1788987149.327530:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788987149.376381:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987149.824249:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788987149.824272:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993714304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788987149.824337:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987149.824396:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993714304 00000100:00100000:0.0:1788987149.824403:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993714304 00000100:00100000:0.0:1788987149.824453:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1788987149.824464:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094132aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993714304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987149.824502:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987149.824550:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094132aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993714304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987149.824558:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1788987149.824605:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993714304:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788987150.401270:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788987150.657257:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788987150.657266:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788987150.657272:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788987150.657327:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987150.657339:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987150.657351:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987150.657377:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941329180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993714432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788987150.657451:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987150.657504:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a50ab0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788987150.657543:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993714432 00000100:00100000:1.0:1788987150.657551:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993714432 00000100:00100000:1.0:1788987150.657608:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:1.0:1788987150.657617:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993714432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987150.657632:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987150.657644:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aac9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54aac2 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987150.657669:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aac9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54aac2 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987150.657680:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aac9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54aac2 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987150.657689:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d48800, rc 0) 00000100:00100000:1.0:1788987150.657737:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993714432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987150.657744:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00100000:0.0:1788987150.658394:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941329180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993714432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987150.658411:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987150.658420:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54aac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987150.658437:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788987150.658442:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987150.658455:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987151.431620:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987152.449014:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987153.214050:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987153.214205:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971484160 00000100:00100000:1.0:1788987153.214215:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971484160 00000100:00100000:1.0:1788987153.214292:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1614 00000100:00100000:1.0:1788987153.214301:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2345:x1875885971484160:12345-192.168.206.21@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788987153.214334:0:5848:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from da528634-9595-47cd-9385-2665acd18d8b@192.168.206.21@tcp t0 exp 0000000000000000 cur 2937 last 0 00000020:00000080:1.0:1788987153.214478:0:5848:0:(genops.c:1384:class_connect()) connect: client da528634-9595-47cd-9385-2665acd18d8b, cookie 0xc20d828fcf54aad0 00000100:00080000:1.0:1788987153.214532:0:5848:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f9e8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788987153.214724:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+5:2345:x1875885971484160:12345-192.168.206.21@tcp:250:mount.lustre.0 Request processed in 422us (682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987153.214732:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1614 00000100:00100000:2.0:1788987153.221814:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987153.221909:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971484288 00000100:00100000:1.0:1788987153.221919:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971484288 00000100:00100000:1.0:1788987153.221989:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1615 00000100:00100000:1.0:1788987153.222001:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da528634-9595-47cd-9385-2665acd18d8b+5:65516:x1875885971484288:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788987153.222019:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987153.222041:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aad7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1831 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987153.222075:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1831 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987153.222140:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a43d49600/0xc20d828fcf54aad7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1831 expref: 6 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987153.222152:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d49600, rc 0) 00000100:00100000:1.0:1788987153.222231:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da528634-9595-47cd-9385-2665acd18d8b+6:65516:x1875885971484288:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 232us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987153.222239:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1615 00000100:00100000:0.0:1788987153.227804:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987153.228074:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971484416 00000100:00100000:1.0:1788987153.228085:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971484416 00000100:00100000:1.0:1788987153.228224:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1616 00000100:00100000:1.0:1788987153.228237:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+6:65516:x1875885971484416:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788987153.228630:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+6:65516:x1875885971484416:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 323us (766us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788987153.228640:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1616 00000100:00100000:2.0:1788987153.231013:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987153.231659:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971484544 00000100:00100000:0.0:1788987153.231667:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971484544 00000100:00100000:0.0:1788987153.231720:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1617 00000100:00100000:0.0:1788987153.231728:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+6:65516:x1875885971484544:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788987153.231742:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788987153.231759:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54aade lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1838 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987153.231785:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54aade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1838 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987153.231796:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ee800/0xc20d828fcf54aade lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1838 expref: 7 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987153.231804:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee800, rc 0) 00000100:00100000:0.0:1788987153.231855:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+7:65516:x1875885971484544:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 128us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987153.231869:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1617 00000100:00100000:2.0:1788987153.234165:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987153.234398:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971484672 00000100:00100000:0.0:1788987153.234407:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971484672 00000100:00100000:0.0:1788987153.234459:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1618 00000100:00100000:0.0:1788987153.234468:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+7:65516:x1875885971484672:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788987153.234839:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+8:65516:x1875885971484672:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 372us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987153.234847:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1618 00000100:00100000:3.0:1788987153.236696:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987153.236866:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971484800 00000100:00100000:1.0:1788987153.236874:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971484800 00000100:00100000:1.0:1788987153.236924:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1619 00000100:00100000:1.0:1788987153.236935:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+8:65516:x1875885971484800:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788987153.237240:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+8:65516:x1875885971484800:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 305us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987153.237248:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1619 00000100:00100000:2.0:1788987153.245460:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987153.247381:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971484928 00000100:00100000:0.0:1788987153.247397:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971484928 00000100:00100000:0.0:1788987153.247482:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1620 00000100:00100000:0.0:1788987153.247492:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+8:65534:x1875885971484928:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788987153.247781:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e37450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+8:65534:x1875885971484928:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 290us (2330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987153.247789:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1620 00000100:00100000:3.0:1788987153.268199:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987153.268399:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971485056 00000100:00100000:2.0:1788987153.268409:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971485056 00000100:00100000:2.0:1788987153.268469:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1621 00000100:00100000:2.0:1788987153.268479:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da528634-9595-47cd-9385-2665acd18d8b+8:65534:x1875885971485056:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788987153.268882:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e34450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da528634-9595-47cd-9385-2665acd18d8b+8:65534:x1875885971485056:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 403us (691us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987153.268890:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1621 00000100:00100000:3.0:1788987153.271475:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987153.271688:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971485184 00000100:00100000:1.0:1788987153.271698:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971485184 00000100:00100000:1.0:1788987153.271746:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1622 00000100:00100000:1.0:1788987153.271755:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+8:65516:x1875885971485184:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788987153.271769:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987153.271784:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a43d48000/0xc20d828fcf54aae5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1862 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987153.271811:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d48000/0xc20d828fcf54aae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1862 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987153.271821:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a43d48000/0xc20d828fcf54aae5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1862 expref: 9 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987153.271829:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d48000, rc 0) 00000100:00100000:1.0:1788987153.273753:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+9:65516:x1875885971485184:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 1990us (2276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987153.273764:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1622 00000100:00100000:2.0:1788987153.284966:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987153.285074:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971485312 00000100:00100000:0.0:1788987153.285083:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971485312 00000100:00100000:0.0:1788987153.285200:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1623 00000100:00100000:0.0:1788987153.285210:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+9:65516:x1875885971485312:12345-192.168.206.21@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788987153.285235:0:5846:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788987153.285258:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788987153.285263:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788987153.285266:0:5846:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788987153.285268:0:5846:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788987153.287237:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+9:65516:x1875885971485312:12345-192.168.206.21@tcp:256:mount.lustre.0 Request processed in 2019us (2269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987153.287251:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1623 00000100:00100000:3.0:1788987153.292468:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987153.292651:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971485440 00000100:00100000:1.0:1788987153.292660:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971485440 00000100:00100000:1.0:1788987153.292753:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1624 00000100:00100000:1.0:1788987153.292763:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+9:65516:x1875885971485440:12345-192.168.206.21@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788987153.292778:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987153.292795:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a43d48200/0xc20d828fcf54aaec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1869 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987153.292821:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d48200/0xc20d828fcf54aaec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1869 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987153.292833:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a43d48200/0xc20d828fcf54aaec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1869 expref: 10 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987153.292842:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d48200, rc 0) 00000100:00100000:1.0:1788987153.292902:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46e36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+10:65516:x1875885971485440:12345-192.168.206.21@tcp:101:mount.lustre.0 Request processed in 140us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987153.292909:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1624 00000100:00100000:2.0:1788987153.297232:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987153.297357:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971485568 00000100:00100000:0.0:1788987153.297371:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971485568 00000100:00100000:0.0:1788987153.297436:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1625 00000100:00100000:0.0:1788987153.297446:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:65516:x1875885971485568:12345-192.168.206.21@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788987153.298132:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:65516:x1875885971485568:12345-192.168.206.21@tcp:501:mount.lustre.0 Request processed in 684us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987153.298142:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1625 00000100:00100000:3.0:1788987153.300488:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987153.300699:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971485696 00000100:00100000:1.0:1788987153.300710:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971485696 00000100:00100000:1.0:1788987153.300800:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1626 00000100:00100000:1.0:1788987153.300810:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+10:65516:x1875885971485696:12345-192.168.206.21@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788987153.301029:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+10:65516:x1875885971485696:12345-192.168.206.21@tcp:503:mount.lustre.0 Request processed in 218us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987153.301041:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1626 00000100:00100000:2.0:1788987153.304825:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987153.304919:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971485824 00000100:00100000:0.0:1788987153.304927:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971485824 00000100:00100000:0.0:1788987153.304985:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1627 00000100:00100000:0.0:1788987153.304994:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:65536:x1875885971485824:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788987153.305272:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:65536:x1875885971485824:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 277us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987153.305281:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1627 00000100:00100000:3.0:1788987153.338479:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987153.338656:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971485952 00000100:00100000:1.0:1788987153.338670:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971485952 00000100:00100000:1.0:1788987153.338738:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1628 00000100:00100000:1.0:1788987153.338748:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+10:65536:x1875885971485952:12345-192.168.206.21@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788987153.339012:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+10:65536:x1875885971485952:12345-192.168.206.21@tcp:502:llog_process_th.0 Request processed in 264us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987153.339021:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1628 00000100:00100000:3.0:1788987153.353604:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987153.353701:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971486080 00000100:00100000:1.0:1788987153.353711:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971486080 00000100:00100000:1.0:1788987153.353757:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1258 00000100:00100000:1.0:1788987153.353765:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2345:x1875885971486080:12345-192.168.206.21@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788987153.353792:0:5855:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from c602a535-9f45-4972-b672-7d262fcb8aee@192.168.206.21@tcp t0 exp 0000000000000000 cur 2937 last 0 00000020:00000080:1.0:1788987153.353830:0:5855:0:(genops.c:1384:class_connect()) connect: client c602a535-9f45-4972-b672-7d262fcb8aee, cookie 0xc20d828fcf54aaf3 00000004:00100000:1.0:1788987153.353877:0:5855:0:(mdt_handler.c:7294:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1788987153.354182:0:5855:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f9ef800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788987153.354251:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c602a535-9f45-4972-b672-7d262fcb8aee+6:2345:x1875885971486080:12345-192.168.206.21@tcp:38:mount.lustre.0 Request processed in 485us (655us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987153.354257:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1258 00000100:00100000:2.0:1788987153.359532:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987153.359584:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987153.359716:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971486208 00000100:00100000:0.0:1788987153.359725:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971486208 00000100:00100000:0.0:1788987153.359793:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971486336 00000100:00100000:0.0:1788987153.359797:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971486336 00000100:00100000:0.0:1788987153.359820:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1259 00000100:00100000:0.0:1788987153.359830:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c602a535-9f45-4972-b672-7d262fcb8aee+7:0:x1875885971486208:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788987153.359871:0:5856:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1788987153.359942:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c602a535-9f45-4972-b672-7d262fcb8aee+7:0:x1875885971486208:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 112us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987153.359950:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1259 00000100:00100000:0.0:1788987153.359980:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1260 00000100:00100000:0.0:1788987153.359987:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c602a535-9f45-4972-b672-7d262fcb8aee+6:65516:x1875885971486336:12345-192.168.206.21@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788987153.359998:0:5856:0:(mdt_handler.c:541:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261516288 avail 2259419136 00000100:00100000:0.0:1788987153.360021:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c602a535-9f45-4972-b672-7d262fcb8aee+6:65516:x1875885971486336:12345-192.168.206.21@tcp:41:mount.lustre.0 Request processed in 34us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987153.360031:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1260 00000100:00080000:1.0:1788987153.362125:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987153.363448:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987153.363538:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971486464 00000100:00100000:0.0:1788987153.363547:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971486464 00000100:00100000:0.0:1788987153.363623:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1261 00000100:00100000:0.0:1788987153.363633:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c602a535-9f45-4972-b672-7d262fcb8aee+6:65516:x1875885971486464:12345-192.168.206.21@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788987153.363718:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c602a535-9f45-4972-b672-7d262fcb8aee+6:65516:x1875885971486464:12345-192.168.206.21@tcp:40:mount.lustre.0 Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987153.363726:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1261 00000100:00100000:0.0:1788987153.367495:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987153.367594:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987153.368359:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971486592 00000100:00100000:1.0:1788987153.368369:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971486592 00000100:00100000:1.0:1788987153.368445:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971486720 00000100:00100000:1.0:1788987153.368449:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971486720 00000100:00100000:2.0:1788987153.368489:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 694 00000100:00100000:2.0:1788987153.368500:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2345:x1875885971486592:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788987153.368537:0:86533:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from c602a535-9f45-4972-b672-7d262fcb8aee@192.168.206.21@tcp t0 exp 0000000000000000 cur 2937 last 0 00000020:00000080:2.0:1788987153.368586:0:86533:0:(genops.c:1384:class_connect()) connect: client c602a535-9f45-4972-b672-7d262fcb8aee, cookie 0xc20d828fcf54aafa 00002000:00100000:2.0:1788987153.368600:0:86533:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c602a535-9f45-4972-b672-7d262fcb8aee/ffff9b0a7f371000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788987153.368625:0:86533:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788987153.369232:0:86533:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788987153.369266:0:86533:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f377800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788987153.369338:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941329180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c602a535-9f45-4972-b672-7d262fcb8aee+6:2345:x1875885971486592:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 837us (1854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987153.369347:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 694 00000100:00100000:2.0:1788987153.369370:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 695 00000100:00100000:2.0:1788987153.369375:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2345:x1875885971486720:12345-192.168.206.21@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788987153.369393:0:86533:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from c602a535-9f45-4972-b672-7d262fcb8aee@192.168.206.21@tcp t0 exp 0000000000000000 cur 2937 last 0 00000020:00000080:2.0:1788987153.369412:0:86533:0:(genops.c:1384:class_connect()) connect: client c602a535-9f45-4972-b672-7d262fcb8aee, cookie 0xc20d828fcf54ab01 00002000:00100000:2.0:1788987153.369418:0:86533:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c602a535-9f45-4972-b672-7d262fcb8aee/ffff9b0a7f370800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788987153.369432:0:86533:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788987153.369582:0:86533:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788987153.369598:0:86533:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f374800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788987153.369621:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941329c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c602a535-9f45-4972-b672-7d262fcb8aee+6:2345:x1875885971486720:12345-192.168.206.21@tcp:8:mount.lustre.0 Request processed in 244us (2027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987153.369628:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 695 00000100:00100000:3.0:1788987153.369896:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987153.369996:0:5857:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971486848 00000100:00100000:3.0:1788987153.370002:0:5857:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971486848 00000100:00100000:3.0:1788987153.370050:0:5857:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:3.0:1788987153.370060:0:5857:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c602a535-9f45-4972-b672-7d262fcb8aee+6:65516:x1875885971486848:12345-192.168.206.21@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788987153.370143:0:5857:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788987153.370191:0:5857:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c602a535-9f45-4972-b672-7d262fcb8aee+6:65516:x1875885971486848:12345-192.168.206.21@tcp:33:mount.lustre.0 Request processed in 133us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987153.370198:0:5857:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 125 00000100:00100000:3.0:1788987153.410479:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788987153.410501:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993714560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987153.410578:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987153.412229:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993714560 00000100:00100000:0.0:1788987153.412240:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993714560 00000100:00100000:0.0:1788987153.412311:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:0.0:1788987153.412320:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993714560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788987153.412343:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987153.412409:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993714560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987153.412416:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:0.0:1788987153.412471:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe14000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993714560:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788987153.414411:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788987153.472452:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788987153.479930:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c602a535-9f45-4972-b672-7d262fcb8aee 00000001:00100000:2.0:1788987153.495503:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c602a535-9f45-4972-b672-7d262fcb8aee 00000100:00100000:1.0:1788987154.432618:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993714944:0@lo:400:kworker.0 00000100:00100000:1.0:1788987154.432685:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987154.432814:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993714816:0@lo:400:kworker.0 00000100:00100000:3.0:1788987154.432854:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987154.432879:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788987154.432885:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993714688:0@lo:400:kworker.0 00000100:00100000:3.0:1788987154.432917:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987154.432952:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993714944 00000100:00100000:3.0:1788987154.432959:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993714944 00000100:00100000:3.0:1788987154.433006:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993714816 00000100:00100000:3.0:1788987154.433009:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993714816 00000100:00100000:3.0:1788987154.433029:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2095 00000100:00100000:3.0:1788987154.433037:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993714944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987154.435381:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1788987154.435401:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993714816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987154.435483:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993714816:12345-0@lo:400:kworker.0 Request processed in 92us (2628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987154.435490:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2096 00000100:00100000:0.0:1788987154.435529:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993715072:0@lo:400:kworker.0 00000100:00100000:0.0:1788987154.435574:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987154.435615:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993715072 00000100:00100000:0.0:1788987154.435622:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993715072 00000100:00100000:0.0:1788987154.435657:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1595 00000100:00100000:0.0:1788987154.435664:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993715072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987154.435698:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941328a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993715072:12345-0@lo:400:kworker.0 Request processed in 35us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987154.435704:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1595 00000100:00100000:0.0:1788987154.435740:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993715072:0@lo:400:kworker.0 00000100:00080000:2.0:1788987154.436752:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987154.436767:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993714688 00000100:00100000:2.0:1788987154.436773:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993714688 00000100:00100000:2.0:1788987154.436810:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1629 00000100:00100000:2.0:1788987154.436817:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993714688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987154.436880:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993714688:12345-0@lo:400:kworker.0 Request processed in 64us (3962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987154.436887:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1629 00000100:00100000:2.0:1788987154.436933:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993715328:0@lo:400:kworker.0 00000100:00100000:2.0:1788987154.436960:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987154.436991:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993714688:0@lo:400:kworker.0 00000100:00100000:2.0:1788987154.437004:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993714816:0@lo:400:kworker.0 00000100:00100000:2.0:1788987154.437021:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788987154.437027:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993715200:0@lo:400:kworker.0 00000100:00100000:2.0:1788987154.437069:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987154.437125:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993715200 00000100:00100000:2.0:1788987154.437139:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993715200 00000100:00100000:2.0:1788987154.439833:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2097 00000100:00100000:2.0:1788987154.439859:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993715200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987154.439979:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993715200:12345-0@lo:400:kworker.0 Request processed in 133us (2909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987154.439987:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2097 00000100:00080000:2.0:1788987154.440022:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987154.440070:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993715200:0@lo:400:kworker.0 00000100:00100000:0.0:1788987154.440487:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993715328 00000100:00100000:0.0:1788987154.440495:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993715328 00000100:00100000:0.0:1788987154.440562:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1596 00000100:00100000:0.0:1788987154.440571:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993715328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987154.440620:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993715328:12345-0@lo:400:kworker.0 Request processed in 51us (3660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987154.440626:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1596 00000100:00100000:0.0:1788987154.440794:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993715328:0@lo:400:kworker.0 00000100:00080000:2.0:1788987154.441295:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788987154.443698:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993714944:12345-0@lo:400:kworker.0 Request processed in 10653us (11004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987154.443712:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2095 00000100:00100000:1.0:1788987154.445384:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993714944:0@lo:400:kworker.0 00010000:00010000:1.0:1788987154.498758:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987154.948402:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993715456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788987154.948484:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987154.948566:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993715456 00000100:00100000:1.0:1788987154.948584:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993715456 00000100:00100000:1.0:1788987154.948638:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1788987154.948648:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993715456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788987154.948669:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987154.948713:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993715456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987154.948721:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:1.0:1788987154.948776:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993715456:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788987155.521650:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788987156.050356:0:5876:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c602a535-9f45-4972-b672-7d262fcb8aee 00010000:00010000:2.0:1788987156.549884:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987157.568311:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987158.535001:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993715584:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987158.535105:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987158.535196:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993715584 00000100:00100000:3.0:1788987158.535205:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993715584 00000100:00100000:3.0:1788987158.535273:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:3.0:1788987158.535283:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993715584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987158.535324:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987158.535371:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993715584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987158.535378:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00080000:3.0:1788987158.535401:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788987158.535439:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993715584:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788987158.592408:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987158.647834:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987158.647873:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987158.647900:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987158.647924:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987158.647954:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971487360 00000100:00100000:3.0:1788987158.647963:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971487360 00000100:00100000:3.0:1788987158.648014:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971487232 00000100:00100000:3.0:1788987158.648017:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971487232 00000100:00100000:3.0:1788987158.648056:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1597 00000100:00100000:3.0:1788987158.648076:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c602a535-9f45-4972-b672-7d262fcb8aee+5:2349:x1875885971487360:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788987158.648161:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c602a535-9f45-4972-b672-7d262fcb8aee+5:2349:x1875885971487360:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 96us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987158.648169:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1597 00000100:00100000:3.0:1788987158.648186:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1598 00000100:00100000:3.0:1788987158.648192:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c602a535-9f45-4972-b672-7d262fcb8aee+5:2349:x1875885971487232:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788987158.648216:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c602a535-9f45-4972-b672-7d262fcb8aee+5:2349:x1875885971487232:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987158.648222:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1598 00000100:00100000:3.0:1788987158.648239:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971486976 00000100:00100000:3.0:1788987158.648242:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971486976 00000100:00100000:3.0:1788987158.648264:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1630 00000100:00100000:3.0:1788987158.648270:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:2349:x1875885971486976:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788987158.648296:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:2349:x1875885971486976:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 26us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987158.648302:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1630 00000100:00080000:3.0:1788987158.648329:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788987158.648333:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788987158.649081:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971487104 00000100:00100000:2.0:1788987158.649109:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971487104 00000100:00100000:2.0:1788987158.649160:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2098 00000100:00100000:2.0:1788987158.649169:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c602a535-9f45-4972-b672-7d262fcb8aee+5:2349:x1875885971487104:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987158.649209:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c602a535-9f45-4972-b672-7d262fcb8aee+5:2349:x1875885971487104:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 42us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987158.649216:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2098 00000100:00080000:3.0:1788987158.649397:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987159.552422:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993716096:0@lo:400:kworker.0 00000100:00100000:2.0:1788987159.552495:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987159.552560:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788987159.552567:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993715968:0@lo:400:kworker.0 00000100:00100000:2.0:1788987159.552596:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987159.552628:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993716096 00000100:00100000:2.0:1788987159.552634:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993716096 00000100:00100000:2.0:1788987159.552678:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1599 00000100:00100000:2.0:1788987159.552687:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7678b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993716096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987159.552737:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7678b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993716096:12345-0@lo:400:kworker.0 Request processed in 51us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987159.552744:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1599 00000100:00100000:2.0:1788987159.552920:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993715968 00000100:00100000:2.0:1788987159.552925:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993715968 00000100:00100000:2.0:1788987159.552956:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2099 00000100:00100000:2.0:1788987159.552963:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993715968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987159.552994:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993715968:12345-0@lo:400:kworker.0 Request processed in 32us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987159.553000:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2099 00000100:00100000:2.0:1788987159.553041:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993715968:0@lo:400:kworker.0 00000100:00100000:2.0:1788987159.553052:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993716096:0@lo:400:kworker.0 00000100:00080000:3.0:1788987159.553155:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987159.553215:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993715712:0@lo:400:kworker.0 00000100:00100000:0.0:1788987159.553249:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987159.553276:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993716224:0@lo:400:kworker.0 00000100:00100000:0.0:1788987159.553298:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987159.553323:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788987159.553328:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993715840:0@lo:400:kworker.0 00000100:00100000:0.0:1788987159.553348:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987159.553364:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993716352:0@lo:400:kworker.0 00000100:00100000:0.0:1788987159.553384:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987159.553447:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993716224 00000100:00100000:3.0:1788987159.553452:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993716224 00000100:00100000:3.0:1788987159.553488:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993715840 00000100:00100000:3.0:1788987159.553492:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993715840 00000100:00100000:3.0:1788987159.553509:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2100 00000100:00100000:3.0:1788987159.553516:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094132a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993716224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987159.553553:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094132a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993716224:12345-0@lo:400:kworker.0 Request processed in 37us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987159.553559:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2100 00000100:00100000:3.0:1788987159.553573:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2101 00000100:00100000:3.0:1788987159.553578:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094132b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993715840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987159.553604:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094132b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993715840:12345-0@lo:400:kworker.0 Request processed in 26us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987159.553609:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2101 00000100:00100000:3.0:1788987159.553626:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993716352 00000100:00100000:3.0:1788987159.553630:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993716352 00000100:00100000:3.0:1788987159.553655:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1600 00000100:00100000:3.0:1788987159.553660:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993716352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987159.553689:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941328700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993716352:12345-0@lo:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987159.553698:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1600 00000100:00080000:0.0:1788987159.553758:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788987159.553761:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987159.553780:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993715840:0@lo:400:kworker.0 00000100:00100000:0.0:1788987159.553790:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993716352:0@lo:400:kworker.0 00000100:00100000:0.0:1788987159.553797:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993716224:0@lo:400:kworker.0 00000100:00100000:2.0:1788987159.553909:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993715712 00000100:00100000:2.0:1788987159.553914:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993715712 00000100:00100000:2.0:1788987159.553985:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1631 00000100:00100000:2.0:1788987159.553993:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993715712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987159.554035:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993715712:12345-0@lo:400:kworker.0 Request processed in 44us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987159.554041:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1631 00000100:00100000:0.0:1788987159.554124:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993715712:0@lo:400:kworker.0 00010000:00010000:3.0:1788987159.618308:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987160.066571:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987160.066594:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993716480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788987160.066663:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987160.067043:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993716480 00000100:00100000:1.0:1788987160.067052:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993716480 00000100:00100000:1.0:1788987160.067131:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1788987160.067142:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993716480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788987160.067186:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987160.067234:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993716480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987160.067241:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1788987160.067288:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993716480:0@lo:13:osp-pre-1-0.0 00000001:02000400:1.0:1788987160.365207:0:109163:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 25b: test nodemap info values ========= 16:52:38 (1788987158) 00010000:00010000:1.0:1788987160.644320:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987161.664284:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987162.688357:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00000400:3.0:1788987162.760312:0:109211:0:(mdt_lproc.c:313:identity_upcall_store()) lustre-MDT0000: disable "identity_upcall" with ACL enabled maybe cause unexpected "EACCESS" 00000004:01000000:3.0:1788987162.786968:0:109211:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to NONE 00000100:00100000:2.0:1788987163.651054:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987163.651077:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993716608:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788987163.651281:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987163.653470:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993716608 00000100:00100000:0.0:1788987163.653490:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993716608 00000100:00100000:0.0:1788987163.653600:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00080000:0.0:1788987163.653660:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788987163.653677:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993716608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788987163.653727:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987163.654015:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993716608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 404us (2734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987163.654023:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:3.0:1788987163.656424:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993716608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788987163.713704:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987163.761438:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987163.761477:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987163.761632:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987163.761668:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987163.761695:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971487616 00000100:00100000:3.0:1788987163.761705:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971487616 00000100:00100000:3.0:1788987163.761773:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2102 00000100:00100000:3.0:1788987163.761784:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c602a535-9f45-4972-b672-7d262fcb8aee+5:2347:x1875885971487616:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788987163.761855:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c602a535-9f45-4972-b672-7d262fcb8aee+5:2347:x1875885971487616:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 73us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987163.761862:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2102 00000100:00100000:0.0:1788987163.761863:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971487744 00000100:00100000:0.0:1788987163.761867:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971487744 00000100:00100000:3.0:1788987163.761882:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971487872 00000100:00100000:3.0:1788987163.761885:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971487872 00000100:00100000:0.0:1788987163.761896:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1601 00000100:00100000:0.0:1788987163.761908:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c602a535-9f45-4972-b672-7d262fcb8aee+5:2347:x1875885971487744:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987163.761937:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c602a535-9f45-4972-b672-7d262fcb8aee+5:2347:x1875885971487744:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 35us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987163.762068:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971487488 00000100:00100000:2.0:1788987163.762073:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971487488 00000100:00100000:2.0:1788987163.762125:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1632 00000100:00100000:2.0:1788987163.762133:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da528634-9595-47cd-9385-2665acd18d8b+10:2347:x1875885971487488:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987163.762160:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da528634-9595-47cd-9385-2665acd18d8b+10:2347:x1875885971487488:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 29us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987163.762166:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1632 00000100:00100000:3.0:1788987163.763249:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1602 00000100:00100000:3.0:1788987163.763261:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c602a535-9f45-4972-b672-7d262fcb8aee+5:2346:x1875885971487872:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788987163.763301:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c602a535-9f45-4972-b672-7d262fcb8aee+5:2346:x1875885971487872:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 44us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987163.763309:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1602 00000100:00080000:3.0:1788987163.763341:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788987163.763346:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788987163.763348:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788987163.771578:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1601 00000020:00000080:2.0:1788987163.820444:0:109261:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc37defcd0 20000000:00000080:2.0:1788987163.820460:0:109261:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a42c4ac00 uarg=0000000000000000 10000000:01000000:2.0:1788987163.820995:0:109261:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987163.821014:0:109261:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987163.822659:0:109261:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aac9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54aac2 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987163.822679:0:109261:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987163.822725:0:109261:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aac9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54aac2 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987163.822738:0:109261:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aac9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54aac2 expref: 18 pid: 5849 timeout: 3047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987163.822751:0:109261:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109261:1875885993716736:0@lo:104: 00000100:00100000:2.0:1788987163.822804:0:109261:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987163.822966:0:109261:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a7f89e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788987163.823060:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993716736 00000100:00100000:0.0:1788987163.823067:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993716736 00000100:00100000:0.0:1788987163.823342:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 427 00000100:00100000:0.0:1788987163.823353:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:109261:x1875885993716736:12345-0@lo:104: 00010000:00010000:0.0:1788987163.823365:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54aac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987163.823432:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987163.823438:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:109261:x1875885993716736:12345-0@lo:104: Request processed in 88us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987163.823445:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 427 00010000:00010000:3.0:1788987163.823492:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987163.823498:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54aac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.823506:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987163.823510:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54aac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.823518:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54aac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987163.823524:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54aac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987163.823530:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788987163.823559:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.823566:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987163.823584:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.823591:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54aac2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aac9 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.823604:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987163.823606:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987163.823607:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987163.823624:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993716864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788987163.823655:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987163.823695:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993716864 00000100:00100000:3.0:1788987163.823699:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993716864 00010000:00010000:3.0:1788987163.823716:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aac9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54aac2 expref: 19 pid: 5849 timeout: 3047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987163.823734:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1788987163.823739:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993716864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987163.823748:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788987163.823753:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aac9 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54aac2 expref: 19 pid: 5849 timeout: 3047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.823762:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aac9 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54aac2 expref: 19 pid: 5849 timeout: 3047 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.823776:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.823784:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.823796:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.823803:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.823809:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987163.823951:0:109261:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d48800/0xc20d828fcf54aac9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54aac2 expref: 19 pid: 5849 timeout: 3047 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987163.823961:0:109261:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109261:1875885993716736:0@lo:104: 00010000:00010000:3.0:1788987163.823993:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987163.824055:0:109261:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987163.824065:0:109261:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987163.824071:0:109261:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.824575:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1000 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987163.824580:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.824588:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.824597:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.824604:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1000/0xc20d828fcf54ab08 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109261 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987163.824676:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788987163.824714:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe17480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3320:x1875885993716864:12345-0@lo:103:ldlm_bl.0 Request processed in 974us (1058us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987163.824721:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00000100:00100000:1.0:1788987163.824962:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993716864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788987164.672301:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993717120:0@lo:400:kworker.0 00000100:00100000:2.0:1788987164.672379:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987164.672439:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993717632:0@lo:400:kworker.0 00000100:00100000:2.0:1788987164.672461:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987164.672484:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987164.672489:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993717248:0@lo:400:kworker.0 00000100:00100000:2.0:1788987164.672505:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987164.672536:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993717632 00000100:00100000:2.0:1788987164.672544:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993717632 00000100:00100000:2.0:1788987164.672603:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1603 00000100:00100000:2.0:1788987164.672612:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993717632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987164.672666:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993717632:12345-0@lo:400:kworker.0 Request processed in 55us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987164.672672:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1603 00000100:00080000:2.0:1788987164.672696:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788987164.672735:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993717632:0@lo:400:kworker.0 00000100:00100000:1.0:1788987164.672830:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993716992:0@lo:400:kworker.0 00000100:00100000:1.0:1788987164.672865:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987164.672899:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993717504:0@lo:400:kworker.0 00000100:00100000:1.0:1788987164.672922:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987164.672946:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788987164.672952:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993717376:0@lo:400:kworker.0 00000100:00100000:1.0:1788987164.672973:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987164.673005:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993717120 00000100:00100000:1.0:1788987164.673009:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993717120 00000100:00100000:1.0:1788987164.673050:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993717248 00000100:00100000:1.0:1788987164.673053:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993717248 00000100:00100000:1.0:1788987164.673079:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993717504 00000100:00100000:1.0:1788987164.673082:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993717504 00000100:00100000:1.0:1788987164.673120:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2103 00000100:00100000:1.0:1788987164.673127:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993717120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987164.673165:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993717120:12345-0@lo:400:kworker.0 Request processed in 39us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987164.673172:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2103 00000100:00100000:1.0:1788987164.673186:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2104 00000100:00100000:1.0:1788987164.673192:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993717248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987164.673219:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993717248:12345-0@lo:400:kworker.0 Request processed in 28us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987164.673228:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2104 00000100:00100000:1.0:1788987164.673239:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2105 00000100:00100000:1.0:1788987164.673244:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993717504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987164.673274:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993717504:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987164.673279:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2105 00000100:00100000:1.0:1788987164.673295:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993717376 00000100:00100000:1.0:1788987164.673298:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993717376 00000100:00100000:1.0:1788987164.673321:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1604 00000100:00100000:1.0:1788987164.673327:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993717376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987164.673355:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993717376:12345-0@lo:400:kworker.0 Request processed in 29us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987164.673361:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1604 00000100:00080000:1.0:1788987164.673384:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987164.673402:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993717376:0@lo:400:kworker.0 00000100:00100000:1.0:1788987164.673411:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993717504:0@lo:400:kworker.0 00000100:00100000:1.0:1788987164.673441:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993717248:0@lo:400:kworker.0 00000100:00100000:1.0:1788987164.673451:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993717120:0@lo:400:kworker.0 00000100:00100000:2.0:1788987164.678518:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993716992 00000100:00100000:2.0:1788987164.678533:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993716992 00000100:00100000:2.0:1788987164.678594:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1633 00000100:00100000:2.0:1788987164.678604:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993716992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987164.678700:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993716992:12345-0@lo:400:kworker.0 Request processed in 97us (5833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987164.678707:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1633 00000100:00100000:1.0:1788987164.680517:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993716992:0@lo:400:kworker.0 00010000:00010000:3.0:1788987164.736286:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788987164.815401:0:109309:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff2b3424b0 20000000:00000080:2.0:1788987164.815417:0:109309:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a45072000 uarg=0000000000000000 10000000:01000000:2.0:1788987164.815690:0:109309:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987164.815709:0:109309:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab0f lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987164.815726:0:109309:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab0f lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987164.815735:0:109309:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab0f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987164.815741:0:109309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab0f lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987164.815748:0:109309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab0f lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987164.815755:0:109309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab0f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987164.815765:0:109309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987164.815769:0:109309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab0f lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987164.815777:0:109309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab0f lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987164.815790:0:109309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab0f lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987164.815798:0:109309:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab0f lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987164.815805:0:109309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab0f lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109309 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987165.185260:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993717760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788987165.185337:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987165.187400:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993717760 00000100:00100000:1.0:1788987165.187416:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993717760 00000100:00100000:1.0:1788987165.187485:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:1.0:1788987165.187570:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993717760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788987165.187626:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987165.188357:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993717760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 860us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987165.188368:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1788987165.189671:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993717760:0@lo:13:osp-pre-1-0.0 10000000:01000000:3.0:1788987165.312655:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788987165.312666:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788987165.312671:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788987165.312718:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.312738:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.312750:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987165.312780:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993717888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788987165.312869:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987165.312933:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0948b95c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788987165.312952:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993717888 00000100:00100000:1.0:1788987165.312960:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993717888 00000100:00100000:1.0:1788987165.313019:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1634 00000100:00100000:1.0:1788987165.313041:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993717888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788987165.313057:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788987165.313072:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf54ab1d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54ab16 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987165.313115:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf54ab1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54ab16 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987165.313127:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf54ab1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54ab16 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987165.313136:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a43d48e00, rc 0) 00000100:00100000:1.0:1788987165.313179:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993717888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987165.313185:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1634 00000100:00100000:3.0:1788987165.313291:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993717888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987165.313304:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab1d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.313313:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54ab1d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987165.313331:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788987165.313335:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab1d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.313342:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab1d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987165.761012:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788987165.874938:0:109358:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe5717bdc0 20000000:00000080:0.0:1788987165.875077:0:109358:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0942780c00 uarg=0000000000000000 10000000:01000000:0.0:1788987165.875330:0:109358:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788987165.875348:0:109358:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987165.875366:0:109358:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf54ab1d lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54ab16 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987165.875375:0:109358:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987165.875410:0:109358:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf54ab1d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54ab16 expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987165.875424:0:109358:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf54ab1d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54ab16 expref: 18 pid: 5846 timeout: 3049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987165.875437:0:109358:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094132ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109358:1875885993718016:0@lo:104: 00000100:00100000:0.0:1788987165.875502:0:109358:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987165.875805:0:109358:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0942afe000 going to sleep for 11 seconds 00000100:00100000:2.0:1788987165.876301:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993718016 00000100:00100000:2.0:1788987165.876309:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993718016 00000100:00100000:2.0:1788987165.876399:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 428 00000100:00100000:2.0:1788987165.876409:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941329500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:109358:x1875885993718016:12345-0@lo:104: 00010000:00010000:2.0:1788987165.876422:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54ab1d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987165.876506:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788987165.876512:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941329500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:109358:x1875885993718016:12345-0@lo:104: Request processed in 105us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987165.876518:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 428 00010000:00010000:3.0:1788987165.876574:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987165.876582:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54ab1d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876589:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987165.876594:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54ab1d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876603:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54ab1d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987165.876619:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54ab1d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987165.876626:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788987165.876666:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab1d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876672:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987165.876694:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab1d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876700:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab16 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab1d expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876714:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987165.876716:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987165.876718:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987165.876737:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993718144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788987165.876772:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987165.876817:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993718144 00000100:00100000:3.0:1788987165.876821:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993718144 00010000:00010000:3.0:1788987165.876840:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf54ab1d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54ab16 expref: 19 pid: 5846 timeout: 3049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987165.876863:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1788987165.876870:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993718144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987165.876880:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788987165.876885:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf54ab1d lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54ab16 expref: 19 pid: 5846 timeout: 3049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876894:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf54ab1d lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54ab16 expref: 19 pid: 5846 timeout: 3049 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876909:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876917:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876931:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876937:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876956:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876963:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876968:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987165.876972:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876979:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.876997:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987165.877006:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788987165.877046:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993718144:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987165.877053:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1788987165.877113:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993718144:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987165.877376:0:109358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d48e00/0xc20d828fcf54ab1d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54ab16 expref: 18 pid: 5846 timeout: 3049 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987165.877388:0:109358:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094132ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109358:1875885993718016:0@lo:104: 00010000:00010000:0.0:1788987165.877403:0:109358:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987165.877411:0:109358:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987165.877418:0:109358:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987165.877425:0:109358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab24 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109358 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788987166.772900:0:109407:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff323e6710 20000000:00000080:0.0:1788987166.772917:0:109407:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0942780c00 uarg=0000000000000000 10000000:01000000:0.0:1788987166.773456:0:109407:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788987166.773477:0:109407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab2b lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987166.773493:0:109407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab2b lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987166.773502:0:109407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab2b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987166.773509:0:109407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab2b lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987166.773516:0:109407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab2b lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987166.773523:0:109407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab2b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987166.773530:0:109407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ee400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788987166.773534:0:109407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab2b lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987166.773541:0:109407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab2b lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987166.773553:0:109407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab2b lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987166.773561:0:109407:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab2b lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987166.773567:0:109407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee400/0xc20d828fcf54ab2b lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987166.791495:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788987167.681148:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788987167.681156:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788987167.681160:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788987167.681203:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.681214:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.681225:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987167.681252:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993718272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788987167.681320:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987167.681374:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0948b95c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788987167.681465:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993718272 00000100:00100000:0.0:1788987167.681473:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993718272 00000100:00100000:0.0:1788987167.681520:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1635 00000100:00100000:0.0:1788987167.681528:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993718272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987167.681540:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788987167.681552:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab39 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54ab32 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987167.681584:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab39 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54ab32 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987167.681596:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab39 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54ab32 expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987167.681606:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788987167.681665:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993718272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987167.681672:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1635 00000100:00100000:3.0:1788987167.681765:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe15180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993718272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987167.681779:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.681793:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54ab39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987167.681815:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788987167.681820:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.681829:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788987167.687433:0:109455:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff79705110 20000000:00000080:3.0:1788987167.687450:0:109455:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a794a8800 uarg=0000000000000000 10000000:01000000:3.0:1788987167.687635:0:109455:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788987167.687658:0:109455:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.687674:0:109455:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab39 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54ab32 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.687682:0:109455:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.687722:0:109455:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab39 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54ab32 expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.687736:0:109455:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab39 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54ab32 expref: 18 pid: 5849 timeout: 3051 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987167.687751:0:109455:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109455:1875885993718400:0@lo:104: 00000100:00100000:3.0:1788987167.687821:0:109455:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987167.688400:0:109455:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0948b95c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788987167.691202:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993718400 00000100:00100000:0.0:1788987167.691219:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993718400 00000100:00100000:0.0:1788987167.691285:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 429 00000100:00100000:0.0:1788987167.691296:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:109455:x1875885993718400:12345-0@lo:104: 00010000:00010000:0.0:1788987167.691313:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54ab39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987167.691416:0:109455:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe15180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109455:1875885993718400:0@lo:104: 00010000:00010000:3.0:1788987167.691443:0:109455:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987167.691624:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987167.691631:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:109455:x1875885993718400:12345-0@lo:104: Request processed in 337us (3810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987167.691639:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 429 00010000:00010000:3.0:1788987167.691720:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987167.691728:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54ab39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.691737:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987167.691741:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54ab39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.691749:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54ab39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987167.691755:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54ab39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987167.691761:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788987167.691805:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.691812:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788987167.691866:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993718528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788987167.691914:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788987167.692062:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987167.692063:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993718528 00000100:00100000:2.0:1788987167.692068:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993718528 00010000:00010000:3.0:1788987167.692070:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54ab32 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab39 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.692104:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987167.692107:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987167.692107:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab39 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54ab32 expref: 19 pid: 5849 timeout: 3051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.692108:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987167.692130:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:2.0:1788987167.692137:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45613850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993718528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987167.692147:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987167.692152:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab39 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54ab32 expref: 19 pid: 5849 timeout: 3051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987167.692163:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab39 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54ab32 expref: 19 pid: 5849 timeout: 3051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987167.692282:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab39 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54ab32 expref: 19 pid: 5849 timeout: 3051 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987167.692295:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987167.692303:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987167.692319:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987167.692325:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987167.692331:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987167.692339:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987167.692345:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987167.692349:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987167.692356:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987167.692374:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987167.692384:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788987167.692429:0:109455:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.692438:0:109455:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987167.692443:0:109455:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54ab40 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109455 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987167.692629:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45613850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993718528:12345-0@lo:103:ldlm_bl.0 Request processed in 492us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987167.692646:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1788987167.692733:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993718528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987167.811212:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788987168.535700:0:109503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffec6fea5d0 20000000:00000080:0.0:1788987168.535715:0:109503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a42c4ac00 uarg=0000000000000000 10000000:01000000:0.0:1788987168.535907:0:109503:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788987168.535928:0:109503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54ab47 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987168.536020:0:109503:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54ab47 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987168.536032:0:109503:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54ab47 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987168.536038:0:109503:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54ab47 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987168.536044:0:109503:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54ab47 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987168.536051:0:109503:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54ab47 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987168.536057:0:109503:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:0.0:1788987168.536061:0:109503:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54ab47 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987168.536069:0:109503:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54ab47 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987168.536083:0:109503:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54ab47 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987168.536160:0:109503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54ab47 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987168.536166:0:109503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508efc00/0xc20d828fcf54ab47 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987168.769182:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993718656:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987168.769253:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987168.769979:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993718656 00000100:00100000:1.0:1788987168.769989:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993718656 00000100:00100000:1.0:1788987168.770058:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:1.0:1788987168.770068:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993718656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788987168.770352:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987168.770427:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993718656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 360us (1174us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987168.770434:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00080000:1.0:1788987168.770844:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788987168.770930:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993718656:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788987168.832212:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987168.891046:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987168.891084:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987168.891170:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987168.891200:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987168.891203:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971488384 00000100:00100000:0.0:1788987168.891215:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971488384 00000100:00100000:3.0:1788987168.891229:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971488000 00000100:00100000:3.0:1788987168.891235:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971488000 00000100:00100000:3.0:1788987168.891287:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1636 00000100:00100000:0.0:1788987168.891292:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971488256 00000100:00100000:0.0:1788987168.891297:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971488256 00000100:00100000:3.0:1788987168.891300:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+10:2346:x1875885971488000:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987168.891328:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1605 00000100:00100000:0.0:1788987168.891338:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c602a535-9f45-4972-b672-7d262fcb8aee+5:2346:x1875885971488384:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788987168.891375:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456c9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+10:2346:x1875885971488000:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987168.891378:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c602a535-9f45-4972-b672-7d262fcb8aee+5:2346:x1875885971488384:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 40us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987168.891391:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1636 00000100:00100000:0.0:1788987168.891391:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1605 00000100:00100000:0.0:1788987168.891414:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1606 00000100:00100000:0.0:1788987168.891423:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c602a535-9f45-4972-b672-7d262fcb8aee+5:2346:x1875885971488256:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987168.891453:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c602a535-9f45-4972-b672-7d262fcb8aee+5:2346:x1875885971488256:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 32us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987168.891460:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1606 00000100:00080000:0.0:1788987168.891479:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788987168.891483:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788987168.891662:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971488128 00000100:00100000:1.0:1788987168.891667:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971488128 00000100:00080000:2.0:1788987168.891695:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987168.891711:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2106 00000100:00100000:1.0:1788987168.891719:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c602a535-9f45-4972-b672-7d262fcb8aee+5:2346:x1875885971488128:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788987168.891763:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c602a535-9f45-4972-b672-7d262fcb8aee+5:2346:x1875885971488128:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 43us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987168.891770:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2106 10000000:01000000:3.0:1788987169.413406:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788987169.413415:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788987169.413419:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788987169.413467:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987169.413482:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987169.413492:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987169.413532:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993718784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788987169.413600:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987169.413653:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0948b956c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788987169.413750:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993718784 00000100:00100000:0.0:1788987169.413761:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993718784 00000100:00100000:0.0:1788987169.413819:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1637 00000100:00100000:0.0:1788987169.413830:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993718784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987169.413843:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788987169.413855:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54ab55 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54ab4e expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987169.413889:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54ab55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54ab4e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987169.413900:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54ab55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54ab4e expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987169.413913:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef000, rc 0) 00000100:00100000:0.0:1788987169.414292:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993718784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 464us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987169.414299:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1637 00000100:00100000:3.0:1788987169.414382:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe14380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993718784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987169.414396:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987169.414405:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54ab55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987169.414422:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788987169.414427:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987169.414434:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987169.793315:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993719040:0@lo:400:kworker.0 00000100:00100000:0.0:1788987169.793391:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987169.793462:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788987169.793470:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993719168:0@lo:400:kworker.0 00000100:00100000:0.0:1788987169.793498:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987169.793534:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993719040 00000100:00100000:0.0:1788987169.793541:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993719040 00000100:00100000:0.0:1788987169.793592:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2107 00000100:00100000:0.0:1788987169.793604:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993719040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987169.793657:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941328000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993719040:12345-0@lo:400:kworker.0 Request processed in 56us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987169.793663:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2107 00000100:00100000:0.0:1788987169.793687:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993719168 00000100:00100000:0.0:1788987169.793691:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993719168 00000100:00100000:0.0:1788987169.793712:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1607 00000100:00100000:0.0:1788987169.793718:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094132a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993719168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987169.793749:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094132a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993719168:12345-0@lo:400:kworker.0 Request processed in 32us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987169.793754:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1607 00000100:00100000:0.0:1788987169.793791:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941329c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993719168:0@lo:400:kworker.0 00000100:00100000:0.0:1788987169.793801:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941329180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993719040:0@lo:400:kworker.0 00000100:00100000:2.0:1788987169.793935:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993719296:0@lo:400:kworker.0 00000100:00100000:2.0:1788987169.793966:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987169.793998:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788987169.794019:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993718912:0@lo:400:kworker.0 00000100:00100000:2.0:1788987169.794042:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987169.794061:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993719424:0@lo:400:kworker.0 00000100:00100000:2.0:1788987169.794081:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788987169.794129:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987169.794140:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993719296 00000100:00100000:2.0:1788987169.794143:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993719296 00000100:00100000:2.0:1788987169.794171:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993718912 00000100:00100000:2.0:1788987169.794174:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993718912 00000100:00100000:2.0:1788987169.794193:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2108 00000100:00100000:2.0:1788987169.794198:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993719296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987169.794235:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80905180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993719296:12345-0@lo:400:kworker.0 Request processed in 36us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987169.794241:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2108 00000100:00100000:2.0:1788987169.794254:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2109 00000100:00100000:2.0:1788987169.794260:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993718912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987169.794285:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993718912:12345-0@lo:400:kworker.0 Request processed in 26us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987169.794291:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2109 00000100:00100000:2.0:1788987169.794310:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993719424 00000100:00100000:2.0:1788987169.794314:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993719424 00000100:00100000:2.0:1788987169.794338:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1608 00000100:00100000:2.0:1788987169.794344:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993719424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987169.794373:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993719424:12345-0@lo:400:kworker.0 Request processed in 30us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987169.794379:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1608 00000100:00080000:2.0:1788987169.794394:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788987169.794397:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987169.794419:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094132ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993718912:0@lo:400:kworker.0 00000100:00100000:2.0:1788987169.794430:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941329f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993719424:0@lo:400:kworker.0 00000100:00100000:2.0:1788987169.794437:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941328a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993719296:0@lo:400:kworker.0 00010000:00010000:2.0:1788987169.863168:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987170.304582:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788987170.304626:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993719552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788987170.304699:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987170.305203:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993719552 00000100:00100000:1.0:1788987170.305213:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993719552 00000100:00100000:1.0:1788987170.305270:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1788987170.305279:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993719552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788987170.305312:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987170.305363:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe14380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993719552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987170.305370:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:3.0:1788987170.305503:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993719552:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788987170.896693:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788987171.807663:0:109652:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffc114235e0 20000000:00000080:2.0:1788987171.807679:0:109652:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80874800 uarg=0000000000000000 10000000:01000000:2.0:1788987171.812353:0:109652:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987171.812380:0:109652:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987171.812399:0:109652:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54ab55 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54ab4e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987171.812408:0:109652:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987171.812449:0:109652:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54ab55 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54ab4e expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987171.812466:0:109652:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54ab55 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54ab4e expref: 18 pid: 5846 timeout: 3055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987171.812481:0:109652:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109652:1875885993719680:0@lo:104: 00000100:00100000:2.0:1788987171.812551:0:109652:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987171.812607:0:109652:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a45664e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788987171.815168:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993719680 00000100:00100000:0.0:1788987171.815182:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993719680 00000100:00100000:0.0:1788987171.815253:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 430 00000100:00100000:0.0:1788987171.815263:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:109652:x1875885993719680:12345-0@lo:104: 00010000:00010000:0.0:1788987171.815280:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54ab55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987171.815376:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987171.815382:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:109652:x1875885993719680:12345-0@lo:104: Request processed in 121us (2832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987171.815388:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 430 00010000:00010000:3.0:1788987171.819892:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987171.819908:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54ab55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.819921:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987171.819925:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54ab55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.819935:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54ab55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987171.819941:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54ab55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987171.819956:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788987171.820028:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820034:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987171.820058:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820064:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab4e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab55 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820102:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987171.820104:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987171.820106:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987171.820122:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993719808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788987171.820180:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987171.820234:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993719808 00000100:00100000:3.0:1788987171.820242:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993719808 00010000:00010000:3.0:1788987171.820278:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54ab55 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54ab4e expref: 19 pid: 5846 timeout: 3055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987171.820305:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1788987171.820314:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993719808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987171.820325:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788987171.820330:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54ab55 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54ab4e expref: 19 pid: 5846 timeout: 3055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820340:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54ab55 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54ab4e expref: 19 pid: 5846 timeout: 3055 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820356:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820365:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820379:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820386:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820392:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820398:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820406:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0a00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987171.820410:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820416:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820424:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987171.820443:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788987171.820484:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79797480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993719808:12345-0@lo:103:ldlm_bl.0 Request processed in 172us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987171.820491:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1788987171.820528:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993719808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987171.820944:0:109652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef000/0xc20d828fcf54ab55 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54ab4e expref: 18 pid: 5846 timeout: 3055 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987171.820966:0:109652:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109652:1875885993719680:0@lo:104: 00010000:00010000:2.0:1788987171.820982:0:109652:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987171.821000:0:109652:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987171.821007:0:109652:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987171.821018:0:109652:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0a00/0xc20d828fcf54ab5c lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109652 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987171.907911:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987172.929225:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788987172.940941:0:109701:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffeae174f0 20000000:00000080:3.0:1788987172.940960:0:109701:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7673e000 uarg=0000000000000000 10000000:01000000:3.0:1788987172.941304:0:109701:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788987172.941324:0:109701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54ab63 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987172.941407:0:109701:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54ab63 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987172.941417:0:109701:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54ab63 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987172.941424:0:109701:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54ab63 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987172.941431:0:109701:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54ab63 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987172.941439:0:109701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54ab63 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987172.941445:0:109701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987172.941449:0:109701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54ab63 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987172.941456:0:109701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54ab63 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987172.941469:0:109701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54ab63 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987172.941476:0:109701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54ab63 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987172.941482:0:109701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a3c00/0xc20d828fcf54ab63 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987173.510533:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788987173.510541:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788987173.510547:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788987173.511946:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987173.511962:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987173.511990:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987173.512018:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79796300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993719936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788987173.512136:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987173.512184:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0948b95f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788987173.512339:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993719936 00000100:00100000:2.0:1788987173.512348:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993719936 00000100:00100000:2.0:1788987173.512402:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1638 00000100:00100000:2.0:1788987173.512411:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993719936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987173.512425:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788987173.512440:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf54ab71 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54ab6a expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987173.512478:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf54ab71 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54ab6a expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987173.512489:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf54ab71 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54ab6a expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987173.512498:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0600, rc 0) 00000100:00100000:2.0:1788987173.512550:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993719936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987173.512558:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1638 00000100:00100000:2.0:1788987173.512622:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79796300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993719936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987173.512637:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987173.512647:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54ab71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987173.512676:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788987173.512682:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987173.512691:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987173.890664:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993720064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788987173.890753:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987173.890859:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993720064 00000100:00100000:2.0:1788987173.890870:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993720064 00000100:00100000:2.0:1788987173.890939:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1788987173.890967:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a8099a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993720064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788987173.891019:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44105728 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987173.891077:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a8099a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993720064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987173.891085:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00080000:2.0:1788987173.891138:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788987173.891182:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0942bb0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993720064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788987173.954610:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987174.012377:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987174.012411:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987174.012443:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971488768 00000100:00100000:3.0:1788987174.012451:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971488768 00000100:00100000:3.0:1788987174.012521:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971488896 00000100:00100000:3.0:1788987174.012525:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971488896 00000100:00100000:3.0:1788987174.012552:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 696 00000100:00100000:3.0:1788987174.012588:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c602a535-9f45-4972-b672-7d262fcb8aee+5:2345:x1875885971488768:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788987174.012616:0:8478:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54aafa 00000100:00080000:3.0:1788987174.012626:0:8478:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f377800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788987174.012657:0:8478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967375 00000100:00100000:3.0:1788987174.012921:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c602a535-9f45-4972-b672-7d262fcb8aee+2:2345:x1875885971488768:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 359us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987174.012929:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 696 00000100:00100000:3.0:1788987174.012948:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 697 00000100:00100000:3.0:1788987174.012957:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c602a535-9f45-4972-b672-7d262fcb8aee+5:2345:x1875885971488896:12345-192.168.206.21@tcp:9:kworker.0 00000020:00000080:3.0:1788987174.012970:0:8478:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0xc20d828fcf54ab01 00000100:00080000:3.0:1788987174.012988:0:8478:0:(import.c:65:import_set_state_nolock()) ffff9b0a7f374800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788987174.013010:0:8478:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967375 00000100:00080000:2.0:1788987174.015342:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788987174.015342:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788987174.015350:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788987174.015480:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987174.016951:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c602a535-9f45-4972-b672-7d262fcb8aee+2:2345:x1875885971488896:12345-192.168.206.21@tcp:9:kworker.0 Request processed in 3982us (4525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987174.016968:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 697 00000100:00100000:2.0:1788987174.017119:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987174.017329:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987174.017357:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971488512 00000100:00100000:2.0:1788987174.017365:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971488512 00000100:00100000:3.0:1788987174.017376:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971488640 00000100:00100000:3.0:1788987174.017383:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971488640 00000100:00100000:2.0:1788987174.017407:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1639 00000100:00100000:2.0:1788987174.017418:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:2346:x1875885971488512:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788987174.017435:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2110 00000100:00100000:3.0:1788987174.017448:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c602a535-9f45-4972-b672-7d262fcb8aee+5:2346:x1875885971488640:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987174.017462:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456ca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:2346:x1875885971488512:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 46us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987174.017469:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1639 00000100:00100000:3.0:1788987174.017486:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c602a535-9f45-4972-b672-7d262fcb8aee+5:2346:x1875885971488640:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 42us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987174.017494:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2110 00000100:00080000:2.0:1788987174.017505:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987174.918924:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993720576:0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919022:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987174.919113:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788987174.919121:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993720192:0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919151:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987174.919175:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993720704:0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919198:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987174.919224:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993720320:0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919245:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987174.919265:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993720832:0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919283:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987174.919302:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788987174.919308:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993720448:0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919328:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987174.919360:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993720576 00000100:00100000:2.0:1788987174.919367:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993720576 00000100:00100000:2.0:1788987174.919407:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993720832 00000100:00100000:2.0:1788987174.919410:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993720832 00000100:00100000:2.0:1788987174.919436:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1609 00000100:00100000:2.0:1788987174.919444:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993720576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919494:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80714380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993720576:12345-0@lo:400:kworker.0 Request processed in 50us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987174.919501:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1609 00000100:00100000:2.0:1788987174.919519:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1610 00000100:00100000:2.0:1788987174.919525:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993720832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919556:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80716680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993720832:12345-0@lo:400:kworker.0 Request processed in 32us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987174.919563:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1610 00000100:00100000:2.0:1788987174.919581:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993720192 00000100:00100000:2.0:1788987174.919584:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993720192 00000100:00100000:2.0:1788987174.919606:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1640 00000100:00100000:2.0:1788987174.919612:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993720192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919641:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a456cb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993720192:12345-0@lo:400:kworker.0 Request processed in 30us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987174.919647:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1640 00000100:00100000:2.0:1788987174.919671:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993720704 00000100:00100000:2.0:1788987174.919675:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993720704 00000100:00100000:2.0:1788987174.919716:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993720320 00000100:00100000:2.0:1788987174.919719:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993720320 00000100:00100000:2.0:1788987174.919734:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993720448 00000100:00100000:2.0:1788987174.919737:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993720448 00000100:00100000:2.0:1788987174.919752:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2111 00000100:00100000:2.0:1788987174.919758:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993720704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919789:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80717800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993720704:12345-0@lo:400:kworker.0 Request processed in 31us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987174.919795:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2111 00000100:00100000:2.0:1788987174.919806:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2112 00000100:00100000:2.0:1788987174.919812:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993720320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919836:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80715c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993720320:12345-0@lo:400:kworker.0 Request processed in 24us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987174.919841:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2112 00000100:00100000:2.0:1788987174.919852:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2113 00000100:00100000:2.0:1788987174.919857:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993720448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919883:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1875885993720448:12345-0@lo:400:kworker.0 Request processed in 26us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987174.919889:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2113 00000100:00080000:2.0:1788987174.919914:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788987174.919918:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788987174.919962:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3320:1875885993720448:0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919986:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993720320:0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.919998:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993720832:0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.920032:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993720192:0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.920047:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993720704:0@lo:400:kworker.0 00000100:00100000:2.0:1788987174.920056:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe41f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993720576:0@lo:400:kworker.0 00010000:00010000:2.0:1788987174.978881:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987175.425407:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993720960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788987175.425497:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987175.425658:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993720960 00000100:00100000:1.0:1788987175.425666:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993720960 00000100:00100000:1.0:1788987175.425717:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1788987175.425725:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993720960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788987175.425757:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987175.425807:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79794a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993720960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987175.425814:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1788987175.425857:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993720960:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788987176.000313:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987177.024335:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788987177.135664:0:109897:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffda0ee17a0 20000000:00000080:0.0:1788987177.135681:0:109897:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a5572cc00 uarg=0000000000000000 00010000:00010000:0.0:1788987177.136216:0:109897:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a7f9e9800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788987177.136318:0:109897:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a7f9e9800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788987177.136332:0:109897:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788987177.136351:0:109897:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987177.136367:0:109897:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf54ab71 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54ab6a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987177.136375:0:109897:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987177.136415:0:109897:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf54ab71 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54ab6a expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987177.136660:0:109897:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf54ab71 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54ab6a expref: 18 pid: 5849 timeout: 3061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987177.136676:0:109897:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941329180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109897:1875885993721088:0@lo:104: 00000100:00100000:0.0:1788987177.136741:0:109897:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987177.136858:0:109897:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09413573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788987177.136910:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993721088 00000100:00100000:2.0:1788987177.136917:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993721088 00000100:00100000:2.0:1788987177.136974:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 431 00000100:00100000:2.0:1788987177.136983:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941329c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:109897:x1875885993721088:12345-0@lo:104: 00010000:00010000:2.0:1788987177.136995:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54ab71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987177.137073:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788987177.137079:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941329c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:109897:x1875885993721088:12345-0@lo:104: Request processed in 98us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987177.137084:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 431 00000100:00100000:1.0:1788987177.137487:0:109897:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941329180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:109897:1875885993721088:0@lo:104: 00010000:00010000:1.0:1788987177.137509:0:109897:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.137527:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788987177.137535:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54ab71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.137543:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:3.0:1788987177.137547:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54ab71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.137554:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54ab71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788987177.137560:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54ab71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987177.137566:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:3.0:1788987177.137601:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.137611:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788987177.137644:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.137650:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab6a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab71 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.137667:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987177.137669:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788987177.137670:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987177.137737:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993721216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788987177.137773:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987177.137861:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993721216 00000100:00100000:3.0:1788987177.137866:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993721216 00010000:00010000:3.0:1788987177.137896:0:5840:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf54ab71 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54ab6a expref: 19 pid: 5849 timeout: 3061 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987177.137926:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1788987177.137936:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993721216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987177.137946:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788987177.137951:0:5840:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf54ab71 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54ab6a expref: 19 pid: 5849 timeout: 3061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.137969:0:5840:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf54ab71 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54ab6a expref: 19 pid: 5849 timeout: 3061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.137982:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0600/0xc20d828fcf54ab71 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54ab6a expref: 19 pid: 5849 timeout: 3061 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.137994:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.138006:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.138020:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.138027:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.138034:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.138039:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.138044:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef400 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987177.138048:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.138056:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.138075:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987177.138878:0:109897:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987177.138891:0:109897:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987177.138897:0:109897:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54ab78 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 109897 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987177.144744:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788987177.144849:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941328380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993721216:12345-0@lo:103:ldlm_bl.0 Request processed in 6911us (7072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987177.144861:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:3.0:1788987177.144920:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79796300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993721216:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788987178.051685:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788987178.562526:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788987178.562532:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788987178.562537:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788987178.562579:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987178.562601:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987178.562612:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987178.562637:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a79796300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993721344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788987178.562702:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987178.562754:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a51df2e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788987178.562935:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993721344 00000100:00100000:2.0:1788987178.562942:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993721344 00000100:00100000:2.0:1788987178.563004:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1641 00000100:00100000:2.0:1788987178.563013:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993721344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987178.563025:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788987178.563038:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab86 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54ab7f expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987178.563060:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab86 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54ab7f expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987178.563071:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab86 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54ab7f expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987178.563079:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f0800, rc 0) 00000100:00100000:2.0:1788987178.563165:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993721344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 152us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987178.563172:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1641 00000100:00100000:0.0:1788987178.563272:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a79796300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993721344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987178.563286:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987178.563295:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54ab86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987178.563319:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788987178.563323:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987178.563330:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54ab86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987179.010457:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788987179.010483:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993721472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788987179.010549:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987179.010783:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993721472 00000100:00100000:3.0:1788987179.010792:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993721472 00000100:00100000:3.0:1788987179.010845:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:3.0:1788987179.010863:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993721472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987179.010898:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987179.010946:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a79796300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993721472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987179.010965:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00080000:3.0:1788987179.010987:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788987179.011022:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993721472:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788987179.072477:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788987179.078488:0:6721:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c602a535-9f45-4972-b672-7d262fcb8aee 00000020:00000080:3.0:1788987179.078498:0:6721:0:(genops.c:885:class_export_put()) final put ffff9b0a7f371000/c602a535-9f45-4972-b672-7d262fcb8aee 00000020:00000080:0.0:1788987179.078775:0:489:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a7f371000/c602a535-9f45-4972-b672-7d262fcb8aee for lustre-OST0000 00000020:00000080:0.0:1788987179.078825:0:489:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a7f377800 for lustre-OST0000 00000001:00100000:1.0:1788987179.081381:0:7656:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c602a535-9f45-4972-b672-7d262fcb8aee 00000020:00000080:1.0:1788987179.081389:0:7656:0:(genops.c:885:class_export_put()) final put ffff9b0a7f370800/c602a535-9f45-4972-b672-7d262fcb8aee 00000020:00000080:3.0:1788987179.081555:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9b0a7f370800/c602a535-9f45-4972-b672-7d262fcb8aee for lustre-OST0001 00000020:00000080:3.0:1788987179.081608:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9b0a7f374800 for lustre-OST0001 00000100:00100000:1.0:1788987179.126377:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987179.126506:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971489024 00000100:00100000:2.0:1788987179.126517:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971489024 00000100:00100000:2.0:1788987179.126574:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1642 00000100:00100000:2.0:1788987179.126584:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:2348:x1875885971489024:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987179.126660:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:2348:x1875885971489024:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 77us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987179.126668:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1642 00000100:00100000:3.0:1788987179.131373:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987179.131521:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971489152 00000100:00100000:2.0:1788987179.131531:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971489152 00000100:00100000:2.0:1788987179.131611:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2114 00000100:00100000:2.0:1788987179.131621:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c602a535-9f45-4972-b672-7d262fcb8aee+5:2349:x1875885971489152:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987179.131699:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c602a535-9f45-4972-b672-7d262fcb8aee+5:2349:x1875885971489152:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 80us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987179.131706:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2114 00000100:00080000:3.0:1788987179.131771:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987180.032346:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993721984:0@lo:400:kworker.0 00000100:00100000:1.0:1788987180.032432:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987180.032492:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987180.032499:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993721856:0@lo:400:kworker.0 00000100:00100000:1.0:1788987180.032524:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987180.032670:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993721600:0@lo:400:kworker.0 00000100:00100000:0.0:1788987180.032708:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987180.032744:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993722112:0@lo:400:kworker.0 00000100:00100000:0.0:1788987180.032768:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987180.032785:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788987180.032790:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993721728:0@lo:400:kworker.0 00000100:00100000:0.0:1788987180.032819:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987180.032835:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993722240:0@lo:400:kworker.0 00000100:00100000:0.0:1788987180.032855:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987180.032960:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993721856 00000100:00100000:2.0:1788987180.032968:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993721856 00000100:00100000:2.0:1788987180.033032:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993722112 00000100:00100000:2.0:1788987180.033035:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993722112 00000100:00100000:2.0:1788987180.033067:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993721728 00000100:00100000:2.0:1788987180.033070:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993721728 00000100:00100000:2.0:1788987180.033086:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2115 00000100:00100000:2.0:1788987180.033115:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993721856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987180.033173:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993721856:12345-0@lo:400:kworker.0 Request processed in 60us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987180.033180:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2115 00000100:00100000:2.0:1788987180.033196:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1788987180.033203:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993722112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987180.033238:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941329180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993722112:12345-0@lo:400:kworker.0 Request processed in 36us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987180.033244:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2116 00000100:00100000:2.0:1788987180.033255:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2117 00000100:00100000:2.0:1788987180.033261:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993721728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987180.033290:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941328a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993721728:12345-0@lo:400:kworker.0 Request processed in 29us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987180.033296:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2117 00000100:00100000:2.0:1788987180.033320:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993721984 00000100:00100000:2.0:1788987180.033324:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993721984 00000100:00100000:2.0:1788987180.033348:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993722240 00000100:00100000:2.0:1788987180.033351:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993722240 00000100:00100000:2.0:1788987180.033370:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1611 00000100:00100000:2.0:1788987180.033376:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993721984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987180.033409:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993721984:12345-0@lo:400:kworker.0 Request processed in 33us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987180.033429:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1611 00000100:00100000:2.0:1788987180.033441:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1612 00000100:00100000:2.0:1788987180.033448:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993722240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987180.033483:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941329f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993722240:12345-0@lo:400:kworker.0 Request processed in 36us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987180.033489:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1612 00000100:00080000:2.0:1788987180.033504:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788987180.033508:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987180.033545:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993721856:0@lo:400:kworker.0 00000100:00100000:2.0:1788987180.033557:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993721984:0@lo:400:kworker.0 00000100:00100000:2.0:1788987180.033585:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993721728:0@lo:400:kworker.0 00000100:00100000:2.0:1788987180.033593:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993722240:0@lo:400:kworker.0 00000100:00100000:2.0:1788987180.033602:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993722112:0@lo:400:kworker.0 00000100:00100000:1.0:1788987180.033934:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993721600 00000100:00100000:1.0:1788987180.033939:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993721600 00000100:00100000:1.0:1788987180.033983:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1643 00000100:00100000:1.0:1788987180.034002:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993721600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987180.034048:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993721600:12345-0@lo:400:kworker.0 Request processed in 59us (1340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987180.034054:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1643 00000100:00100000:0.0:1788987180.034179:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993721600:0@lo:400:kworker.0 00010000:00010000:1.0:1788987180.097372:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788987180.545232:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993722368:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788987180.545307:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987180.545419:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993722368 00000100:00100000:2.0:1788987180.545426:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993722368 00000100:00100000:2.0:1788987180.545474:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1788987180.545484:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993722368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788987180.545517:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987180.545568:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993722368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987180.545575:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1788987180.545657:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993722368:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788987181.120223:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788987181.222367:0:110094:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe5f9a82d0 20000000:00000080:1.0:1788987181.222387:0:110094:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80854c00 uarg=0000000000000000 00010000:00010000:1.0:1788987181.222948:0:110094:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a7f9e9800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788987181.222965:0:110094:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a7f9e9800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788987181.222979:0:110094:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788987181.222996:0:110094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987181.223012:0:110094:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab86 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54ab7f expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987181.223020:0:110094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987181.223059:0:110094:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab86 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54ab7f expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987181.223080:0:110094:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab86 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54ab7f expref: 18 pid: 5849 timeout: 3065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987181.223167:0:110094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110094:1875885993722496:0@lo:104: 00000100:00100000:1.0:1788987181.223230:0:110094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987181.223334:0:110094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a43fb2e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788987181.225242:0:7642:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993722496 00000100:00100000:3.0:1788987181.225255:0:7642:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993722496 00000100:00100000:3.0:1788987181.225336:0:7642:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 432 00000100:00100000:3.0:1788987181.225347:0:7642:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:110094:x1875885993722496:12345-0@lo:104: 00010000:00010000:3.0:1788987181.225365:0:7642:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54ab86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226216:0:7642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1788987181.226223:0:5843:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788987181.226226:0:7642:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:2b823764-e7a6-4601-a766-b07f91a03a4c+3:110094:x1875885993722496:12345-0@lo:104: Request processed in 881us (2995us total) trans 0 rc 0/0 00010000:00010000:2.0:1788987181.226230:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54ab86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987181.226235:0:7642:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 432 00010000:00010000:2.0:1788987181.226238:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a3c00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788987181.226242:0:5843:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54ab86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987181.226251:0:5843:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54ab86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788987181.226257:0:5843:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54ab86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987181.226263:0:5843:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788987181.226306:0:5843:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987181.226313:0:5843:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788987181.226327:0:110094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80c18a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110094:1875885993722496:0@lo:104: 00010000:00010000:2.0:1788987181.226345:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987181.226351:0:110094:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987181.226357:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a3c00/0xc20d828fcf54ab7f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54ab86 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987181.226378:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987181.226380:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987181.226382:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987181.226389:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987181.226401:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993722624:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788987181.226439:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987181.226536:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993722624 00000100:00100000:3.0:1788987181.226542:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993722624 00010000:00010000:3.0:1788987181.226573:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab86 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54ab7f expref: 19 pid: 5849 timeout: 3065 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987181.226605:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1788987181.226615:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993722624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788987181.226626:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788987181.226631:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab86 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54ab7f expref: 19 pid: 5849 timeout: 3065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226641:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab86 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54ab7f expref: 19 pid: 5849 timeout: 3065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226654:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f0800/0xc20d828fcf54ab86 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54ab7f expref: 19 pid: 5849 timeout: 3065 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226666:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226675:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226689:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226696:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226702:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226709:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226714:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d49200 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:3.0:1788987181.226718:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226726:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226745:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987181.226755:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788987181.226790:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3318:x1875885993722624:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987181.226797:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:2.0:1788987181.226823:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993722624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788987181.226841:0:110094:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987181.226849:0:110094:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987181.226855:0:110094:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d49200/0xc20d828fcf54ab8d lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1788987182.106275:0:110143:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fffcbab4820 20000000:00000080:2.0:1788987182.106292:0:110143:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a45766400 uarg=0000000000000000 10000000:01000000:2.0:1788987182.106684:0:110143:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:2.0:1788987182.106704:0:110143:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54ab94 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987182.106718:0:110143:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54ab94 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987182.106729:0:110143:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54ab94 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987182.106736:0:110143:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54ab94 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987182.106743:0:110143:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54ab94 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987182.106750:0:110143:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54ab94 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987182.106757:0:110143:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987182.106761:0:110143:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54ab94 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987182.106768:0:110143:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54ab94 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987182.106780:0:110143:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54ab94 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987182.106788:0:110143:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54ab94 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987182.106795:0:110143:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a581f1600/0xc20d828fcf54ab94 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987182.146380:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788987182.400278:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:0.0:1788987182.400284:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:0.0:1788987182.400289:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788987182.400333:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987182.400345:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987182.400355:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987182.400381:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094132ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993722752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788987182.400457:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987182.400501:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a58161840 going to sleep for 11 seconds 00000100:00100000:3.0:1788987182.400617:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993722752 00000100:00100000:3.0:1788987182.400624:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993722752 00000100:00100000:3.0:1788987182.400673:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1644 00000100:00100000:3.0:1788987182.400681:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993722752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987182.400694:0:5849:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788987182.400706:0:5849:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54aba2 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54ab9b expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987182.400727:0:5849:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54aba2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54ab9b expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987182.400737:0:5849:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54aba2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54ab9b expref: 19 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987182.400745:0:5849:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2600, rc 0) 00000100:00100000:3.0:1788987182.400791:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993722752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987182.400801:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1644 00000100:00100000:0.0:1788987182.400900:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094132ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993722752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987182.400914:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aba2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987182.400923:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54aba2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788987182.400952:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788987182.400958:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aba2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987182.400965:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54aba2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987183.170321:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987184.129941:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993722880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788987184.130014:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987184.130122:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993722880 00000100:00100000:0.0:1788987184.130129:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993722880 00000100:00100000:0.0:1788987184.130195:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1788987184.130206:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094132ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993722880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788987184.130239:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987184.130288:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094132ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993722880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987184.130296:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00080000:0.0:1788987184.130319:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788987184.130568:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a761c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993722880:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788987184.193270:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987184.243336:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987184.243419:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987184.244371:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971489280 00000100:00100000:3.0:1788987184.244382:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971489280 00000100:00100000:3.0:1788987184.244434:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1645 00000100:00100000:3.0:1788987184.244444:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:2348:x1875885971489280:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:2.0:1788987184.244486:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971489408 00000100:00100000:2.0:1788987184.244492:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971489408 00000100:00100000:3.0:1788987184.244510:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:2348:x1875885971489280:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 66us (1181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987184.244518:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1645 00000100:00100000:2.0:1788987184.244542:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2118 00000100:00100000:2.0:1788987184.244553:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c602a535-9f45-4972-b672-7d262fcb8aee+5:2348:x1875885971489408:12345-192.168.206.21@tcp:400:kworker.0 00000100:00080000:3.0:1788987184.245328:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987184.245498:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c602a535-9f45-4972-b672-7d262fcb8aee+5:2348:x1875885971489408:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 946us (2077us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987184.245506:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2118 00000100:00100000:2.0:1788987185.163892:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993723136:0@lo:400:kworker.0 00000100:00100000:2.0:1788987185.163970:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987185.164024:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a80d39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993723648:0@lo:400:kworker.0 00000100:00100000:2.0:1788987185.164049:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987185.164134:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987185.164141:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993723264:0@lo:400:kworker.0 00000100:00100000:2.0:1788987185.164165:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987185.164203:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993723136 00000100:00100000:2.0:1788987185.164210:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993723136 00000100:00100000:2.0:1788987185.164266:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993723264 00000100:00100000:2.0:1788987185.164269:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993723264 00000100:00100000:2.0:1788987185.164299:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1788987185.164308:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993723136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987185.164358:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993723136:12345-0@lo:400:kworker.0 Request processed in 51us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987185.164365:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2119 00000100:00100000:2.0:1788987185.164384:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2120 00000100:00100000:2.0:1788987185.164390:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993723264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987185.164418:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993723264:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987185.164423:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2120 00000100:00100000:2.0:1788987185.164443:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993723648 00000100:00100000:2.0:1788987185.164447:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993723648 00000100:00100000:2.0:1788987185.164472:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1613 00000100:00100000:2.0:1788987185.164479:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993723648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987185.164506:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993723648:12345-0@lo:400:kworker.0 Request processed in 29us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987185.164512:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1613 00000100:00100000:2.0:1788987185.164557:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993723264:0@lo:400:kworker.0 00000100:00100000:2.0:1788987185.164567:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993723136:0@lo:400:kworker.0 00000100:00100000:2.0:1788987185.164578:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a80d39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993723648:0@lo:400:kworker.0 00000100:00100000:3.0:1788987185.164853:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993723008:0@lo:400:kworker.0 00000100:00100000:3.0:1788987185.164892:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987185.164946:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993723520:0@lo:400:kworker.0 00000100:00100000:3.0:1788987185.164971:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987185.164992:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788987185.164998:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993723392:0@lo:400:kworker.0 00000100:00100000:3.0:1788987185.165024:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788987185.166009:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788987185.166016:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987185.166040:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993723008 00000100:00100000:3.0:1788987185.166058:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993723008 00000100:00100000:3.0:1788987185.166124:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1646 00000100:00100000:3.0:1788987185.166133:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993723008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987185.166193:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993723008:12345-0@lo:400:kworker.0 Request processed in 61us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987185.166200:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1646 00000100:00100000:3.0:1788987185.166235:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993723520 00000100:00100000:3.0:1788987185.166240:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993723520 00000100:00100000:3.0:1788987185.166280:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2121 00000100:00100000:3.0:1788987185.166287:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a761c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993723520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987185.166318:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a761c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993723520:12345-0@lo:400:kworker.0 Request processed in 33us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987185.166324:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2121 00000100:00100000:3.0:1788987185.166340:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993723392 00000100:00100000:3.0:1788987185.166344:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993723392 00000100:00100000:3.0:1788987185.166366:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1614 00000100:00100000:3.0:1788987185.166372:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993723392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987185.166401:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993723392:12345-0@lo:400:kworker.0 Request processed in 29us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987185.166406:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1614 00000100:00100000:3.0:1788987185.166439:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993723392:0@lo:400:kworker.0 00000100:00100000:3.0:1788987185.166454:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09413adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993723008:0@lo:400:kworker.0 00000100:00100000:3.0:1788987185.166462:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993723520:0@lo:400:kworker.0 00000100:00080000:3.0:1788987185.166484:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788987185.217171:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987185.666050:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987185.666071:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993723776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788987185.666152:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987185.666217:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993723776 00000100:00100000:2.0:1788987185.666224:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993723776 00000100:00100000:2.0:1788987185.666269:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:2.0:1788987185.666279:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993723776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788987185.666311:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987185.666357:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993723776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987185.666364:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:2.0:1788987185.666412:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993723776:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788987186.241264:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987187.264473:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987188.288251:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987189.250290:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993723904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788987189.250361:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987189.250926:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993723904 00000100:00100000:0.0:1788987189.250934:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993723904 00000100:00100000:0.0:1788987189.250987:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1788987189.250995:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993723904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788987189.251025:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987189.251073:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993723904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987189.251080:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1788987189.251148:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe40a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993723904:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788987189.252026:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788987189.318356:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987189.361565:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987189.361612:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987189.364140:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971489536 00000100:00100000:0.0:1788987189.364154:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971489536 00000100:00100000:0.0:1788987189.364216:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1647 00000100:00100000:0.0:1788987189.364226:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da528634-9595-47cd-9385-2665acd18d8b+10:2348:x1875885971489536:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987189.364300:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da528634-9595-47cd-9385-2665acd18d8b+10:2348:x1875885971489536:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 75us (2744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987189.364308:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1647 00000100:00100000:3.0:1788987189.365120:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971489664 00000100:00100000:3.0:1788987189.365127:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971489664 00000100:00100000:3.0:1788987189.365190:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2122 00000100:00100000:3.0:1788987189.365209:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c602a535-9f45-4972-b672-7d262fcb8aee+5:2348:x1875885971489664:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788987189.365255:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c602a535-9f45-4972-b672-7d262fcb8aee+5:2348:x1875885971489664:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 58us (3642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987189.365261:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2122 00000100:00080000:3.0:1788987189.365282:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987190.273240:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993724288:0@lo:400:kworker.0 00000100:00100000:1.0:1788987190.273240:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993724416:0@lo:400:kworker.0 00000100:00100000:2.0:1788987190.273354:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993724160:0@lo:400:kworker.0 00000100:00100000:0.0:1788987190.273381:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993724032:0@lo:400:kworker.0 00000100:00100000:3.0:1788987190.275663:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987190.275789:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987190.275846:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993724288 00000100:00100000:1.0:1788987190.275855:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993724288 00000100:00100000:1.0:1788987190.275994:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2123 00000100:00100000:1.0:1788987190.276004:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0943704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993724288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987190.276065:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0943704700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993724288:12345-0@lo:400:kworker.0 Request processed in 62us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987190.276075:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2123 00000100:00080000:1.0:1788987190.276196:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987190.276209:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993724416 00000100:00100000:1.0:1788987190.276212:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993724416 00000100:00100000:1.0:1788987190.276237:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1615 00000100:00100000:1.0:1788987190.276244:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993724416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987190.276282:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c18a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993724416:12345-0@lo:400:kworker.0 Request processed in 39us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987190.276288:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1615 00000100:00100000:1.0:1788987190.276324:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993724416:0@lo:400:kworker.0 00000100:00100000:1.0:1788987190.276369:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb31880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993724288:0@lo:400:kworker.0 00000100:00100000:2.0:1788987190.285695:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987190.285695:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987190.285762:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993724672:0@lo:400:kworker.0 00000100:00100000:2.0:1788987190.285798:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987190.285798:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993724544:0@lo:400:kworker.0 00000100:00100000:0.0:1788987190.285820:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987190.285825:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993724672 00000100:00100000:2.0:1788987190.285831:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993724672 00000100:00100000:0.0:1788987190.285852:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993724032 00000100:00100000:0.0:1788987190.285855:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993724032 00000100:00100000:2.0:1788987190.285878:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1616 00000100:00100000:0.0:1788987190.285878:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1648 00000100:00100000:2.0:1788987190.285886:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993724672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987190.285886:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993724032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987190.285949:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993724672:12345-0@lo:400:kworker.0 Request processed in 63us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987190.285956:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1616 00000100:00100000:0.0:1788987190.286019:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993724032:12345-0@lo:400:kworker.0 Request processed in 133us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987190.286025:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1648 00000100:00100000:0.0:1788987190.286054:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993724160 00000100:00100000:0.0:1788987190.286057:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993724160 00000100:00100000:0.0:1788987190.286079:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993724544 00000100:00100000:0.0:1788987190.286081:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993724544 00000100:00100000:0.0:1788987190.286204:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2124 00000100:00100000:0.0:1788987190.286285:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993724160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987190.286319:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09413adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993724160:12345-0@lo:400:kworker.0 Request processed in 109us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987190.286326:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2124 00000100:00100000:0.0:1788987190.286339:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2125 00000100:00100000:0.0:1788987190.286345:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993724544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788987190.286373:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993724544:12345-0@lo:400:kworker.0 Request processed in 29us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987190.286379:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2125 00000100:00100000:0.0:1788987190.286416:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993724032:0@lo:400:kworker.0 00000100:00100000:0.0:1788987190.286427:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993724544:0@lo:400:kworker.0 00000100:00100000:3.0:1788987190.287482:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993724672:0@lo:400:kworker.0 00000100:00100000:3.0:1788987190.287511:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993724160:0@lo:400:kworker.0 00000100:00080000:2.0:1788987190.292990:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788987190.292999:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788987190.337235:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987190.784277:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993724800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788987190.784349:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987190.784447:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993724800 00000100:00100000:0.0:1788987190.784454:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993724800 00000100:00100000:0.0:1788987190.784518:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1788987190.784528:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993724800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987190.784559:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987190.786434:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993724800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1897us (2074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987190.786446:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:1.0:1788987190.786528:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a511c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993724800:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788987191.360311:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987192.386204:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788987193.408921:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987194.368811:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993724928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788987194.368908:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987194.369159:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993724928 00000100:00100000:3.0:1788987194.369171:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993724928 00000100:00100000:3.0:1788987194.369239:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:3.0:1788987194.369269:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993724928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788987194.369311:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788987194.369373:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb32300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993724928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987194.369380:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00080000:3.0:1788987194.369404:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788987194.369445:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993724928:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788987194.437151:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987194.485349:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987194.485497:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987194.485510:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971489920 00000100:00100000:1.0:1788987194.485523:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971489920 00000100:00080000:2.0:1788987194.485629:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987194.485652:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2126 00000100:00100000:1.0:1788987194.485668:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c602a535-9f45-4972-b672-7d262fcb8aee+5:2349:x1875885971489920:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788987194.485770:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a511c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c602a535-9f45-4972-b672-7d262fcb8aee+5:2349:x1875885971489920:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 107us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987194.485783:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2126 00000100:00100000:0.0:1788987194.486004:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971489792 00000100:00100000:0.0:1788987194.486010:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971489792 00000100:00100000:0.0:1788987194.486053:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1649 00000100:00100000:0.0:1788987194.486065:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+10:2348:x1875885971489792:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:0.0:1788987194.486148:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:da528634-9595-47cd-9385-2665acd18d8b+10:2348:x1875885971489792:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 84us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987194.486161:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1649 00000100:00100000:3.0:1788987195.394726:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993725184:0@lo:400:kworker.0 00000100:00100000:3.0:1788987195.394827:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987195.394896:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993725440:0@lo:400:kworker.0 00000100:00100000:3.0:1788987195.394912:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993725696:0@lo:400:kworker.0 00000100:00100000:2.0:1788987195.394934:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987195.394949:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993725184 00000100:00100000:3.0:1788987195.394959:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993725184 00000100:00100000:2.0:1788987195.394976:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788987195.394982:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993725056:0@lo:400:kworker.0 00000100:00100000:2.0:1788987195.395011:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987195.395031:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2127 00000100:00100000:2.0:1788987195.395033:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993725568:0@lo:400:kworker.0 00000100:00100000:3.0:1788987195.395042:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993725184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987195.395052:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987195.395083:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993725440 00000100:00100000:2.0:1788987195.395109:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993725440 00000100:00100000:3.0:1788987195.395117:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3318:x1875885993725184:12345-0@lo:400:kworker.0 Request processed in 79us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987195.395125:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2127 00000100:00100000:2.0:1788987195.395140:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1617 00000100:00100000:3.0:1788987195.395141:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993725568 00000100:00100000:3.0:1788987195.395144:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993725568 00000100:00100000:2.0:1788987195.395146:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993725440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987195.395172:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2128 00000100:00100000:3.0:1788987195.395181:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993725568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987195.395182:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80d67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993725440:12345-0@lo:400:kworker.0 Request processed in 37us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987195.395188:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1617 00000100:00100000:3.0:1788987195.395206:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1875885993725568:12345-0@lo:400:kworker.0 Request processed in 28us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987195.395209:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993725056 00000100:00100000:3.0:1788987195.395212:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2128 00000100:00100000:2.0:1788987195.395212:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993725056 00000100:00100000:2.0:1788987195.395235:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1650 00000100:00100000:2.0:1788987195.395241:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993725056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987195.395272:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3320:x1875885993725056:12345-0@lo:400:kworker.0 Request processed in 32us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987195.395282:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1650 00000100:00080000:2.0:1788987195.395312:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788987195.395349:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:2b823764-e7a6-4601-a766-b07f91a03a4c:3320:1875885993725056:0@lo:400:kworker.0 00000100:00100000:2.0:1788987195.395365:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3320:1875885993725568:0@lo:400:kworker.0 00000100:00100000:2.0:1788987195.395374:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993725440:0@lo:400:kworker.0 00000100:00100000:1.0:1788987195.395530:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993725312:0@lo:400:kworker.0 00000100:00100000:1.0:1788987195.395566:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987195.395617:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993725312 00000100:00100000:1.0:1788987195.395621:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993725312 00000100:00100000:2.0:1788987195.395653:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987195.395654:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1788987195.395660:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993725312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987195.395687:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3318:1875885993725184:0@lo:400:kworker.0 00000100:00100000:1.0:1788987195.395694:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3319:x1875885993725312:12345-0@lo:400:kworker.0 Request processed in 35us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987195.395700:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2129 00000100:00100000:1.0:1788987195.395718:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993725696 00000100:00100000:1.0:1788987195.395721:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993725696 00000100:00100000:1.0:1788987195.395762:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1618 00000100:00100000:1.0:1788987195.395768:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b09439aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993725696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987195.395806:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b09439aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993725696:12345-0@lo:400:kworker.0 Request processed in 38us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987195.395812:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1618 00000100:00080000:1.0:1788987195.395826:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788987195.395829:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987195.395983:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3319:1875885993725312:0@lo:400:kworker.0 00000100:00100000:1.0:1788987195.396017:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993725696:0@lo:400:kworker.0 00010000:00010000:0.0:1788987195.463176:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788987195.550695:0:110727:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff66526f50 20000000:00000080:0.0:1788987195.550713:0:110727:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a43245000 uarg=0000000000000000 00010000:00010000:0.0:1788987195.554021:0:110727:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a7f9e9800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788987195.554040:0:110727:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a7f9e9800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788987195.554072:0:110727:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788987195.554308:0:110727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987195.554326:0:110727:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54aba2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54ab9b expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987195.554334:0:110727:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987195.554370:0:110727:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54aba2 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54ab9b expref: 18 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987195.554388:0:110727:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54aba2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54ab9b expref: 18 pid: 5849 timeout: 3079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987195.554401:0:110727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110727:1875885993725824:0@lo:104: 00000100:00100000:0.0:1788987195.554510:0:110727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987195.554617:0:110727:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b09413576c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788987195.554699:0:5838:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788987195.554711:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993725824 00000100:00100000:2.0:1788987195.554718:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993725824 00000100:00100000:2.0:1788987195.554762:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 433 00000100:00100000:2.0:1788987195.554771:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:110727:x1875885993725824:12345-0@lo:104: 00010000:00010000:2.0:1788987195.554905:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54aba2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987195.555004:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788987195.555011:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80ef8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:110727:x1875885993725824:12345-0@lo:104: Request processed in 241us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987195.555018:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 433 00010000:00010000:1.0:1788987195.555112:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788987195.555120:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54aba2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987195.555127:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508efc00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:1.0:1788987195.555132:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54aba2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987195.555140:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54aba2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788987195.555147:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54aba2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788987195.555152:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:1.0:1788987195.555192:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aba2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987195.555199:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788987195.555227:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aba2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987195.555235:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a508efc00/0xc20d828fcf54ab9b lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54aba2 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987195.555249:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987195.555251:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987195.555253:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987195.555260:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788987195.555270:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993725952:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788987195.555300:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987195.555428:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993725952 00000100:00100000:2.0:1788987195.555433:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993725952 00010000:00010000:2.0:1788987195.555451:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54aba2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54ab9b expref: 19 pid: 5849 timeout: 3079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987195.555480:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1788987195.555487:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993725952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987195.555496:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987195.555501:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54aba2 lrc: 5/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54ab9b expref: 19 pid: 5849 timeout: 3079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987195.555511:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54aba2 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54ab9b expref: 19 pid: 5849 timeout: 3079 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987195.555525:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987195.555532:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987195.555544:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987195.555551:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987195.555557:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987195.555562:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987195.555566:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508ef600 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987195.555569:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987195.555577:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987195.555589:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987195.555597:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987195.555629:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb30a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993725952:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987195.555635:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:2.0:1788987195.555662:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fb33100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993725952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987195.555912:0:110727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2600/0xc20d828fcf54aba2 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54ab9b expref: 18 pid: 5849 timeout: 3079 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987195.555923:0:110727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110727:1875885993725824:0@lo:104: 00010000:00010000:0.0:1788987195.555935:0:110727:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987195.555944:0:110727:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987195.555949:0:110727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987195.555955:0:110727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ef600/0xc20d828fcf54aba9 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987195.908388:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993726080:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788987195.908463:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987195.908589:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993726080 00000100:00100000:2.0:1788987195.908598:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993726080 00000100:00100000:2.0:1788987195.908649:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:2.0:1788987195.908657:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993726080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788987195.908687:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987195.908735:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fb33100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993726080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987195.908741:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1788987195.910400:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993726080:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788987196.397800:0:110775:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffcddb438c0 20000000:00000080:1.0:1788987196.397817:0:110775:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a45765800 uarg=0000000000000000 00010000:00010000:1.0:1788987196.398038:0:110775:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a7f9e9800, canceled 0 locks, left on hash table 0. 00010000:00010000:1.0:1788987196.398054:0:110775:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a7f9e9800, canceled 0 locks, left on hash table 0. 10000000:01000000:1.0:1788987196.398073:0:110775:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:1.0:1788987196.398274:0:110775:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf54abb0 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987196.398290:0:110775:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf54abb0 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987196.398299:0:110775:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf54abb0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987196.398305:0:110775:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf54abb0 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987196.398311:0:110775:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf54abb0 lrc: 3/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987196.398318:0:110775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf54abb0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987196.398324:0:110775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d49800 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:1.0:1788987196.398327:0:110775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf54abb0 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987196.398335:0:110775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf54abb0 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987196.398348:0:110775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf54abb0 lrc: 3/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987196.398359:0:110775:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf54abb0 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987196.398365:0:110775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a43d49800/0xc20d828fcf54abb0 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110775 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987196.481187:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788987197.376212:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:3.0:1788987197.376225:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:3.0:1788987197.376231:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788987197.376294:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987197.376309:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987197.376324:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987197.376356:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993726208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788987197.376444:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987197.376504:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0948acfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788987197.378395:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993726208 00000100:00100000:0.0:1788987197.378413:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993726208 00000100:00100000:0.0:1788987197.378488:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1651 00000100:00100000:0.0:1788987197.378504:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993726208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987197.378526:0:5848:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788987197.378550:0:5848:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54abbe lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54abb7 expref: -99 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987197.378585:0:5848:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54abbe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54abb7 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987197.378598:0:5848:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54abbe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54abb7 expref: 19 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987197.378609:0:5848:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ee600, rc 0) 00000100:00100000:0.0:1788987197.380881:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993726208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2356us (4409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987197.380900:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1651 00000100:00100000:3.0:1788987197.381282:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993726208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987197.381320:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54abbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987197.381337:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54abbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987197.381376:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788987197.381384:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54abbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987197.381392:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54abbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788987197.436255:0:110824:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007ffe5f1214b0 20000000:00000080:3.0:1788987197.436280:0:110824:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a80854000 uarg=0000000000000000 00010000:00010000:3.0:1788987197.437215:0:110824:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a7f9e9800, canceled 0 locks, left on hash table 0. 00010000:00010000:3.0:1788987197.437241:0:110824:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a7f9e9800, canceled 0 locks, left on hash table 0. 10000000:01000000:3.0:1788987197.437267:0:110824:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:3.0:1788987197.437292:0:110824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987197.437314:0:110824:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54abbe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54abb7 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987197.437324:0:110824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987197.437380:0:110824:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54abbe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54abb7 expref: 18 pid: 5848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987197.437399:0:110824:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54abbe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54abb7 expref: 18 pid: 5848 timeout: 3081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788987197.437416:0:110824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110824:1875885993726336:0@lo:104: 00000100:00100000:3.0:1788987197.437619:0:110824:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987197.437737:0:110824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0948acfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788987197.437978:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993726336 00000100:00100000:0.0:1788987197.437988:0:5837:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993726336 00000100:00100000:0.0:1788987197.438232:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 434 00000100:00100000:0.0:1788987197.438246:0:5837:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f350700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:110824:x1875885993726336:12345-0@lo:104: 00010000:00010000:0.0:1788987197.438265:0:5837:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54abbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987197.438379:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788987197.438385:0:5837:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f350700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+3:110824:x1875885993726336:12345-0@lo:104: Request processed in 144us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987197.438392:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 434 00000100:00100000:1.0:1788987197.438477:0:110824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:110824:1875885993726336:0@lo:104: 00010000:00010000:1.0:1788987197.438504:0:110824:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.438606:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788987197.438615:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54abbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.438624:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2e00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788987197.438629:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54abbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.438638:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54abbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788987197.438652:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54abbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987197.438659:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788987197.438719:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54abbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.438727:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788987197.438759:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54abbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.438768:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a413a2e00/0xc20d828fcf54abb7 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54abbe expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.438790:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987197.438792:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987197.438794:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987197.438810:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993726464:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788987197.438870:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987197.438942:0:8524:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993726464 00000100:00100000:2.0:1788987197.438949:0:8524:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993726464 00010000:00010000:2.0:1788987197.438975:0:8524:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54abbe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54abb7 expref: 19 pid: 5848 timeout: 3081 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987197.439003:0:8524:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1788987197.439011:0:8524:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993726464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987197.439023:0:8524:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987197.439028:0:8524:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54abbe lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54abb7 expref: 19 pid: 5848 timeout: 3081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.439041:0:8524:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54abbe lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54abb7 expref: 19 pid: 5848 timeout: 3081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.439057:0:8524:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508ee600/0xc20d828fcf54abbe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54abb7 expref: 19 pid: 5848 timeout: 3081 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.439075:0:8524:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.439086:0:8524:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.439137:0:8524:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.439145:0:8524:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.439154:0:8524:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.439162:0:8524:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.439168:0:8524:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a413a2c00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987197.439172:0:8524:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.439181:0:8524:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.439199:0:8524:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987197.439209:0:8524:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987197.439242:0:8524:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe14700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3321:x1875885993726464:12345-0@lo:103:ldlm_bl.0 Request processed in 232us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987197.439249:0:8524:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1788987197.439291:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993726464:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788987197.439394:0:110824:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987197.439403:0:110824:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987197.439410:0:110824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2c00/0xc20d828fcf54abc5 lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 110824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987197.506795:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987198.538763:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788987198.723235:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:1.0:1788987198.723246:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:1.0:1788987198.723252:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788987198.723315:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987198.723327:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788987198.723338:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788987198.723366:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993726592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788987198.723440:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987198.723507:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0948541840 going to sleep for 11 seconds 00000100:00100000:3.0:1788987198.723572:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993726592 00000100:00100000:3.0:1788987198.723581:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993726592 00000100:00100000:3.0:1788987198.723646:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1652 00000100:00100000:3.0:1788987198.723656:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993726592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987198.723672:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788987198.723685:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54abd3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54abcc expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987198.723712:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54abd3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54abcc expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987198.723724:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54abd3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54abcc expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987198.723733:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2800, rc 0) 00000100:00100000:3.0:1788987198.723779:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b83850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993726592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987198.723785:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1652 00000100:00100000:3.0:1788987198.723833:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993726592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788987198.723863:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54abd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987198.723873:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54abd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788987198.723894:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788987198.723902:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54abd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987198.723910:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54abd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987199.490647:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788987199.490682:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993726720:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788987199.490766:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987199.490856:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993726720 00000100:00100000:2.0:1788987199.490863:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993726720 00000100:00100000:2.0:1788987199.490949:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:2.0:1788987199.490959:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0942bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993726720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788987199.490991:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788987199.491039:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0942bb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993726720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987199.491046:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:2.0:1788987199.491139:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993726720:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788987199.491224:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788987199.557695:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987199.603883:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987199.603939:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987199.603969:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971490048 00000100:00100000:1.0:1788987199.603979:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971490048 00000100:00100000:1.0:1788987199.604023:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1653 00000100:00100000:1.0:1788987199.604032:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da528634-9595-47cd-9385-2665acd18d8b+10:2349:x1875885971490048:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788987199.604123:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da528634-9595-47cd-9385-2665acd18d8b+10:2349:x1875885971490048:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 91us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987199.604130:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1653 00000100:00100000:3.0:1788987199.604789:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971490176 00000100:00100000:3.0:1788987199.604796:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971490176 00000100:00100000:3.0:1788987199.604878:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2130 00000100:00100000:3.0:1788987199.604888:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c602a535-9f45-4972-b672-7d262fcb8aee+5:2349:x1875885971490176:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788987199.604936:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c602a535-9f45-4972-b672-7d262fcb8aee+5:2349:x1875885971490176:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 50us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987199.604942:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2130 00000100:00080000:1.0:1788987199.605629:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987200.512286:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788987200.512316:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993726848:0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.512404:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987200.512485:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993726848 00000100:00100000:3.0:1788987200.512494:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993726848 00000100:00100000:3.0:1788987200.512547:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1654 00000100:00100000:3.0:1788987200.512556:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993726848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.512618:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b80050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3318:x1875885993726848:12345-0@lo:400:kworker.0 Request processed in 62us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987200.512626:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1654 00000100:00100000:3.0:1788987200.512682:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:2b823764-e7a6-4601-a766-b07f91a03a4c:3318:1875885993726848:0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.512732:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993726976:0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.512762:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987200.512800:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993726976 00000100:00100000:3.0:1788987200.512804:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993726976 00000100:00100000:3.0:1788987200.512852:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2131 00000100:00100000:3.0:1788987200.512859:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993726976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.512896:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1875885993726976:12345-0@lo:400:kworker.0 Request processed in 38us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987200.512903:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2131 00000100:00100000:3.0:1788987200.512935:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3320:1875885993726976:0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.512968:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993727104:0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.512993:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987200.513023:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993727104 00000100:00100000:3.0:1788987200.513027:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993727104 00000100:00100000:3.0:1788987200.513060:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2132 00000100:00100000:3.0:1788987200.513066:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993727104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.513129:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1875885993727104:12345-0@lo:400:kworker.0 Request processed in 62us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987200.513136:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2132 00000100:00080000:3.0:1788987200.513154:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987200.513177:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3321:1875885993727104:0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.513210:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993727232:0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.513236:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987200.513264:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993727232 00000100:00100000:3.0:1788987200.513267:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993727232 00000100:00100000:3.0:1788987200.513294:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1619 00000100:00100000:3.0:1788987200.513300:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993727232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.513332:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993727232:12345-0@lo:400:kworker.0 Request processed in 32us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987200.513339:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1619 00000100:00100000:3.0:1788987200.513364:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993727232:0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.513389:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788987200.513394:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993727360:0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.513416:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987200.513443:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993727360 00000100:00100000:3.0:1788987200.513446:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993727360 00000100:00100000:3.0:1788987200.513496:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2133 00000100:00100000:3.0:1788987200.513502:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993727360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.513535:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3318:x1875885993727360:12345-0@lo:400:kworker.0 Request processed in 34us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987200.513541:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2133 00000100:00080000:3.0:1788987200.513555:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987200.513572:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3318:1875885993727360:0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.513605:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993727488:0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.513630:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987200.513660:0:8478:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993727488 00000100:00100000:3.0:1788987200.513664:0:8478:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993727488 00000100:00100000:3.0:1788987200.513695:0:8478:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1620 00000100:00100000:3.0:1788987200.513700:0:8478:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993727488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987200.513736:0:8478:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993727488:12345-0@lo:400:kworker.0 Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987200.513742:0:8478:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1620 00000100:00080000:3.0:1788987200.513760:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788987200.513777:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993727488:0@lo:400:kworker.0 00010000:00010000:0.0:1788987200.578616:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987201.024373:0:3320:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788987201.024991:0:3320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993727616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788987201.025063:0:3320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987201.029043:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993727616 00000100:00100000:1.0:1788987201.029058:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993727616 00000100:00100000:0.0:1788987201.029402:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1788987201.029415:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993727616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987201.029456:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987201.029549:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3320:x1875885993727616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (4485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987201.029556:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1788987201.029613:0:3320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a760e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3320:1875885993727616:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788987201.603144:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788987202.326558:0:111021:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866c5 len=0 uarg=00007fff1f6c4de0 20000000:00000080:0.0:1788987202.326576:0:111021:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866c5 len=576 karg=ffff9b0a7fe87800 uarg=0000000000000000 00010000:00010000:0.0:1788987202.327071:0:111021:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9b0a7f9e9800, canceled 0 locks, left on hash table 0. 00010000:00010000:0.0:1788987202.327086:0:111021:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9b0a7f9e9800, canceled 0 locks, left on hash table 0. 10000000:01000000:0.0:1788987202.327143:0:111021:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 00010000:00010000:0.0:1788987202.327161:0:111021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987202.327178:0:111021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54abd3 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54abcc expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987202.327186:0:111021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 4/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987202.327221:0:111021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54abd3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xc20d828fcf54abcc expref: 18 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987202.327234:0:111021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54abd3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xc20d828fcf54abcc expref: 18 pid: 5846 timeout: 3086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788987202.327246:0:111021:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111021:1875885993727744:0@lo:104: 00000100:00100000:0.0:1788987202.327305:0:111021:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987202.329641:0:111021:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0a513b6540 going to sleep for 11 seconds 00000100:00100000:2.0:1788987202.330657:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993727744 00000100:00100000:2.0:1788987202.330670:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993727744 00000100:00100000:3.0:1788987202.333811:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 435 00000100:00100000:3.0:1788987202.333837:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:111021:x1875885993727744:12345-0@lo:104: 00010000:00010000:3.0:1788987202.333858:0:5838:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54abd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987202.333960:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788987202.333967:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b094247f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:2b823764-e7a6-4601-a766-b07f91a03a4c+3:111021:x1875885993727744:12345-0@lo:104: Request processed in 146us (6662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987202.333974:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 435 00000100:00100000:0.0:1788987202.334044:0:111021:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:111021:1875885993727744:0@lo:104: 00010000:00010000:0.0:1788987202.334067:0:111021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 3/0,1 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.335882:0:5842:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788987202.335896:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xc20d828fcf54abd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.335911:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a43d48a00 already unused, calling callback (ffffffffc1b23c20) 10000000:00010000:2.0:1788987202.335916:0:5842:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xc20d828fcf54abd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.335926:0:5842:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xc20d828fcf54abd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788987202.335932:0:5842:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xc20d828fcf54abd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987202.335938:0:5842:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 00010000:00010000:2.0:1788987202.336001:0:5842:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54abd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336008:0:5842:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788987202.336038:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 1/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54abd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336045:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.121@tcp lock: ffff9b0a43d48a00/0xc20d828fcf54abcc lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xc20d828fcf54abd3 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336068:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987202.336070:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788987202.336071:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987202.336082:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788987202.336149:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993727872:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788987202.336217:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987202.336291:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993727872 00000100:00100000:2.0:1788987202.336299:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993727872 00010000:00010000:2.0:1788987202.336331:0:5839:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54abd3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54abcc expref: 19 pid: 5846 timeout: 3086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987202.336366:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1788987202.336375:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941329500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3319:x1875885993727872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788987202.336387:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788987202.336392:0:5839:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54abd3 lrc: 4/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xc20d828fcf54abcc expref: 19 pid: 5846 timeout: 3086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336403:0:5839:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54abd3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xc20d828fcf54abcc expref: 19 pid: 5846 timeout: 3086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336417:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a413a2800/0xc20d828fcf54abd3 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xc20d828fcf54abcc expref: 19 pid: 5846 timeout: 3086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336431:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 3/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336440:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 4/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336456:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336463:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 5/0,1 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336470:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 4/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336477:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336482:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a508eea00 already unused, calling callback (ffffffffc14ed8b0) 00010000:00010000:2.0:1788987202.336486:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 5/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336500:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 6/0,0 mode: EX/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336512:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 4/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.336521:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788987202.336556:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941329500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:3319:x1875885993727872:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987202.336563:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:2.0:1788987202.336601:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:2b823764-e7a6-4601-a766-b07f91a03a4c:3319:1875885993727872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788987202.337698:0:111021:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987202.337711:0:111021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 1/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987202.337717:0:111021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9b0a508eea00/0xc20d828fcf54abda lrc: 0/0,0 mode: --/EX res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 111021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987202.624249:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788987203.398656:0:5851:0:(mgc_request.c:611:do_requeue()) updating log nodemap 10000000:01000000:2.0:1788987203.398663:0:5851:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9b0a51b64d40 from 1 10000000:01000000:2.0:1788987203.398667:0:5851:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788987203.398787:0:5851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54abe1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987203.398798:0:5851:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54abe1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987203.398808:0:5851:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54abe1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788987203.398844:0:5851:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941329c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993728000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788987203.398903:0:5851:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987203.398958:0:5851:0:(client.c:2716:ptlrpc_set_wait()) set ffff9b0941357cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788987203.399359:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993728000 00000100:00100000:0.0:1788987203.399367:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993728000 00000100:00100000:0.0:1788987203.399423:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1655 00000100:00100000:0.0:1788987203.399432:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+18:5851:x1875885993728000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788987203.399444:0:5846:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788987203.399458:0:5846:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54abe8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc20d828fcf54abe1 expref: -99 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987203.399479:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54abe8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xc20d828fcf54abe1 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987203.399489:0:5846:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9b0a508ef400/0xc20d828fcf54abe8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xc20d828fcf54abe1 expref: 19 pid: 5846 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788987203.399503:0:5846:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a508ef400, rc 0) 00000100:00100000:0.0:1788987203.399549:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b82c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b823764-e7a6-4601-a766-b07f91a03a4c+19:5851:x1875885993728000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987203.399556:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1655 00000100:00100000:2.0:1788987203.399802:0:5851:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941329c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:2b823764-e7a6-4601-a766-b07f91a03a4c:5851:1875885993728000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788987203.399816:0:5851:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54abe1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54abe8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987203.402304:0:5851:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54abe1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xc20d828fcf54abe8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788987203.402334:0:5851:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.121@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788987203.402339:0:5851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54abe1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54abe8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987203.402348:0:5851:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.121@tcp lock: ffff9b0a581f1600/0xc20d828fcf54abe1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xc20d828fcf54abe8 expref: -99 pid: 5851 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987203.648539:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987204.610028:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788987204.610053:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993728128:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788987204.610151:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987204.610207:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993728128 00000100:00100000:0.0:1788987204.610214:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993728128 00000100:00100000:0.0:1788987204.610264:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:0.0:1788987204.610273:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993728128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788987204.610501:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987204.610545:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993728128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 273us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987204.610553:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00080000:0.0:1788987204.610573:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788987204.610609:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b094247e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993728128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788987204.672528:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987204.723616:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987204.723753:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971490304 00000100:00100000:3.0:1788987204.723762:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971490304 00000100:00100000:3.0:1788987204.723848:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1656 00000100:00100000:3.0:1788987204.723868:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da528634-9595-47cd-9385-2665acd18d8b+10:2348:x1875885971490304:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788987204.723942:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a46b81850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:da528634-9595-47cd-9385-2665acd18d8b+10:2348:x1875885971490304:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 86us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987204.723949:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1656 00000100:00100000:3.0:1788987204.726518:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987204.726668:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971490432 00000100:00100000:1.0:1788987204.726678:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971490432 00000100:00100000:1.0:1788987204.726758:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2134 00000100:00100000:1.0:1788987204.726770:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c602a535-9f45-4972-b672-7d262fcb8aee+5:2348:x1875885971490432:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788987204.726860:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a797f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c602a535-9f45-4972-b672-7d262fcb8aee+5:2348:x1875885971490432:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 92us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987204.726868:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2134 00000100:00080000:3.0:1788987204.728383:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987205.632585:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993728512:0@lo:400:kworker.0 00000100:00100000:3.0:1788987205.632695:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987205.632816:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788987205.632824:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993728640:0@lo:400:kworker.0 00000100:00100000:3.0:1788987205.632856:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987205.632900:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993728512 00000100:00100000:3.0:1788987205.632911:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993728512 00000100:00100000:3.0:1788987205.632984:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2135 00000100:00100000:3.0:1788987205.633013:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993728512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987205.633079:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993728512:12345-0@lo:400:kworker.0 Request processed in 85us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987205.633113:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2135 00000100:00100000:3.0:1788987205.633144:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993728640 00000100:00100000:3.0:1788987205.633148:0:6697:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993728640 00000100:00100000:3.0:1788987205.633178:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1621 00000100:00100000:3.0:1788987205.633186:0:6697:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993728640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987205.633221:0:6697:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993728640:12345-0@lo:400:kworker.0 Request processed in 36us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987205.633227:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1621 00000100:00080000:3.0:1788987205.633245:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788987205.633289:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993728640:0@lo:400:kworker.0 00000100:00100000:3.0:1788987205.633301:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993728512:0@lo:400:kworker.0 00000100:00100000:1.0:1788987205.633561:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993728384:0@lo:400:kworker.0 00000100:00100000:1.0:1788987205.633603:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987205.633642:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993728896:0@lo:400:kworker.0 00000100:00100000:1.0:1788987205.633667:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987205.633692:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788987205.633708:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993728256:0@lo:400:kworker.0 00000100:00100000:1.0:1788987205.633741:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987205.633767:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7f5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993728768:0@lo:400:kworker.0 00000100:00100000:1.0:1788987205.633791:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987205.633834:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993728896 00000100:00100000:1.0:1788987205.633838:0:6695:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993728896 00000100:00100000:1.0:1788987205.633885:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1622 00000100:00100000:1.0:1788987205.633892:0:6695:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993728896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987205.633934:0:6695:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993728896:12345-0@lo:400:kworker.0 Request processed in 42us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987205.633940:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1622 00000100:00100000:1.0:1788987205.633963:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993728256 00000100:00100000:1.0:1788987205.633966:0:5848:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993728256 00000100:00100000:1.0:1788987205.633995:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1657 00000100:00100000:1.0:1788987205.634002:0:5848:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993728256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987205.634034:0:5848:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993728256:12345-0@lo:400:kworker.0 Request processed in 33us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987205.634041:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1657 00000100:00100000:1.0:1788987205.634074:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993728384 00000100:00100000:1.0:1788987205.634078:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993728384 00000100:00100000:1.0:1788987205.634124:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993728768 00000100:00100000:1.0:1788987205.634127:0:5854:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993728768 00000100:00100000:1.0:1788987205.634154:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2136 00000100:00100000:1.0:1788987205.634161:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993728384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987205.634193:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a760e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993728384:12345-0@lo:400:kworker.0 Request processed in 33us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987205.634200:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2136 00000100:00100000:1.0:1788987205.634213:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2137 00000100:00100000:1.0:1788987205.634219:0:5854:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993728768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788987205.634247:0:5854:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993728768:12345-0@lo:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987205.634253:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2137 00000100:00080000:1.0:1788987205.634280:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788987205.634284:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788987205.634308:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a797faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993728256:0@lo:400:kworker.0 00000100:00100000:1.0:1788987205.634322:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993728768:0@lo:400:kworker.0 00000100:00100000:1.0:1788987205.634333:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993728384:0@lo:400:kworker.0 00000100:00100000:1.0:1788987205.634342:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7f5f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993728896:0@lo:400:kworker.0 00010000:00010000:2.0:1788987205.698629:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788987206.145154:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788987206.145174:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993729024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788987206.145233:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788987206.145481:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993729024 00000100:00100000:0.0:1788987206.145490:0:6699:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993729024 00000100:00100000:0.0:1788987206.145592:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1788987206.145602:0:6699:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993729024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788987206.145637:0:6699:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788987206.145686:0:6699:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941835880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993729024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788987206.145694:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:0.0:1788987206.145851:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941834a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993729024:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788987206.720443:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788987207.745131:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788987208.385644:0:111218:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-sec test 25c: test yaml-compliance for nodemap ========================================================== 16:53:26 (1788987206) 00010000:00010000:2.0:1788987208.768515:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788987209.278189:0:3313:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:3.0:1788987209.278303:0:5856:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971490560 00000100:00100000:3.0:1788987209.278316:0:5856:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971490560 00000100:00100000:3.0:1788987209.278405:0:5856:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1262 00000100:00100000:3.0:1788987209.278416:0:5856:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c602a535-9f45-4972-b672-7d262fcb8aee+5:67378:x1875885971490560:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:3.0:1788987209.278443:0:5856:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788987209.278511:0:5856:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54abef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d1893 expref: -99 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987209.278573:0:5856:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54abf6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987209.278589:0:5856:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54abf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987209.278617:0:5856:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54abf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788987209.278660:0:5856:0:(mdt_handler.c:910:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788987209.278664:0:5856:0:(mdt_handler.c:1575:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788987209.278686:0:5856:0:(mdt_handler.c:2508:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54abf6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5856 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987209.278707:0:5856:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a3800/0xc20d828fcf54abef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1893 expref: 7 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987209.278727:0:5856:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a413a2200/0xc20d828fcf54abf6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d1893 expref: 6 pid: 5856 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788987209.278736:0:5856:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:3.0:1788987209.278739:0:5856:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788987209.278742:0:5856:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a413a2200, rc 0) 00000100:00100000:3.0:1788987209.278810:0:5856:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941329c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c602a535-9f45-4972-b672-7d262fcb8aee+6:67378:x1875885971490560:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 396us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987209.278816:0:5856:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1262 00000100:00080000:1.0:1788987209.279141:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788987209.290844:0:3311:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:2.0:1788987209.295138:0:7899:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971490688 00000100:00100000:2.0:1788987209.295159:0:7899:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971490688 00000100:00100000:2.0:1788987209.295587:0:7899:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1263 00000100:00100000:2.0:1788987209.295606:0:7899:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0941836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c602a535-9f45-4972-b672-7d262fcb8aee+6:67378:x1875885971490688:12345-192.168.206.21@tcp:101:lfs.0 00010000:00010000:2.0:1788987209.295626:0:7899:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788987209.295647:0:7899:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54abfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd5e97b26b54d189a expref: -99 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.295710:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54ac04 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.295724:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54ac04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.295737:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54ac04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.295751:0:7899:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54ac0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.295757:0:7899:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54ac0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.295764:0:7899:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54ac0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296000:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54ac04 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296008:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54ac04 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296013:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54ac04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296019:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f0800 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788987209.296023:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54ac04 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296034:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54ac04 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296046:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:2.0:1788987209.296049:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788987209.296054:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54ac04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296059:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f0800/0xc20d828fcf54ac04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296070:0:7899:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54ac0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296075:0:7899:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54ac0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296081:0:7899:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54ac0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296142:0:7899:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9b0a581f1e00 already unused, calling callback (ffffffffc1f4a4f0) 00010000:00010000:2.0:1788987209.296147:0:7899:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54ac0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296153:0:7899:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54ac0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296161:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe6cb9a5d (ffff9b0a45aca200) 00010000:00010000:2.0:1788987209.296164:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788987209.296167:0:7899:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54ac0b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296177:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1e00/0xc20d828fcf54ac0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe6cb9a5d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7899 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296212:0:7899:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54abfd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d189a expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296222:0:7899:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9b0a55745600) 00010000:00010000:2.0:1788987209.296224:0:7899:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788987209.296228:0:7899:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9b0a581f1000/0xc20d828fcf54abfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.21@tcp remote: 0xd5e97b26b54d189a expref: 7 pid: 7899 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788987209.296237:0:7899:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9b0a581f1000, rc 0) 00000100:00100000:2.0:1788987209.296331:0:7899:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0941836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c602a535-9f45-4972-b672-7d262fcb8aee+6:67378:x1875885971490688:12345-192.168.206.21@tcp:101:lfs.0 Request processed in 734us (5495us total) trans 0 rc 301/301 00000100:00100000:2.0:1788987209.296339:0:7899:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1263 00000100:00100000:2.0:1788987209.729341:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987209.729360:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993729152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788987209.729421:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987209.729815:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993729152 00000100:00100000:1.0:1788987209.729823:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993729152 00000100:00100000:1.0:1788987209.729893:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:1.0:1788987209.729903:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a80c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993729152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788987209.729934:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987209.729982:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a80c1b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993729152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987209.729989:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00080000:0.0:1788987209.730263:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788987209.731323:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993729152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788987209.794973:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987209.846516:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:0.0:1788987209.846566:0:3312:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.21@tcp (source: 12345-192.168.206.21@tcp) 00000100:00100000:1.0:1788987209.846637:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971490816 00000100:00100000:1.0:1788987209.846648:0:5846:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971490816 00000100:00100000:1.0:1788987209.846706:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 1658 00000100:00100000:1.0:1788987209.846715:0:5846:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:2347:x1875885971490816:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:1.0:1788987209.846795:0:5846:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:da528634-9595-47cd-9385-2665acd18d8b+10:2347:x1875885971490816:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 70us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987209.846802:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 1658 00000100:00100000:3.0:1788987209.846994:0:15241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885971490944 00000100:00100000:3.0:1788987209.846999:0:15241:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885971490944 00000100:00100000:3.0:1788987209.847039:0:15241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.21@tcp, seq: 2138 00000100:00100000:3.0:1788987209.847047:0:15241:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c602a535-9f45-4972-b672-7d262fcb8aee+6:2347:x1875885971490944:12345-192.168.206.21@tcp:400:kworker.0 00000100:00100000:3.0:1788987209.847119:0:15241:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:c602a535-9f45-4972-b672-7d262fcb8aee+6:2347:x1875885971490944:12345-192.168.206.21@tcp:400:kworker.0 Request processed in 72us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987209.847126:0:15241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.21@tcp, seq: 2138 00000001:02000400:2.0:1788987210.643574:0:111266:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-sec test_25c: @@@@@@ FAIL: failed to mkdir /mnt/lustre/d25c.sanity-sec 00000100:00100000:2.0:1788987210.752664:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993729536:0@lo:400:kworker.0 00000100:00100000:2.0:1788987210.752732:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987210.752799:0:3318:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788987210.752806:0:3318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993729664:0@lo:400:kworker.0 00000100:00100000:2.0:1788987210.752835:0:3318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788987210.752870:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993729664 00000100:00100000:2.0:1788987210.752877:0:6698:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993729664 00000100:00100000:2.0:1788987210.752922:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1623 00000100:00100000:2.0:1788987210.752930:0:6698:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993729664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987210.752980:0:6698:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3318:x1875885993729664:12345-0@lo:400:kworker.0 Request processed in 50us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987210.752987:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1623 00000100:00100000:2.0:1788987210.753036:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943707800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3318:1875885993729664:0@lo:400:kworker.0 00000100:00100000:3.0:1788987210.753215:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993729408:0@lo:400:kworker.0 00000100:00100000:3.0:1788987210.753246:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987210.753269:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0a7fe57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993729920:0@lo:400:kworker.0 00000100:00100000:3.0:1788987210.753301:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987210.753321:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788987210.753326:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993729280:0@lo:400:kworker.0 00000100:00100000:3.0:1788987210.753353:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987210.753376:0:3321:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993729792:0@lo:400:kworker.0 00000100:00100000:3.0:1788987210.753398:0:3321:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788987210.753423:0:86533:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993729920 00000100:00100000:3.0:1788987210.753427:0:86533:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993729920 00000100:00100000:3.0:1788987210.753461:0:86533:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1624 00000100:00100000:3.0:1788987210.753467:0:86533:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993729920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987210.753505:0:86533:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1875885993729920:12345-0@lo:400:kworker.0 Request processed in 37us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987210.753511:0:86533:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1624 00000100:00100000:3.0:1788987210.753533:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993729280 00000100:00100000:3.0:1788987210.753537:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993729280 00000100:00100000:3.0:1788987210.753561:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1659 00000100:00100000:3.0:1788987210.753567:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993729280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788987210.753594:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a45ba1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b823764-e7a6-4601-a766-b07f91a03a4c+19:3321:x1875885993729280:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788987210.753600:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1659 00000100:00100000:3.0:1788987210.753632:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b09439ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:2b823764-e7a6-4601-a766-b07f91a03a4c:3321:1875885993729280:0@lo:400:kworker.0 00000100:00100000:3.0:1788987210.753641:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0a7fe57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3321:1875885993729920:0@lo:400:kworker.0 00000100:00100000:2.0:1788987210.754471:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993729536 00000100:00100000:2.0:1788987210.754479:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993729536 00000100:00100000:2.0:1788987210.754523:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993729408 00000100:00100000:2.0:1788987210.754526:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993729408 00000100:00100000:2.0:1788987210.754546:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993729792 00000100:00100000:2.0:1788987210.754549:0:5855:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993729792 00000100:00100000:2.0:1788987210.754579:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1788987210.754586:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993729536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987210.754644:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3318:x1875885993729536:12345-0@lo:400:kworker.0 Request processed in 58us (1912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987210.754651:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2139 00000100:00100000:2.0:1788987210.754666:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1788987210.754672:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993729408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987210.754709:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1875885993729408:12345-0@lo:400:kworker.0 Request processed in 37us (1462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987210.754714:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2140 00000100:00100000:2.0:1788987210.754725:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1788987210.754730:0:5855:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993729792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788987210.754757:0:5855:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7f5f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1875885993729792:12345-0@lo:400:kworker.0 Request processed in 27us (1358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788987210.754762:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2141 00000100:00100000:2.0:1788987210.754812:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3321:1875885993729792:0@lo:400:kworker.0 00000100:00100000:2.0:1788987210.754823:0:3321:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943704a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3321:1875885993729408:0@lo:400:kworker.0 00000100:00100000:2.0:1788987210.754858:0:3318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0943706a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3318:1875885993729536:0@lo:400:kworker.0 00000100:00080000:0.0:1788987210.754950:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788987210.754955:0:5850:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788987210.820398:0:5843:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788987211.266518:0:3319:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788987211.266549:0:3319:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9b0941836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993730048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788987211.266623:0:3319:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788987211.266942:0:6700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875885993730048 00000100:00100000:1.0:1788987211.266950:0:6700:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875885993730048 00000100:00100000:1.0:1788987211.267004:0:6700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:1.0:1788987211.267013:0:6700:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9b0a7fe80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993730048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788987211.267044:0:6700:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40697856 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788987211.267123:0:6700:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9b0a7fe80a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3319:x1875885993730048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788987211.267130:0:6700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:3.0:1788987211.267233:0:3319:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9b0941836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3319:1875885993730048:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788987211.842852:0:5842:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 74537 lines, 74537 kept, 0 dropped, 0 bad.